-- Logs begin at Fri 2022-09-16 04:53:17 UTC, end at Fri 2022-09-16 05:49:41 UTC. -- Sep 16 05:20:04.856939 dv-cinder-857528-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 16 05:20:04.864227 dv-cinder-857528-3-smb devstack@keystone.service[104758]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 16 05:20:04.866230 dv-cinder-857528-3-smb devstack@keystone.service[104758]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 05:20:04 2022] *** Sep 16 05:20:04.866230 dv-cinder-857528-3-smb devstack@keystone.service[104758]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 05:20:04.866230 dv-cinder-857528-3-smb devstack@keystone.service[104758]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 05:20:04.866230 dv-cinder-857528-3-smb devstack@keystone.service[104758]: nodename: dv-cinder-857528-3-smb Sep 16 05:20:04.866230 dv-cinder-857528-3-smb devstack@keystone.service[104758]: machine: x86_64 Sep 16 05:20:04.866230 dv-cinder-857528-3-smb devstack@keystone.service[104758]: clock source: unix Sep 16 05:20:04.866230 dv-cinder-857528-3-smb devstack@keystone.service[104758]: pcre jit disabled Sep 16 05:20:04.866230 dv-cinder-857528-3-smb devstack@keystone.service[104758]: detected number of CPU cores: 4 Sep 16 05:20:04.866760 dv-cinder-857528-3-smb devstack@keystone.service[104758]: current working directory: / Sep 16 05:20:04.866760 dv-cinder-857528-3-smb devstack@keystone.service[104758]: detected binary path: /usr/bin/uwsgi-core Sep 16 05:20:04.866760 dv-cinder-857528-3-smb devstack@keystone.service[104758]: your processes number limit is 47680 Sep 16 05:20:04.866760 dv-cinder-857528-3-smb devstack@keystone.service[104758]: your memory page size is 4096 bytes Sep 16 05:20:04.866760 dv-cinder-857528-3-smb devstack@keystone.service[104758]: detected max file descriptor number: 2048 Sep 16 05:20:04.866760 dv-cinder-857528-3-smb devstack@keystone.service[104758]: lock engine: pthread robust mutexes Sep 16 05:20:04.866760 dv-cinder-857528-3-smb devstack@keystone.service[104758]: thunder lock: enabled Sep 16 05:20:04.867553 dv-cinder-857528-3-smb devstack@keystone.service[104758]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 16 05:20:04.872821 dv-cinder-857528-3-smb devstack@keystone.service[104758]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 05:20:04.907085 dv-cinder-857528-3-smb devstack@keystone.service[104758]: Python main interpreter initialized at 0x55fc5d5cc9c0 Sep 16 05:20:04.907085 dv-cinder-857528-3-smb devstack@keystone.service[104758]: python threads support enabled Sep 16 05:20:04.907085 dv-cinder-857528-3-smb devstack@keystone.service[104758]: your server socket listen backlog is limited to 100 connections Sep 16 05:20:04.907085 dv-cinder-857528-3-smb devstack@keystone.service[104758]: your mercy for graceful operations on workers is 90 seconds Sep 16 05:20:04.907439 dv-cinder-857528-3-smb devstack@keystone.service[104758]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 05:20:04.907515 dv-cinder-857528-3-smb devstack@keystone.service[104758]: *** Operational MODE: preforking *** Sep 16 05:20:04.907781 dv-cinder-857528-3-smb devstack@keystone.service[104758]: *** uWSGI is running in multiple interpreter mode *** Sep 16 05:20:04.907781 dv-cinder-857528-3-smb devstack@keystone.service[104758]: spawned uWSGI master process (pid: 104758) Sep 16 05:20:04.907963 dv-cinder-857528-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 16 05:20:04.910549 dv-cinder-857528-3-smb devstack@keystone.service[104758]: spawned uWSGI worker 1 (pid: 104772, cores: 1) Sep 16 05:20:04.910829 dv-cinder-857528-3-smb devstack@keystone.service[104758]: spawned uWSGI worker 2 (pid: 104774, cores: 1) Sep 16 05:20:04.911890 dv-cinder-857528-3-smb devstack@keystone.service[104758]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 05:20:09.182207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 05:20:09.182207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: from cryptography.utils import int_from_bytes Sep 16 05:20:09.183033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 05:20:09.183033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: from cryptography.utils import int_from_bytes Sep 16 05:20:09.183469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 05:20:09.183469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: from cryptography.utils import int_from_bytes Sep 16 05:20:09.183937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 05:20:09.183937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: from cryptography.utils import int_from_bytes Sep 16 05:20:09.233490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 05:20:09.233667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 05:20:09.233769 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 05:20:09.233849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 05:20:09.233921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] command line args: [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 05:20:09.233986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] command line args: [] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 05:20:09.234125 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 05:20:09.234246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 05:20:09.234325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ================================================================================ {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 05:20:09.234397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ================================================================================ {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 05:20:09.234584 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] admin_token = **** {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.234684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] admin_token = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.234823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] config_dir = [] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.234909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] config_dir = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.235033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.235128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.235197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] config_source = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.235256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] config_source = [] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.235353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] debug = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.235455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] debug = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.235528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.235812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.235901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.235960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.236017 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] insecure_debug = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.236073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] insecure_debug = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.236273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.236359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.236599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.236691 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.236758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] list_limit = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.236816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] list_limit = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.236973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] log_config_append = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.237057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] log_config_append = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.237057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.237169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.237231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] log_dir = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.237294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] log_dir = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.237553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] log_file = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.237646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] log_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.237646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.237758 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.237909 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.238045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.238181 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.238306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.238437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.238610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.238742 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.238888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.239023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.239153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.239286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.239419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.239556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.239689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.239815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.239947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.240073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.240204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.240329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.240470 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.240602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.240727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.240851 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.240988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.241114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] notification_format = cadf {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.241249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] notification_format = cadf {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.241375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.241507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.241641 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.241767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.242340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] publish_errors = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.242423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] publish_errors = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.242494 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.242586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.242655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.242736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.242814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.242889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.242958 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.243043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.243165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.243243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.243313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] standard_threads = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.243388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] standard_threads = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.243457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] strict_password_check = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.243525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] strict_password_check = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.243604 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.243675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.243749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] use_eventlog = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.243818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] use_eventlog = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.243891 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] use_journal = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.243959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] use_journal = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.244038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] use_json = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.244109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] use_json = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.244178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] use_stderr = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.244291 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] use_stderr = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.244369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] use_syslog = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.244438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] use_syslog = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.244518 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] watch_log_file = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.244589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] watch_log_file = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 05:20:09.244669 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.244746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.244815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.244889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.244969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.245040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.245108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.245245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.245325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.245395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.245512 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.245591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.245756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.245840 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.245991 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.246073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.246236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.246320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.246479 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.246578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.246749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.246826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.246981 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.247066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.247226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.247304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.247458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.247535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.247705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.247782 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.247949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.248024 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.248186 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.248270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.248437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.248513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.248691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.248774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.248933 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.249019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.249167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.249242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.249415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.249503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.249676 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.249765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.249927 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.250003 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.250174 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.250256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.250402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.250486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.250656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.250735 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.250887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.250964 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.251131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.251219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.251369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.251451 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.251615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.251690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.251842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.251926 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.252071 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.252146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.252313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.252397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.252557 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.252643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.252793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.252869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.253039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.253114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.253268 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.253419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.253492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.253560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.253726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.253803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.253952 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.254061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.254180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.254291 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.254444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.254576 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.254687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.254798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.254901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.254996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.255111 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.255183 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.255324 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.255418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.255560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.255636 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.255786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.255903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.256019 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.256097 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.256251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.256332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.256495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.256574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.256725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.256810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.256959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.257035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.257195 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.257274 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.257418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.257990 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.258159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.258236 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.258394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.258470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.258643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.258724 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.258918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.259062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.259136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.259249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.259332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.259446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.259559 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.259687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.259817 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.259904 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.260050 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.260128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.260280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.260358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.260513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.260595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.260747 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.260825 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.261012 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.261091 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.261249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.261325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.261491 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.261575 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.261734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.261821 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.261972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.262050 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.262202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.262280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.262435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.262567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.262703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.enabled = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.262781 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.enabled = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.262938 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.263015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.263170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.263249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.263409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.263486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.263644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.263722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.263886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.263965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.264122 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.264204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.264352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.264486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.264570 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.264641 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.264806 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.264932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.265035 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.265113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.265292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.265373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.265529 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.265640 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.265774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.265859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.266008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.266085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.266242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.266319 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.266478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.266645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.266722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.266792 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.266957 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.267035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.267191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.267278 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.267417 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.267503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.267644 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.267722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.267870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.267947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.268102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.268190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.268326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.268403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.268564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.268645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.268795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.268882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.269041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.269118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.269272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.269349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.269524 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.269610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.269779 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.269857 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.270018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.270126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.270244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] auth.external = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.270329 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] auth.external = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.270474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] auth.mapped = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.270584 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] auth.mapped = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.270794 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.270874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.271025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.271102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.271255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] auth.password = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.271343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] auth.password = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.271481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] auth.token = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.271558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] auth.token = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.271719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.271797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.271953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] catalog.caching = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.272041 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] catalog.caching = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.272193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.272270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.272422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.272500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.272667 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.272753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.272911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.272989 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.273198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.273819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.273964 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] credential.caching = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.274044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] credential.caching = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.274214 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] credential.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.274292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] credential.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.274462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.274594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.274733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.274814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.274975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.275054 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.275217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.275294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.275449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.275529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.275690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.275769 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.275939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.276017 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.276173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.276253 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.276422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.276507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.276703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.276782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.276945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.277024 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.277202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.277280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.277444 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.277534 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.277695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.277773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.277928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] federation.caching = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.278006 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] federation.caching = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.278162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.278240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.278405 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] federation.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.278483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] federation.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.278668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.278746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.278897 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.278976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.279141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.279221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.279373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.279450 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.279624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.279701 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.279846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.279919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.280093 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.280172 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.280330 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.280408 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.280573 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.280651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.280804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.caching = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.280882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.caching = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.281047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.281131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.281290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.281370 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.281524 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.281602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.281757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.281843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.282004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.282082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.282234 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.282312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.282471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.282579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.282740 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.282817 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.282987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.283077 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.283228 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.283365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.283442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.283518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.283663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.283741 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.283905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.283991 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.284149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.284227 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.284389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.284467 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.284642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.284729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.284886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.284965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.285156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.285233 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.285391 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.285480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.285628 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.285707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.285857 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.285935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.286090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.286175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.286320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.286405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.286571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.286653 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.286811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.286902 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.287047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.287125 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.287291 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.287369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.287518 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.287603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.287761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.287840 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.288005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.288083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.288237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.288323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.288479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.288556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.290409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.290531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.290531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.290670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.290745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.290816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.290816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.password = **** {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.290951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.password = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291241 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291322 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291609 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291827 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.291976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292118 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292405 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292562 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292633 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292851 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292923 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.292993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.293063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.293132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.293210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.293282 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.293428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.293507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.293659 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.293737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.293905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.293986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.294152 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.294229 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.294393 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.294470 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.294632 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.294708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.294868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.294946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.295102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.295181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.295335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.295415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.295570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.295649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.295798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.295876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.296040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.296120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.296284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.296362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.296526 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.296604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.296857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.296932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.297007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.297078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.297212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.297291 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.297457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.297538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.297692 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.297770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.297925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.298004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.298161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.298240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.298390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.298474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.298656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.298735 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.298902 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.298983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.299140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.299217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.299391 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] policy.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.299468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] policy.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.299619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.299699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.299862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.299940 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.300094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.300171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.300327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] receipt.caching = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.300407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] receipt.caching = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.300563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.300640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.300804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.300881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.301046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.301131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.301272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.301350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.301509 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.301585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.301745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] resource.caching = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.301823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] resource.caching = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.301994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.302071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.302235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] resource.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.302311 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] resource.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.302454 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.302591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.302729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.302809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.303000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.303079 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.303234 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] revoke.caching = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.303315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] revoke.caching = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.303479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.303556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.303714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.303790 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.303955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] role.cache_time = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.304033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] role.cache_time = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.304187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] role.caching = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.304264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] role.caching = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.304452 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] role.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.304531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] role.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.304682 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] role.list_limit = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.304761 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] role.list_limit = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.304931 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.305008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.305173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.305261 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.305418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.305496 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.305661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.305738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.305904 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.305990 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.306147 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.306225 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.306387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.306464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.306653 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.306745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.306884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.306963 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.307130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.307207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.307371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.307458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.307614 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.307694 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.307857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.307936 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.308257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.308344 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.308495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.308572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.308742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.308819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.308988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.309073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.309234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.309311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.309480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.309558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.309713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.309798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.309962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.310039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.310211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.310288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.310448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.310559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.310704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.310782 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.310935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.311011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.311165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.311244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.311413 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.311490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.311668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.311745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.311919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.311997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.312153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.312230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.312386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.312462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.312618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] token.cache_time = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.312696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] token.cache_time = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.312849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] token.caching = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.312924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] token.caching = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.313084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.313161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.313328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] token.provider = fernet {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.313406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] token.provider = fernet {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.313560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.313643 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.313814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.313891 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.314057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.314135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.314291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.314369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.314554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.314637 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.314798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.314877 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.315042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] trust.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.315119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] trust.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.315275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.315352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.315772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.315857 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.316009 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.316086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.316252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.316328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.316529 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.316614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.316758 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.316849 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.316998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.317085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.317260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.317337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.317514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.connection = **** {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.317604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.connection = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.317757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.317835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.317999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.318076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.318235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.318320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.318470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.318562 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.318724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.318807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.318959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.319050 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.319192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.319279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.319425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.319502 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.319663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.319749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.319895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.320488 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.320657 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.320736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.320890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.320977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.321131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.321210 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.321363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.321441 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.321602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.321688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.321829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.321907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.322062 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.322139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.322296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.322448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 05:20:09.322448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=104774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 05:20:09.322604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 05:20:09.352023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.352158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.352261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.352385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.352469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.352611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.360663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.360882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.388693 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.388919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.389095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.389329 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.441764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.442272 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.491500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.491729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.497498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.497737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.647780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.648004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.648113 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.648251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.648335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.648471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.648553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.648687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.648770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.648900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.648990 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.649110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.671624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.671724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.671853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.671967 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.672078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.672161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.672299 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.672380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.672518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.672608 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.672728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.672809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.672937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.673017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.684683 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.684779 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.698215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.698333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.698398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.698543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.698629 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.698774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.698855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.698998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.699079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.699220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.699312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.699426 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=104774) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.699506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.699635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=104772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 05:20:09.716218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.716421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 05:20:09.716586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.716760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.716842 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 05:20:09.716960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 05:20:09.717126 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.717233 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.717314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 05:20:09.717493 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.717572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.717748 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.717829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.718000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.718080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.718318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.727608 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.727885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.727967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.728153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.728235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.728433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.728531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.728745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.735394 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.735766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.738277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.738582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.738690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.738868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.738972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.739151 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.739245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.739434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.739515 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.739695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.739795 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.739969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.740057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.740242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.740322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.740509 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.740589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.740777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.740858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.741040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.741120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.741315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.764739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.765056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.766207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.766490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.766608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.766813 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.771188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.771470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.771553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.771748 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.771832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.772037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.778163 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.778451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.778619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.778910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.784715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.785013 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.785305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.785594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.785874 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.786154 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.786426 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.786721 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.788953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.789255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.789540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.789822 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.790098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.790373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.790666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.790933 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.802348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.802659 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.807061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.808036 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.808320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.810300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.810632 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.812270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.814896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.815768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.816066 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.818358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.820926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.822191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.822494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.822806 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.823092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.823367 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.823653 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.824127 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.827369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.827666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.827944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.828220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.828490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.828776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.839554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.839845 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.840115 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.840379 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.844585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.844873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.845139 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.845398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.847361 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.848908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.850442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.850749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.852273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.853453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.853734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.853816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.854015 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.854297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.854718 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.855362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.855637 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.858398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.858713 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.859004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.859282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.859664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.865929 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.866216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.866500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.867300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.867690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.867970 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.868249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.871348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.871635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.871915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.872191 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.872563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.872845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.873122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.884311 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.887259 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.889081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.890150 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.891636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.892001 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.893114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.893407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.893801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.894894 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.896338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.897796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.898122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.898543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.900285 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.901773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.904707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.904895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.905103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.905390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.905663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.906354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.909249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.909645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.909925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.910196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.913528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.913844 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.914131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.918023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.918319 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.918625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.921078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=104772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.921363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.921648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.921924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.922203 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.922471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.922764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.923047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.923316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.923589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.923910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.924255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.924522 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.924788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=104772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.925480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=104774) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 05:20:09.925765 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.926044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.926323 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.926625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.926895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.927164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.927454 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.927721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.927986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.928304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.928651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.928916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.929173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=104774) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 05:20:09.960170 dv-cinder-857528-3-smb devstack@keystone.service[104772]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fc5d5cc9c0 pid: 104772 (default app) Sep 16 05:20:09.963433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be0a94-d250-4558-8ba7-e5bf80e065c0 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:09.963721 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be0a94-d250-4558-8ba7-e5bf80e065c0 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:09.963993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be0a94-d250-4558-8ba7-e5bf80e065c0 None None] PATH_INFO: `/v3` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:09.964318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fc5d5cc9c0 pid: 104774 (default app) Sep 16 05:20:09.968161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Fri Sep 16 05:20:09 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:16.706767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb335-fa5b-43c0-86ac-ce41a70b3ea7 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:16.707276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb335-fa5b-43c0-86ac-ce41a70b3ea7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:16.707355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb335-fa5b-43c0-86ac-ce41a70b3ea7 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:16.712070 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:20:16.717198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfad472-adab-4189-b00f-1fdf03d461a0 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:16.717715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfad472-adab-4189-b00f-1fdf03d461a0 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:16.717715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfad472-adab-4189-b00f-1fdf03d461a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:16.788152 dv-cinder-857528-3-smb devstack@keystone.service[104772]: INFO dbcounter [None req-2cfad472-adab-4189-b00f-1fdf03d461a0 None None] Registered counter for database keystone Sep 16 05:20:16.806787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG oslo_db.sqlalchemy.engines [None req-2cfad472-adab-4189-b00f-1fdf03d461a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 05:20:16.812881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writer thread running {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 05:20:16.990740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG passlib.handlers.bcrypt [None req-2cfad472-adab-4189-b00f-1fdf03d461a0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=104772) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 16 05:20:16.991040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG passlib.handlers.bcrypt [None req-2cfad472-adab-4189-b00f-1fdf03d461a0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=104772) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 16 05:20:17.048456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-2cfad472-adab-4189-b00f-1fdf03d461a0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:17.050070 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2cfad472-adab-4189-b00f-1fdf03d461a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:17.174797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 16 05:20:17.627429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb335-fa5b-43c0-86ac-ce41a70b3ea7 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:17.696490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: INFO dbcounter [None req-149eb335-fa5b-43c0-86ac-ce41a70b3ea7 None None] Registered counter for database keystone Sep 16 05:20:17.717511 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG oslo_db.sqlalchemy.engines [None req-149eb335-fa5b-43c0-86ac-ce41a70b3ea7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 05:20:17.723738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writer thread running {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 05:20:17.841094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb335-fa5b-43c0-86ac-ce41a70b3ea7 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:17.845323 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ea717-054b-42e8-b2a9-97f1f85c34b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:17.845944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ea717-054b-42e8-b2a9-97f1f85c34b1 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:17.846226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ea717-054b-42e8-b2a9-97f1f85c34b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:17.846499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ea717-054b-42e8-b2a9-97f1f85c34b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:17.855177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ea717-054b-42e8-b2a9-97f1f85c34b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:17.907011 dv-cinder-857528-3-smb devstack@keystone.service[104774]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a68ea717-054b-42e8-b2a9-97f1f85c34b1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 16 05:20:17.907299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ea717-054b-42e8-b2a9-97f1f85c34b1 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:17.917153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Sep 16 05:20:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:20:17.923090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfad472-adab-4189-b00f-1fdf03d461a0 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:17.939864 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfad472-adab-4189-b00f-1fdf03d461a0 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:17.944495 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00259c-03f1-49f9-8e1e-1b338cf1a7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:17.945611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00259c-03f1-49f9-8e1e-1b338cf1a7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:17.945888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00259c-03f1-49f9-8e1e-1b338cf1a7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:17.946153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00259c-03f1-49f9-8e1e-1b338cf1a7e7 admin admin] PATH_INFO: `/v3/projects/7a0a847de7a845db8a359724caa6c1da` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:17.947766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00259c-03f1-49f9-8e1e-1b338cf1a7e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=7a0a847de7a845db8a359724caa6c1da)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:18.001137 dv-cinder-857528-3-smb devstack@keystone.service[104772]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bc00259c-03f1-49f9-8e1e-1b338cf1a7e7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 16 05:20:18.001475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00259c-03f1-49f9-8e1e-1b338cf1a7e7 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:18.005977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Fri Sep 16 05:20:17 2022] GET /identity/v3/projects/7a0a847de7a845db8a359724caa6c1da => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:20:20.090324 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319caf-d94c-4072-8db4-d60bebce4271 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:20.090871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319caf-d94c-4072-8db4-d60bebce4271 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:20.090953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319caf-d94c-4072-8db4-d60bebce4271 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:20.095049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:20:20.100282 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387253d8-3a44-4bfe-8dba-07e6e26a07e5 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:20.101260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387253d8-3a44-4bfe-8dba-07e6e26a07e5 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:20.101384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387253d8-3a44-4bfe-8dba-07e6e26a07e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:20.120878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-387253d8-3a44-4bfe-8dba-07e6e26a07e5 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:20.122381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-387253d8-3a44-4bfe-8dba-07e6e26a07e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:20.130075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 16 05:20:20.390182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e319caf-d94c-4072-8db4-d60bebce4271 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:20.402721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e319caf-d94c-4072-8db4-d60bebce4271 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:20.406891 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873a0b7-3a13-46be-a73d-44269ab29e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:20.407482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873a0b7-3a13-46be-a73d-44269ab29e25 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:20.408571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873a0b7-3a13-46be-a73d-44269ab29e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:20.408571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873a0b7-3a13-46be-a73d-44269ab29e25 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:20.416371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873a0b7-3a13-46be-a73d-44269ab29e25 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:20.418139 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873a0b7-3a13-46be-a73d-44269ab29e25 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:20.426754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Sep 16 05:20:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:20:20.431878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387253d8-3a44-4bfe-8dba-07e6e26a07e5 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:20.441008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387253d8-3a44-4bfe-8dba-07e6e26a07e5 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:20.445323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f7401-9bd9-4b7f-b388-1540600a540e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:20.445943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f7401-9bd9-4b7f-b388-1540600a540e admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:20.446223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f7401-9bd9-4b7f-b388-1540600a540e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:20.446495 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f7401-9bd9-4b7f-b388-1540600a540e admin admin] PATH_INFO: `/v3/users/c4192bd98cd24e289022a82073365dbc` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:20.447815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f7401-9bd9-4b7f-b388-1540600a540e admin admin] RBAC: Authorizing `identity:get_user(user_id=c4192bd98cd24e289022a82073365dbc)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:20.449632 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f7401-9bd9-4b7f-b388-1540600a540e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:20.451161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Fri Sep 16 05:20:20 2022] GET /identity/v3/users/c4192bd98cd24e289022a82073365dbc => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:22.628956 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd355f9f-e52d-49e9-986d-a5e484930286 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:22.629510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd355f9f-e52d-49e9-986d-a5e484930286 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:22.629510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd355f9f-e52d-49e9-986d-a5e484930286 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:22.631030 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:22.635876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c427eb6-75b7-4012-a3bb-ac87176deea1 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:22.636264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c427eb6-75b7-4012-a3bb-ac87176deea1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:22.636546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c427eb6-75b7-4012-a3bb-ac87176deea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:22.654786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-3c427eb6-75b7-4012-a3bb-ac87176deea1 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:22.655967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3c427eb6-75b7-4012-a3bb-ac87176deea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:22.704868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9136cf8-ef82-4942-81cd-cbd89033b119 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:22.705148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9136cf8-ef82-4942-81cd-cbd89033b119 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:22.705419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9136cf8-ef82-4942-81cd-cbd89033b119 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:22.706764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:20:22.711911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c6a6a-adc4-4efe-afb2-118a81f1d87b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:22.712256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c6a6a-adc4-4efe-afb2-118a81f1d87b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:22.712596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c6a6a-adc4-4efe-afb2-118a81f1d87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:22.736289 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:22.754139 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG passlib.handlers.bcrypt [None req-f45c6a6a-adc4-4efe-afb2-118a81f1d87b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=104774) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 16 05:20:22.754547 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG passlib.handlers.bcrypt [None req-f45c6a6a-adc4-4efe-afb2-118a81f1d87b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=104774) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 16 05:20:22.803065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f45c6a6a-adc4-4efe-afb2-118a81f1d87b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:22.805459 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f45c6a6a-adc4-4efe-afb2-118a81f1d87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:22.904621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:20:23.035443 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c427eb6-75b7-4012-a3bb-ac87176deea1 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:23.059797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:23.141048 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c427eb6-75b7-4012-a3bb-ac87176deea1 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:23.172995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c6a6a-adc4-4efe-afb2-118a81f1d87b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:23.175103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4154c2-f63f-4f74-9811-f4e32cb73469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:23.175727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4154c2-f63f-4f74-9811-f4e32cb73469 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:23.176008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4154c2-f63f-4f74-9811-f4e32cb73469 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:23.176281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4154c2-f63f-4f74-9811-f4e32cb73469 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:23.187706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4154c2-f63f-4f74-9811-f4e32cb73469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-0b4154c2-f63f-4f74-9811-f4e32cb73469 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:23.197155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:23.198151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:23.199063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:23.199063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:23.199063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:23.199063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:23.199063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:23.199063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:23.199063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:23.199063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:23.199063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:23.199063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:23.199063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:23.199063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:23.199714 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:20:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:23.204907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4154c2-f63f-4f74-9811-f4e32cb73469 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:23.279202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c6a6a-adc4-4efe-afb2-118a81f1d87b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:23.281440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:23.286269 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:23.304966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4154c2-f63f-4f74-9811-f4e32cb73469 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:23.316593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77b182-8ea0-4b04-9b6a-10627206abe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:23.317453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b182-8ea0-4b04-9b6a-10627206abe3 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:23.317735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b182-8ea0-4b04-9b6a-10627206abe3 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:23.318004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b182-8ea0-4b04-9b6a-10627206abe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:23.338051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88f458-5460-479f-bd00-027fea999321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:23.338687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88f458-5460-479f-bd00-027fea999321 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:23.338973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88f458-5460-479f-bd00-027fea999321 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:23.339243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88f458-5460-479f-bd00-027fea999321 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:23.339921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88f458-5460-479f-bd00-027fea999321 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:23.340222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88f458-5460-479f-bd00-027fea999321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:23.341620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88f458-5460-479f-bd00-027fea999321 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:23.353440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:20:23.359206 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88f458-5460-479f-bd00-027fea999321 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:23.384304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77b182-8ea0-4b04-9b6a-10627206abe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:23.385829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77b182-8ea0-4b04-9b6a-10627206abe3 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:23.456315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88f458-5460-479f-bd00-027fea999321 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:23.482348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 05:20:23.488040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77b182-8ea0-4b04-9b6a-10627206abe3 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:23.489749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27344aa-72d2-404c-8b4d-17c47fe5cd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:23.490383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27344aa-72d2-404c-8b4d-17c47fe5cd05 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:23.490642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:23.490748 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27344aa-72d2-404c-8b4d-17c47fe5cd05 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:23.491048 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27344aa-72d2-404c-8b4d-17c47fe5cd05 None admin] PATH_INFO: `/v3/users/c4192bd98cd24e289022a82073365dbc` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:23.492368 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27344aa-72d2-404c-8b4d-17c47fe5cd05 None admin] RBAC: Authorizing `identity:get_user(user_id=c4192bd98cd24e289022a82073365dbc)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:23.494218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27344aa-72d2-404c-8b4d-17c47fe5cd05 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:23.496648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:23 2022] GET /identity/v3/users/c4192bd98cd24e289022a82073365dbc => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:20:23.503335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27344aa-72d2-404c-8b4d-17c47fe5cd05 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:23.520333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:23.589013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77b182-8ea0-4b04-9b6a-10627206abe3 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:23.605558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27344aa-72d2-404c-8b4d-17c47fe5cd05 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:23.623517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e225b7-1595-4842-8ddf-8373a9ee327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:23.624358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e225b7-1595-4842-8ddf-8373a9ee327b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:23.624640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e225b7-1595-4842-8ddf-8373a9ee327b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:23.624913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e225b7-1595-4842-8ddf-8373a9ee327b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:23.639955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233a0ba-e23b-4032-ae97-0082311f0d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:23.640574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233a0ba-e23b-4032-ae97-0082311f0d92 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:23.640858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233a0ba-e23b-4032-ae97-0082311f0d92 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:23.641132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233a0ba-e23b-4032-ae97-0082311f0d92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:23.642247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233a0ba-e23b-4032-ae97-0082311f0d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:23.643382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e225b7-1595-4842-8ddf-8373a9ee327b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:23.643744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233a0ba-e23b-4032-ae97-0082311f0d92 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:23.644841 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e225b7-1595-4842-8ddf-8373a9ee327b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:23.645427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:20:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:23.651759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233a0ba-e23b-4032-ae97-0082311f0d92 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-d4e225b7-1595-4842-8ddf-8373a9ee327b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:20:23.667099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:23.668159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:20:23.669198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:20:23.669198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:20:23.669198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:20:23.669198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:20:23.673857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e225b7-1595-4842-8ddf-8373a9ee327b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:23.728310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:23.730288 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:23.749163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233a0ba-e23b-4032-ae97-0082311f0d92 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:23.774980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e225b7-1595-4842-8ddf-8373a9ee327b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:23.782757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a22ef-8179-414b-bf72-ac17414ec40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:23.783352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a22ef-8179-414b-bf72-ac17414ec40e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:23.783627 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a22ef-8179-414b-bf72-ac17414ec40e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:23.783898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a22ef-8179-414b-bf72-ac17414ec40e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:23.784607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a22ef-8179-414b-bf72-ac17414ec40e None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.domain.id=default, user.id=c4192bd98cd24e289022a82073365dbc) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:23.784905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a22ef-8179-414b-bf72-ac17414ec40e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:23.786346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a22ef-8179-414b-bf72-ac17414ec40e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:23.793448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Sep 16 05:20:23 2022] GET /identity/v3/role_assignments?user.id=c4192bd98cd24e289022a82073365dbc&scope.domain.id=default&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:20:23.808892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b0b0c-64b8-4916-8883-34f445cbef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:23.809519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b0b0c-64b8-4916-8883-34f445cbef71 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:23.809796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b0b0c-64b8-4916-8883-34f445cbef71 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:23.810063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b0b0c-64b8-4916-8883-34f445cbef71 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:23.810748 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b0b0c-64b8-4916-8883-34f445cbef71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:23.811047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b0b0c-64b8-4916-8883-34f445cbef71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:23.812479 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b0b0c-64b8-4916-8883-34f445cbef71 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:23.831986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:20:26.253913 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a05105-9f55-49e6-b966-d84669a0ba01 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:26.254995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a05105-9f55-49e6-b966-d84669a0ba01 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:26.255483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a05105-9f55-49e6-b966-d84669a0ba01 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:26.257162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:26.276538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792277ff-1696-4eb9-a8da-0478a0e719de None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:26.277485 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792277ff-1696-4eb9-a8da-0478a0e719de None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:26.277951 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792277ff-1696-4eb9-a8da-0478a0e719de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:26.307865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-792277ff-1696-4eb9-a8da-0478a0e719de None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:26.309389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-792277ff-1696-4eb9-a8da-0478a0e719de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:26.398284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:26.472400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621c087-93ac-410b-b993-631e7fbf71bd None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:26.473022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621c087-93ac-410b-b993-631e7fbf71bd None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:26.473518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621c087-93ac-410b-b993-631e7fbf71bd None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:26.475062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:26.481034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5d89e-6ad5-4c0e-b7f8-d655456e502c None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:26.481527 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5d89e-6ad5-4c0e-b7f8-d655456e502c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:26.481994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5d89e-6ad5-4c0e-b7f8-d655456e502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:26.507580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-42e5d89e-6ad5-4c0e-b7f8-d655456e502c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:26.509103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-42e5d89e-6ad5-4c0e-b7f8-d655456e502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:26.565777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:26.601361 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 12/25] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:26.622120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219c7e6-70a0-4c76-ba34-f29e47edd5ee None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:26.622403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219c7e6-70a0-4c76-ba34-f29e47edd5ee None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:26.622706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219c7e6-70a0-4c76-ba34-f29e47edd5ee None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:26.624030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 14/26] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:26.629197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711c6be-ee26-478a-8c72-eb4b561ea797 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:26.629485 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711c6be-ee26-478a-8c72-eb4b561ea797 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:26.629760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711c6be-ee26-478a-8c72-eb4b561ea797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:26.655473 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-b711c6be-ee26-478a-8c72-eb4b561ea797 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:26.656643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b711c6be-ee26-478a-8c72-eb4b561ea797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:26.755474 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 13/27] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:26.969914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219c7e6-70a0-4c76-ba34-f29e47edd5ee None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:27.098042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219c7e6-70a0-4c76-ba34-f29e47edd5ee None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:27.140772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5f829-d409-45a1-9e9c-25a10bb98a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:27.141740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5f829-d409-45a1-9e9c-25a10bb98a3b None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:27.142231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5f829-d409-45a1-9e9c-25a10bb98a3b None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:27.142718 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5f829-d409-45a1-9e9c-25a10bb98a3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:27.159393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5f829-d409-45a1-9e9c-25a10bb98a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:27.163384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711c6be-ee26-478a-8c72-eb4b561ea797 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-c0f5f829-d409-45a1-9e9c-25a10bb98a3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:27.173611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:27.174461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:27.175230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:27.175230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:27.175230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:27.175230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:27.175230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:27.175230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:27.175230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:27.175230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:27.175230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:27.175230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:27.175230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:27.175230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:27.180868 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 15/28] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:20:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:27.186645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5f829-d409-45a1-9e9c-25a10bb98a3b None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:27.190823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:27.307328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5f829-d409-45a1-9e9c-25a10bb98a3b None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:27.314162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711c6be-ee26-478a-8c72-eb4b561ea797 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:27.323017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:27.360728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2b150-afd3-459e-a706-2d7809363fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:27.361346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2b150-afd3-459e-a706-2d7809363fa4 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:27.361624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2b150-afd3-459e-a706-2d7809363fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:27.361932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2b150-afd3-459e-a706-2d7809363fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:27.362591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2b150-afd3-459e-a706-2d7809363fa4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:27.365528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48cae4-517e-4a29-b7e7-49ecb8e2c9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:27.366176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48cae4-517e-4a29-b7e7-49ecb8e2c9fd None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:27.366449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48cae4-517e-4a29-b7e7-49ecb8e2c9fd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:27.366739 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48cae4-517e-4a29-b7e7-49ecb8e2c9fd None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:27.367406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48cae4-517e-4a29-b7e7-49ecb8e2c9fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:27.367701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48cae4-517e-4a29-b7e7-49ecb8e2c9fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:27.369093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48cae4-517e-4a29-b7e7-49ecb8e2c9fd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:27.370744 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2b150-afd3-459e-a706-2d7809363fa4 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:27.387513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 16/29] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:20:27.388951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48cae4-517e-4a29-b7e7-49ecb8e2c9fd None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:27.467077 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:27.507682 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48cae4-517e-4a29-b7e7-49ecb8e2c9fd None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:27.518658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 14/30] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 16 05:20:27 2022] POST /identity/v3/roles => generated 219 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:20:27.520767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5368fb-b6a5-4681-93e5-a1b8aa9d6e49 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:27.521196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5368fb-b6a5-4681-93e5-a1b8aa9d6e49 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:27.521627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5368fb-b6a5-4681-93e5-a1b8aa9d6e49 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:27.523870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 15/31] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:27.524890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5368fb-b6a5-4681-93e5-a1b8aa9d6e49 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:27.549574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df027d8-35cb-4483-b55b-ee216e155809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:27.550600 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df027d8-35cb-4483-b55b-ee216e155809 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:27.551119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df027d8-35cb-4483-b55b-ee216e155809 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:27.551601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df027d8-35cb-4483-b55b-ee216e155809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:27.569539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df027d8-35cb-4483-b55b-ee216e155809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:27.573120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df027d8-35cb-4483-b55b-ee216e155809 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-8df027d8-35cb-4483-b55b-ee216e155809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:20:27.602092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:27.603056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:20:27.603860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:20:27.603860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:20:27.603860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:27.603860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 17/32] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:27.604836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88034-b47c-479a-8bb5-199ee69b7c91 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:27.606066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88034-b47c-479a-8bb5-199ee69b7c91 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:27.606066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88034-b47c-479a-8bb5-199ee69b7c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:27.648735 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-20f88034-b47c-479a-8bb5-199ee69b7c91 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:27.650102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-20f88034-b47c-479a-8bb5-199ee69b7c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:27.752355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5368fb-b6a5-4681-93e5-a1b8aa9d6e49 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:27.776923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 18/33] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:27.778200 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f88034-b47c-479a-8bb5-199ee69b7c91 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:27.822489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbbbbe-1b02-47ff-babd-2ba932d07ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:27.824259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbbbbe-1b02-47ff-babd-2ba932d07ed9 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:27.824765 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbbbbe-1b02-47ff-babd-2ba932d07ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:27.827944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbbbbe-1b02-47ff-babd-2ba932d07ed9 None admin] PATH_INFO: `/v3/users/c4192bd98cd24e289022a82073365dbc` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:27.829849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbbbbe-1b02-47ff-babd-2ba932d07ed9 None admin] RBAC: Authorizing `identity:get_user(user_id=c4192bd98cd24e289022a82073365dbc)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:27.831684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbbbbe-1b02-47ff-babd-2ba932d07ed9 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:27.835094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 16/34] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:27 2022] GET /identity/v3/users/c4192bd98cd24e289022a82073365dbc => generated 247 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:27.852735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbbbbe-1b02-47ff-babd-2ba932d07ed9 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:27.883061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:27.916057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:28.005699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f88034-b47c-479a-8bb5-199ee69b7c91 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:28.032500 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbbbbe-1b02-47ff-babd-2ba932d07ed9 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:28.070845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d79d1-f6c9-45e3-a847-716282a3d175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:28.071844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d79d1-f6c9-45e3-a847-716282a3d175 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:28.072351 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d79d1-f6c9-45e3-a847-716282a3d175 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:28.072841 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d79d1-f6c9-45e3-a847-716282a3d175 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:28.074268 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d79d1-f6c9-45e3-a847-716282a3d175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:28.076094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d79d1-f6c9-45e3-a847-716282a3d175 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:28.077985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 17/35] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:20:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:20:28.083860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d79d1-f6c9-45e3-a847-716282a3d175 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:28.094560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda64cc-9dd4-4381-8f71-76fb3b3b766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:28.095182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda64cc-9dd4-4381-8f71-76fb3b3b766d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:28.095459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda64cc-9dd4-4381-8f71-76fb3b3b766d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:28.095952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda64cc-9dd4-4381-8f71-76fb3b3b766d None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:28.096448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda64cc-9dd4-4381-8f71-76fb3b3b766d None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:28.096749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda64cc-9dd4-4381-8f71-76fb3b3b766d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:28.098151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda64cc-9dd4-4381-8f71-76fb3b3b766d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:28.115394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 19/36] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:28.116226 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda64cc-9dd4-4381-8f71-76fb3b3b766d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:28.187050 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d79d1-f6c9-45e3-a847-716282a3d175 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:28.188535 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:28.215631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda64cc-9dd4-4381-8f71-76fb3b3b766d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:28.224093 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cae5b-1105-415a-afcf-829fe7e017e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:28.225237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cae5b-1105-415a-afcf-829fe7e017e1 None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:28.225520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cae5b-1105-415a-afcf-829fe7e017e1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:28.225796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cae5b-1105-415a-afcf-829fe7e017e1 None admin] PATH_INFO: `/v3/domains/default/users/c4192bd98cd24e289022a82073365dbc/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:28.226664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:28.227924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cae5b-1105-415a-afcf-829fe7e017e1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c4192bd98cd24e289022a82073365dbc, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:28.229307 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cae5b-1105-415a-afcf-829fe7e017e1 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:28.247510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 18/37] 10.222.0.20 () {58 vars in 1361 bytes} [Fri Sep 16 05:20:28 2022] PUT /identity/v3/domains/default/users/c4192bd98cd24e289022a82073365dbc/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:20:28.248746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19a44c-448f-4c83-82cf-c15c1aabd519 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:28.249039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19a44c-448f-4c83-82cf-c15c1aabd519 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:28.249313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19a44c-448f-4c83-82cf-c15c1aabd519 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:28.250602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 19/38] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:28.251682 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ba6e9-4ef0-401d-9c00-29ae2503e2ca None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:28.251961 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ba6e9-4ef0-401d-9c00-29ae2503e2ca None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:28.252237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ba6e9-4ef0-401d-9c00-29ae2503e2ca None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:28.253536 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 20/39] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:28.254272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ba6e9-4ef0-401d-9c00-29ae2503e2ca None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:28.255640 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd5f2a-0ebd-4455-a0e9-c92500704765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:28.256878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd5f2a-0ebd-4455-a0e9-c92500704765 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:28.257121 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd5f2a-0ebd-4455-a0e9-c92500704765 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:28.257417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd5f2a-0ebd-4455-a0e9-c92500704765 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:28.258187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd5f2a-0ebd-4455-a0e9-c92500704765 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:28.259895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd5f2a-0ebd-4455-a0e9-c92500704765 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:28.376875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ba6e9-4ef0-401d-9c00-29ae2503e2ca None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:28.385490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 16 05:20:28 2022] POST /identity/v3/roles => generated 225 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:20:28.387028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24260c-363c-4806-b8c6-67be8aed6939 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:28.387319 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24260c-363c-4806-b8c6-67be8aed6939 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:28.387636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24260c-363c-4806-b8c6-67be8aed6939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:28.411107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-8b24260c-363c-4806-b8c6-67be8aed6939 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:28.412843 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8b24260c-363c-4806-b8c6-67be8aed6939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:28.438090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78bb09-e04e-40b8-8408-c4e905df51d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:28.439387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78bb09-e04e-40b8-8408-c4e905df51d3 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:28.439633 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78bb09-e04e-40b8-8408-c4e905df51d3 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:28.439913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78bb09-e04e-40b8-8408-c4e905df51d3 None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:28.440916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78bb09-e04e-40b8-8408-c4e905df51d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:28.442860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78bb09-e04e-40b8-8408-c4e905df51d3 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:28.482546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:20:28 2022] POST /identity/v3/projects => generated 301 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:20:28.482546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a17815-6dac-4630-a2d1-10bbbc60b6c7 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:28.482546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a17815-6dac-4630-a2d1-10bbbc60b6c7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:28.482546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a17815-6dac-4630-a2d1-10bbbc60b6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:28.501420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 21/42] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:28.508738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f3a17815-6dac-4630-a2d1-10bbbc60b6c7 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:28.510425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f3a17815-6dac-4630-a2d1-10bbbc60b6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:28.525611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:28.615054 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 22/43] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:28.832488 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24260c-363c-4806-b8c6-67be8aed6939 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:28.894046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a17815-6dac-4630-a2d1-10bbbc60b6c7 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:28.931239 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:28.935096 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24260c-363c-4806-b8c6-67be8aed6939 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:29.005688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a17815-6dac-4630-a2d1-10bbbc60b6c7 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:29.043985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84c6d8-7292-4d0b-a0b3-147a85df1348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:29.044609 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84c6d8-7292-4d0b-a0b3-147a85df1348 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:29.044886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84c6d8-7292-4d0b-a0b3-147a85df1348 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:29.045158 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84c6d8-7292-4d0b-a0b3-147a85df1348 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:29.045842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84c6d8-7292-4d0b-a0b3-147a85df1348 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:29.047261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84c6d8-7292-4d0b-a0b3-147a85df1348 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:29.064046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 16 05:20:28 2022] POST /identity/v3/roles => generated 223 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:20:29.084039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3d61e-3d49-4577-9f97-dfd9b8f8c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:29.085312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3d61e-3d49-4577-9f97-dfd9b8f8c7a1 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:29.085681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3d61e-3d49-4577-9f97-dfd9b8f8c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:29.086053 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3d61e-3d49-4577-9f97-dfd9b8f8c7a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:29.087436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3d61e-3d49-4577-9f97-dfd9b8f8c7a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:29.089243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3d61e-3d49-4577-9f97-dfd9b8f8c7a1 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:29.091261 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 22/45] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:20:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:29.096834 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84c6d8-7292-4d0b-a0b3-147a85df1348 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:29.100874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:29.207795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84c6d8-7292-4d0b-a0b3-147a85df1348 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:29.255470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5cbb8-b3cc-4eb5-882f-c9332ad41622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:29.256092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5cbb8-b3cc-4eb5-882f-c9332ad41622 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:29.256941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5cbb8-b3cc-4eb5-882f-c9332ad41622 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:29.257212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5cbb8-b3cc-4eb5-882f-c9332ad41622 None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:29.257875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5cbb8-b3cc-4eb5-882f-c9332ad41622 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:29.259352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5cbb8-b3cc-4eb5-882f-c9332ad41622 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:29.289019 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:20:29 2022] POST /identity/v3/projects => generated 312 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:20:30.513940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28e55c-ebcf-4b10-a5c3-8691af3c0a43 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:30.514420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28e55c-ebcf-4b10-a5c3-8691af3c0a43 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:30.514420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28e55c-ebcf-4b10-a5c3-8691af3c0a43 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:30.515776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 23/47] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:30.521090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcd284-f752-46a9-9a31-fa15c719628a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:30.521475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcd284-f752-46a9-9a31-fa15c719628a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:30.521651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcd284-f752-46a9-9a31-fa15c719628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:30.539886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f6fcd284-f752-46a9-9a31-fa15c719628a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:30.541099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f6fcd284-f752-46a9-9a31-fa15c719628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:30.590614 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:30.607921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 25/48] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:30.877347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28e55c-ebcf-4b10-a5c3-8691af3c0a43 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:30.977804 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28e55c-ebcf-4b10-a5c3-8691af3c0a43 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:31.012474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9011a-8cb7-4711-98a5-faa0ef06b324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:31.013097 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9011a-8cb7-4711-98a5-faa0ef06b324 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:31.013375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9011a-8cb7-4711-98a5-faa0ef06b324 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:31.013643 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9011a-8cb7-4711-98a5-faa0ef06b324 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:31.024449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9011a-8cb7-4711-98a5-faa0ef06b324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-41d9011a-8cb7-4711-98a5-faa0ef06b324 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:31.029275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:31.030275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:31.031087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:31.031087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:31.031087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:31.031087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:31.031087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:31.031087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:31.031087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:31.031087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:31.031087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:31.031087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:31.031087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:31.031087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:31.031087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 24/49] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:20:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:31.036286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcd284-f752-46a9-9a31-fa15c719628a None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:31.133892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcd284-f752-46a9-9a31-fa15c719628a None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:31.166644 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031163c-8477-41de-ab40-78ef47ed23cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:31.167247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031163c-8477-41de-ab40-78ef47ed23cb None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:31.167529 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031163c-8477-41de-ab40-78ef47ed23cb None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:31.167800 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031163c-8477-41de-ab40-78ef47ed23cb None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:31.168463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031163c-8477-41de-ab40-78ef47ed23cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:31.168764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031163c-8477-41de-ab40-78ef47ed23cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:31.170152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031163c-8477-41de-ab40-78ef47ed23cb None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:31.182193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 26/50] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:31.187872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9011a-8cb7-4711-98a5-faa0ef06b324 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:31.216317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:31.290680 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9011a-8cb7-4711-98a5-faa0ef06b324 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:31.327619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e805b01-a268-493e-8ead-ed3f4303d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:31.328254 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e805b01-a268-493e-8ead-ed3f4303d901 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:31.328536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e805b01-a268-493e-8ead-ed3f4303d901 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:31.328810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e805b01-a268-493e-8ead-ed3f4303d901 None admin] PATH_INFO: `/v3/users/c4192bd98cd24e289022a82073365dbc` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:31.329949 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e805b01-a268-493e-8ead-ed3f4303d901 None admin] RBAC: Authorizing `identity:get_user(user_id=c4192bd98cd24e289022a82073365dbc)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:31.331454 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e805b01-a268-493e-8ead-ed3f4303d901 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:31.333063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 25/51] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:31 2022] GET /identity/v3/users/c4192bd98cd24e289022a82073365dbc => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:31.339191 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031163c-8477-41de-ab40-78ef47ed23cb None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:31.407430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536200a-3c2f-42d3-a9de-882b3b57bd30 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:31.407619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536200a-3c2f-42d3-a9de-882b3b57bd30 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:31.407899 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536200a-3c2f-42d3-a9de-882b3b57bd30 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:31.409415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 26/52] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:20:31.415165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e775ff-72ea-47b2-a0b1-cca194460464 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:31.415449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e775ff-72ea-47b2-a0b1-cca194460464 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:31.415726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e775ff-72ea-47b2-a0b1-cca194460464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:31.435226 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-17e775ff-72ea-47b2-a0b1-cca194460464 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:31.436464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-17e775ff-72ea-47b2-a0b1-cca194460464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:31.489227 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:31.506959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 27/53] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:20:31.539777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031163c-8477-41de-ab40-78ef47ed23cb None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:31.572887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984bac3-31e0-4d89-82da-d086b231dedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:31.573511 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984bac3-31e0-4d89-82da-d086b231dedc None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:31.573795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984bac3-31e0-4d89-82da-d086b231dedc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:31.574071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984bac3-31e0-4d89-82da-d086b231dedc None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:31.575196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984bac3-31e0-4d89-82da-d086b231dedc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:31.576638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984bac3-31e0-4d89-82da-d086b231dedc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:31.578192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 27/54] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:20:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:31.583958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e775ff-72ea-47b2-a0b1-cca194460464 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:31.609118 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:31.682333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e775ff-72ea-47b2-a0b1-cca194460464 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:31.715413 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd5b64-71c8-48dc-98f8-9b6ecbacbeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:31.716015 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd5b64-71c8-48dc-98f8-9b6ecbacbeb1 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:31.716303 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd5b64-71c8-48dc-98f8-9b6ecbacbeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:31.716574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd5b64-71c8-48dc-98f8-9b6ecbacbeb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:31.717295 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd5b64-71c8-48dc-98f8-9b6ecbacbeb1 None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.domain.id=default, user.id=c4192bd98cd24e289022a82073365dbc) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:31.717603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd5b64-71c8-48dc-98f8-9b6ecbacbeb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:31.719099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd5b64-71c8-48dc-98f8-9b6ecbacbeb1 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:31.725427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Sep 16 05:20:31 2022] GET /identity/v3/role_assignments?user.id=c4192bd98cd24e289022a82073365dbc&scope.domain.id=default&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:31.776781 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984bac3-31e0-4d89-82da-d086b231dedc None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:31.881761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984bac3-31e0-4d89-82da-d086b231dedc None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:31.900085 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:31.918874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0ead3-d87e-46a9-9e46-b451f7160f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:31.919505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ead3-d87e-46a9-9e46-b451f7160f6f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:31.919786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ead3-d87e-46a9-9e46-b451f7160f6f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:31.920057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ead3-d87e-46a9-9e46-b451f7160f6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:31.921155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0ead3-d87e-46a9-9e46-b451f7160f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:31.922635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0ead3-d87e-46a9-9e46-b451f7160f6f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:31.924371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 28/56] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:20:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:31.929909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd5b64-71c8-48dc-98f8-9b6ecbacbeb1 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:32.016169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:32.028395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd5b64-71c8-48dc-98f8-9b6ecbacbeb1 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:32.059544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94bc84-d35d-4e84-91f7-41c9a5ae3ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:32.060141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94bc84-d35d-4e84-91f7-41c9a5ae3ff0 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:32.060419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94bc84-d35d-4e84-91f7-41c9a5ae3ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:32.060687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94bc84-d35d-4e84-91f7-41c9a5ae3ff0 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:32.061320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94bc84-d35d-4e84-91f7-41c9a5ae3ff0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:32.062796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94bc84-d35d-4e84-91f7-41c9a5ae3ff0 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:32.091217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 29/57] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Sep 16 05:20:31 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:20:34.205557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7a992-db9a-44ed-8a1b-76666103d2ef None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:34.206109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7a992-db9a-44ed-8a1b-76666103d2ef None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:34.206109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7a992-db9a-44ed-8a1b-76666103d2ef None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:34.207476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 29/58] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:34.213233 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c0623-b222-41f7-b67e-e7c3305e75ed None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:34.213616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c0623-b222-41f7-b67e-e7c3305e75ed None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:34.213781 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c0623-b222-41f7-b67e-e7c3305e75ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:34.231494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b64c0623-b222-41f7-b67e-e7c3305e75ed None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:34.232674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b64c0623-b222-41f7-b67e-e7c3305e75ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:34.296409 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 30/59] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:34.561212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7a992-db9a-44ed-8a1b-76666103d2ef None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:34.658957 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7a992-db9a-44ed-8a1b-76666103d2ef None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:34.691472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec90d3-81c6-466e-860c-e71e9ae96b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:34.692092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec90d3-81c6-466e-860c-e71e9ae96b11 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:34.692373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec90d3-81c6-466e-860c-e71e9ae96b11 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:34.692645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec90d3-81c6-466e-860c-e71e9ae96b11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:34.694369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec90d3-81c6-466e-860c-e71e9ae96b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:34.695836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec90d3-81c6-466e-860c-e71e9ae96b11 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:34.697404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 30/60] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:20:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:34.702927 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c0623-b222-41f7-b67e-e7c3305e75ed None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:34.769118 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:34.799412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c0623-b222-41f7-b67e-e7c3305e75ed None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:34.832077 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46656256-8f5f-4758-8142-b507721c70d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:34.832619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46656256-8f5f-4758-8142-b507721c70d7 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:34.832896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46656256-8f5f-4758-8142-b507721c70d7 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:34.833163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46656256-8f5f-4758-8142-b507721c70d7 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:34.833795 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46656256-8f5f-4758-8142-b507721c70d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:34.835258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46656256-8f5f-4758-8142-b507721c70d7 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:34.860198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 31/61] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:20:34 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:20:38.174987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad231-e00d-4eeb-bf0a-196b7a700dbc None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:38.175544 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad231-e00d-4eeb-bf0a-196b7a700dbc None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:38.175544 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad231-e00d-4eeb-bf0a-196b7a700dbc None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:38.176918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 31/62] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:38.183552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c0055-6ca8-4459-99b1-044ac480e48e None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:38.184054 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c0055-6ca8-4459-99b1-044ac480e48e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:38.184127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c0055-6ca8-4459-99b1-044ac480e48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:38.211574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-153c0055-6ca8-4459-99b1-044ac480e48e None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:38.212792 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-153c0055-6ca8-4459-99b1-044ac480e48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:38.296779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 32/63] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:20:38.300008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82576828-4f7f-4eb4-abcc-43eff23d5ff8 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:38.300292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82576828-4f7f-4eb4-abcc-43eff23d5ff8 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:38.300563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82576828-4f7f-4eb4-abcc-43eff23d5ff8 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:38.301878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 32/64] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:20:38.320979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940f61f-2d5c-4dd3-8218-23b72eb497b3 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:38.321461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940f61f-2d5c-4dd3-8218-23b72eb497b3 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:38.321734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940f61f-2d5c-4dd3-8218-23b72eb497b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:38.356577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-7940f61f-2d5c-4dd3-8218-23b72eb497b3 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:38.357832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-7940f61f-2d5c-4dd3-8218-23b72eb497b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:38.425299 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:38.448786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 33/65] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:38.493625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28ed91-5ac4-4abe-8d03-dd86f20f4e95 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:38.493903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28ed91-5ac4-4abe-8d03-dd86f20f4e95 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:38.494408 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28ed91-5ac4-4abe-8d03-dd86f20f4e95 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:38.495992 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 33/66] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:38.501237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c65691-d8d1-4e55-9cf6-9dd53ef01665 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:38.501526 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c65691-d8d1-4e55-9cf6-9dd53ef01665 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:38.501803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c65691-d8d1-4e55-9cf6-9dd53ef01665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:38.526756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-67c65691-d8d1-4e55-9cf6-9dd53ef01665 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:38.527957 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-67c65691-d8d1-4e55-9cf6-9dd53ef01665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:38.637099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 34/67] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:38.665612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28ed91-5ac4-4abe-8d03-dd86f20f4e95 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:38.667362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205f036-7809-4cc7-91b6-0380e30b6547 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:38.667798 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205f036-7809-4cc7-91b6-0380e30b6547 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:38.668220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205f036-7809-4cc7-91b6-0380e30b6547 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:38.670597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 35/68] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:38.680508 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77bf22-8e0e-4af5-8acf-a02e08a84a4d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:38.680859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77bf22-8e0e-4af5-8acf-a02e08a84a4d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:38.681273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77bf22-8e0e-4af5-8acf-a02e08a84a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:38.727031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-0b77bf22-8e0e-4af5-8acf-a02e08a84a4d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:38.728505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0b77bf22-8e0e-4af5-8acf-a02e08a84a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:38.759287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:38.801941 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 36/69] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:38.804583 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92853850-2be7-4a23-b671-27ee78526d92 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:38.805084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92853850-2be7-4a23-b671-27ee78526d92 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:38.805579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92853850-2be7-4a23-b671-27ee78526d92 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:38.807040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 37/70] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:38.816297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b84c75-9d7e-4d68-900c-82ec003d44a5 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:38.816811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b84c75-9d7e-4d68-900c-82ec003d44a5 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:38.817285 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b84c75-9d7e-4d68-900c-82ec003d44a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:38.840015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28ed91-5ac4-4abe-8d03-dd86f20f4e95 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:38.854330 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-75b84c75-9d7e-4d68-900c-82ec003d44a5 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:38.856997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-75b84c75-9d7e-4d68-900c-82ec003d44a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:38.890667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f2218-09e1-42e0-ad38-f23ae51a1445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:38.891315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f2218-09e1-42e0-ad38-f23ae51a1445 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:38.891600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f2218-09e1-42e0-ad38-f23ae51a1445 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:38.892295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f2218-09e1-42e0-ad38-f23ae51a1445 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:38.906267 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f2218-09e1-42e0-ad38-f23ae51a1445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:38.910574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-d29f2218-09e1-42e0-ad38-f23ae51a1445 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:38.914768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:38.915647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 34/71] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:38.916828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f2218-09e1-42e0-ad38-f23ae51a1445 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:38.945900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 38/72] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:38.947027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b84c75-9d7e-4d68-900c-82ec003d44a5 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:39.045667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f2218-09e1-42e0-ad38-f23ae51a1445 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:39.060727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:39.077635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b84c75-9d7e-4d68-900c-82ec003d44a5 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:39.087042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195664b-d4af-469a-b08c-5abaa405a898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:39.087958 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195664b-d4af-469a-b08c-5abaa405a898 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:39.088384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195664b-d4af-469a-b08c-5abaa405a898 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:39.088802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195664b-d4af-469a-b08c-5abaa405a898 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:39.101092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195664b-d4af-469a-b08c-5abaa405a898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-1195664b-d4af-469a-b08c-5abaa405a898 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:39.107177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:39.108226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:39.109168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:39.109168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:39.109168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:39.109168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:39.109168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:39.109168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:39.109168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:39.109168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:39.109168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:39.109168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:39.109168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:39.109168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:20:39.111426 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 35/73] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:20:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:39.115373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195664b-d4af-469a-b08c-5abaa405a898 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:39.123243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b41bbf-6c1d-457a-aa9d-0278c931d391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:39.123863 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41bbf-6c1d-457a-aa9d-0278c931d391 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:39.124144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41bbf-6c1d-457a-aa9d-0278c931d391 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:39.124412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41bbf-6c1d-457a-aa9d-0278c931d391 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:39.125102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b41bbf-6c1d-457a-aa9d-0278c931d391 None admin] RBAC: Adding query filter params (name=member) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:39.125404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b41bbf-6c1d-457a-aa9d-0278c931d391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:39.126821 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b41bbf-6c1d-457a-aa9d-0278c931d391 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:39.135476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 39/74] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:20:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:39.140606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b41bbf-6c1d-457a-aa9d-0278c931d391 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:39.183460 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:39.221251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195664b-d4af-469a-b08c-5abaa405a898 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:39.255462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b41bbf-6c1d-457a-aa9d-0278c931d391 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:39.259014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae893c2e-851a-405d-82cb-ef7787633f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:39.259653 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae893c2e-851a-405d-82cb-ef7787633f06 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:39.259937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae893c2e-851a-405d-82cb-ef7787633f06 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:39.260212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae893c2e-851a-405d-82cb-ef7787633f06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:39.270939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae893c2e-851a-405d-82cb-ef7787633f06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-ae893c2e-851a-405d-82cb-ef7787633f06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:39.276862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:39.277710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:39.278456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:39.278456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:39.278456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:39.278456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:39.278456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:39.278456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:39.278456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:39.278456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:39.278456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:39.278456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:39.278456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:20:39.278456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:20:39.278456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 36/75] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:20:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:39.279527 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae893c2e-851a-405d-82cb-ef7787633f06 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:39.290220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeb357-7946-44cd-b2de-43db55fbcac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:39.290877 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeb357-7946-44cd-b2de-43db55fbcac2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:39.291163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeb357-7946-44cd-b2de-43db55fbcac2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:39.291472 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeb357-7946-44cd-b2de-43db55fbcac2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:39.301505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeb357-7946-44cd-b2de-43db55fbcac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-74aeb357-7946-44cd-b2de-43db55fbcac2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:39.306869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:39.307829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:39.308577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:39.308577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:39.308577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:39.308577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:39.308577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:39.308577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:39.308577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:39.308577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:39.308577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:39.308577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:39.308577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:39.308577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:39.308577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 40/76] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:39.309399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeb357-7946-44cd-b2de-43db55fbcac2 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:39.311858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:39.381784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae893c2e-851a-405d-82cb-ef7787633f06 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:39.406024 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:39.410343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeb357-7946-44cd-b2de-43db55fbcac2 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:39.418978 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6bfa8-f8bb-4b7e-852b-eca2c08d16b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:39.419595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6bfa8-f8bb-4b7e-852b-eca2c08d16b4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:39.419881 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6bfa8-f8bb-4b7e-852b-eca2c08d16b4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:39.420146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6bfa8-f8bb-4b7e-852b-eca2c08d16b4 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:39.420843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6bfa8-f8bb-4b7e-852b-eca2c08d16b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:39.421146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6bfa8-f8bb-4b7e-852b-eca2c08d16b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:39.422572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6bfa8-f8bb-4b7e-852b-eca2c08d16b4 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:39.431413 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 37/77] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:39.432220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6bfa8-f8bb-4b7e-852b-eca2c08d16b4 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:39.448142 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13887ccb-f568-4332-9a11-2980b82e4fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:39.448777 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13887ccb-f568-4332-9a11-2980b82e4fcd None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:39.449054 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13887ccb-f568-4332-9a11-2980b82e4fcd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:39.449325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13887ccb-f568-4332-9a11-2980b82e4fcd None admin] PATH_INFO: `/v3/users/fe727ca16f464f80a1fe24f7038c113c` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:39.463043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13887ccb-f568-4332-9a11-2980b82e4fcd None admin] RBAC: Authorizing `identity:get_user(user_id=fe727ca16f464f80a1fe24f7038c113c)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:39.464514 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13887ccb-f568-4332-9a11-2980b82e4fcd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:39.466129 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 41/78] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:39 2022] GET /identity/v3/users/fe727ca16f464f80a1fe24f7038c113c => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:39.466916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13887ccb-f568-4332-9a11-2980b82e4fcd None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:39.527099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:39.534114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6bfa8-f8bb-4b7e-852b-eca2c08d16b4 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:39.563348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13887ccb-f568-4332-9a11-2980b82e4fcd None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:39.566569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cbfb4-4624-4b69-9021-03934998fe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:39.567202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cbfb4-4624-4b69-9021-03934998fe7a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:39.567478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cbfb4-4624-4b69-9021-03934998fe7a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:39.567745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cbfb4-4624-4b69-9021-03934998fe7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:39.569372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cbfb4-4624-4b69-9021-03934998fe7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:39.570843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cbfb4-4624-4b69-9021-03934998fe7a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:39.572393 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 38/79] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:20:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:39.573156 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cbfb4-4624-4b69-9021-03934998fe7a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:39.597890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfc9a7-ddd0-417d-ab7c-d9eddf4ea018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:39.598523 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfc9a7-ddd0-417d-ab7c-d9eddf4ea018 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:39.598819 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfc9a7-ddd0-417d-ab7c-d9eddf4ea018 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:39.599100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfc9a7-ddd0-417d-ab7c-d9eddf4ea018 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:39.600290 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfc9a7-ddd0-417d-ab7c-d9eddf4ea018 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:39.600602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfc9a7-ddd0-417d-ab7c-d9eddf4ea018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:39.602000 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfc9a7-ddd0-417d-ab7c-d9eddf4ea018 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:39.610431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 42/80] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:20:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:39.611320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfc9a7-ddd0-417d-ab7c-d9eddf4ea018 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:39.633460 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:39.672445 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cbfb4-4624-4b69-9021-03934998fe7a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:39.705840 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868007d9-5850-4e68-bf6f-a6d09cdb30e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:39.706445 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868007d9-5850-4e68-bf6f-a6d09cdb30e6 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:39.706761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868007d9-5850-4e68-bf6f-a6d09cdb30e6 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:39.707036 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868007d9-5850-4e68-bf6f-a6d09cdb30e6 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:39.707696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868007d9-5850-4e68-bf6f-a6d09cdb30e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:39.708002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868007d9-5850-4e68-bf6f-a6d09cdb30e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:39.709976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868007d9-5850-4e68-bf6f-a6d09cdb30e6 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:39.713564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfc9a7-ddd0-417d-ab7c-d9eddf4ea018 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:39.717927 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 39/81] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:20:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:39.718743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868007d9-5850-4e68-bf6f-a6d09cdb30e6 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:39.744027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:39.749535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde668c-ba9d-4df1-9eff-af1b103b700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:39.750160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde668c-ba9d-4df1-9eff-af1b103b700c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:39.750443 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde668c-ba9d-4df1-9eff-af1b103b700c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:39.750745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde668c-ba9d-4df1-9eff-af1b103b700c None admin] PATH_INFO: `/v3/users/c4192bd98cd24e289022a82073365dbc` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:39.751863 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde668c-ba9d-4df1-9eff-af1b103b700c None admin] RBAC: Authorizing `identity:get_user(user_id=c4192bd98cd24e289022a82073365dbc)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:39.753315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde668c-ba9d-4df1-9eff-af1b103b700c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:39.754916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 43/82] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:39 2022] GET /identity/v3/users/c4192bd98cd24e289022a82073365dbc => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:39.755658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde668c-ba9d-4df1-9eff-af1b103b700c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:39.824948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868007d9-5850-4e68-bf6f-a6d09cdb30e6 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:39.848019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:39.861320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008c0cc-29ce-40ef-865f-ce846d3e5543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:39.861932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008c0cc-29ce-40ef-865f-ce846d3e5543 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:39.862212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008c0cc-29ce-40ef-865f-ce846d3e5543 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:39.862486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008c0cc-29ce-40ef-865f-ce846d3e5543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:39.863452 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde668c-ba9d-4df1-9eff-af1b103b700c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:39.897724 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f089c79-8de0-4361-9867-d6ba4a47265f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:39.898327 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f089c79-8de0-4361-9867-d6ba4a47265f None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:39.898638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f089c79-8de0-4361-9867-d6ba4a47265f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:39.898914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f089c79-8de0-4361-9867-d6ba4a47265f None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:39.899561 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f089c79-8de0-4361-9867-d6ba4a47265f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:39.901411 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f089c79-8de0-4361-9867-d6ba4a47265f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:39.922737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 44/83] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:20:39 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:20:39.922737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f089c79-8de0-4361-9867-d6ba4a47265f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:39.942969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008c0cc-29ce-40ef-865f-ce846d3e5543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:39.944735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008c0cc-29ce-40ef-865f-ce846d3e5543 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:39.976294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:40.037659 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f089c79-8de0-4361-9867-d6ba4a47265f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:40.065332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 40/84] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:20:40.066100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008c0cc-29ce-40ef-865f-ce846d3e5543 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:40.085274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0a2be-3b5d-4895-9aec-698a7dcb7ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:40.085882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0a2be-3b5d-4895-9aec-698a7dcb7ec7 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:40.086164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0a2be-3b5d-4895-9aec-698a7dcb7ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:40.086484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0a2be-3b5d-4895-9aec-698a7dcb7ec7 None admin] PATH_INFO: `/v3/users/fe727ca16f464f80a1fe24f7038c113c` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:40.088242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0a2be-3b5d-4895-9aec-698a7dcb7ec7 None admin] RBAC: Authorizing `identity:get_user(user_id=fe727ca16f464f80a1fe24f7038c113c)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:40.090621 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0a2be-3b5d-4895-9aec-698a7dcb7ec7 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:40.092914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 45/85] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:39 2022] GET /identity/v3/users/fe727ca16f464f80a1fe24f7038c113c => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:40.097801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0a2be-3b5d-4895-9aec-698a7dcb7ec7 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:40.112522 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:40.201437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008c0cc-29ce-40ef-865f-ce846d3e5543 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:40.233495 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0a2be-3b5d-4895-9aec-698a7dcb7ec7 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:40.240323 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:40.246959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4697a-c8c4-4713-8ed1-b9279d30db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:40.247603 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4697a-c8c4-4713-8ed1-b9279d30db18 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:40.247884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4697a-c8c4-4713-8ed1-b9279d30db18 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:40.248156 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4697a-c8c4-4713-8ed1-b9279d30db18 None admin] PATH_INFO: `/v3/users/fe727ca16f464f80a1fe24f7038c113c` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:40.250097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4697a-c8c4-4713-8ed1-b9279d30db18 None admin] RBAC: Authorizing `identity:get_user(user_id=fe727ca16f464f80a1fe24f7038c113c)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:40.252152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4697a-c8c4-4713-8ed1-b9279d30db18 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:40.254338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 41/86] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:40 2022] GET /identity/v3/users/fe727ca16f464f80a1fe24f7038c113c => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:40.255172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4697a-c8c4-4713-8ed1-b9279d30db18 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:40.273937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed446ae-a578-4284-838e-8d7299b201e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:40.274777 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed446ae-a578-4284-838e-8d7299b201e7 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:40.275064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed446ae-a578-4284-838e-8d7299b201e7 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:40.275341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed446ae-a578-4284-838e-8d7299b201e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:40.347973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed446ae-a578-4284-838e-8d7299b201e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:40.349494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed446ae-a578-4284-838e-8d7299b201e7 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:40.370868 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:40.379033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4697a-c8c4-4713-8ed1-b9279d30db18 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:40.421034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f81c4-fa18-470b-999d-2146fc235819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:40.421981 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f81c4-fa18-470b-999d-2146fc235819 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:40.422444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f81c4-fa18-470b-999d-2146fc235819 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:40.422930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f81c4-fa18-470b-999d-2146fc235819 None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:40.425049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f81c4-fa18-470b-999d-2146fc235819 None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:40.426893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f81c4-fa18-470b-999d-2146fc235819 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:40.429481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 42/87] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:40 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:40.435325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f81c4-fa18-470b-999d-2146fc235819 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:40.482891 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 46/88] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:20:40.484108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed446ae-a578-4284-838e-8d7299b201e7 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:40.513215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:40.570266 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f81c4-fa18-470b-999d-2146fc235819 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:40.611233 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa896-4cb3-49b6-9c8b-d8b418d0ee72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:40.611794 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa896-4cb3-49b6-9c8b-d8b418d0ee72 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:40.612076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa896-4cb3-49b6-9c8b-d8b418d0ee72 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:40.612349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa896-4cb3-49b6-9c8b-d8b418d0ee72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:40.613567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed446ae-a578-4284-838e-8d7299b201e7 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:40.625462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:40.651670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017c6e7-a5b0-461b-b71a-4f7c597fcad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:40.652754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017c6e7-a5b0-461b-b71a-4f7c597fcad0 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:40.653106 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017c6e7-a5b0-461b-b71a-4f7c597fcad0 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:40.653498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017c6e7-a5b0-461b-b71a-4f7c597fcad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:40.691203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aa896-4cb3-49b6-9c8b-d8b418d0ee72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:40.692801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aa896-4cb3-49b6-9c8b-d8b418d0ee72 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:40.748844 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017c6e7-a5b0-461b-b71a-4f7c597fcad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:40.751205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017c6e7-a5b0-461b-b71a-4f7c597fcad0 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:40.755966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:40.803298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 43/89] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:20:40.808456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa896-4cb3-49b6-9c8b-d8b418d0ee72 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:40.910193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 47/90] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:20:40.910958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017c6e7-a5b0-461b-b71a-4f7c597fcad0 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:40.925587 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:40.941333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa896-4cb3-49b6-9c8b-d8b418d0ee72 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:40.981235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834e5d5-abae-4978-af87-1c9e014d5fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:40.982253 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834e5d5-abae-4978-af87-1c9e014d5fea None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:40.982784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834e5d5-abae-4978-af87-1c9e014d5fea None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:40.983283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834e5d5-abae-4978-af87-1c9e014d5fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:40.984215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834e5d5-abae-4978-af87-1c9e014d5fea None admin] RBAC: Adding query filter params (role.id=d912a7e672bb441099f4ef85d61e7c46, scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695, user.id=fe727ca16f464f80a1fe24f7038c113c) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:40.984781 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834e5d5-abae-4978-af87-1c9e014d5fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:40.986442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834e5d5-abae-4978-af87-1c9e014d5fea None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:40.994789 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 44/91] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:20:40 2022] GET /identity/v3/role_assignments?user.id=fe727ca16f464f80a1fe24f7038c113c&scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695&role.id=d912a7e672bb441099f4ef85d61e7c46 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:40.996020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834e5d5-abae-4978-af87-1c9e014d5fea None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:41.051087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:41.083366 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017c6e7-a5b0-461b-b71a-4f7c597fcad0 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:41.160098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317f2ab-8f4e-4833-92a4-59773705c307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:41.161307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317f2ab-8f4e-4833-92a4-59773705c307 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:41.161855 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317f2ab-8f4e-4833-92a4-59773705c307 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:41.162361 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317f2ab-8f4e-4833-92a4-59773705c307 None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:41.164087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317f2ab-8f4e-4833-92a4-59773705c307 None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:41.165911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317f2ab-8f4e-4833-92a4-59773705c307 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:41.168043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 48/92] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:40 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:41.169604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317f2ab-8f4e-4833-92a4-59773705c307 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:41.225242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834e5d5-abae-4978-af87-1c9e014d5fea None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:41.277202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810d3da-9d5c-485b-8d6a-a61a6ee42baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:41.278709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810d3da-9d5c-485b-8d6a-a61a6ee42baf None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:41.279211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810d3da-9d5c-485b-8d6a-a61a6ee42baf None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:41.279690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810d3da-9d5c-485b-8d6a-a61a6ee42baf None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:41.281103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810d3da-9d5c-485b-8d6a-a61a6ee42baf None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:41.282895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810d3da-9d5c-485b-8d6a-a61a6ee42baf None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:41.284821 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 45/93] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:40 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:41.285317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:41.287295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810d3da-9d5c-485b-8d6a-a61a6ee42baf None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:41.320103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317f2ab-8f4e-4833-92a4-59773705c307 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:41.365654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7f178-1b70-4af5-975a-d3d57c6df4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:41.368381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7f178-1b70-4af5-975a-d3d57c6df4f4 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:41.369689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7f178-1b70-4af5-975a-d3d57c6df4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:41.370941 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7f178-1b70-4af5-975a-d3d57c6df4f4 None admin] PATH_INFO: `/v3/projects/b7909f8e3f9b48e9820881cc91531db8` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:41.374610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7f178-1b70-4af5-975a-d3d57c6df4f4 None admin] RBAC: Authorizing `identity:get_project(project_id=b7909f8e3f9b48e9820881cc91531db8)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:41.379205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7f178-1b70-4af5-975a-d3d57c6df4f4 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:41.383032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 49/94] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:41 2022] GET /identity/v3/projects/b7909f8e3f9b48e9820881cc91531db8 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:41.384300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7f178-1b70-4af5-975a-d3d57c6df4f4 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:41.456506 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:41.470478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810d3da-9d5c-485b-8d6a-a61a6ee42baf None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:41.542385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdf461-2506-457c-890c-22f62b70a0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:41.543644 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdf461-2506-457c-890c-22f62b70a0e9 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:41.545118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdf461-2506-457c-890c-22f62b70a0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:41.545593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdf461-2506-457c-890c-22f62b70a0e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:41.547356 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdf461-2506-457c-890c-22f62b70a0e9 None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695, user.id=c4192bd98cd24e289022a82073365dbc) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:41.549673 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdf461-2506-457c-890c-22f62b70a0e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:41.551397 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdf461-2506-457c-890c-22f62b70a0e9 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:41.562243 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 46/95] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:20:41 2022] GET /identity/v3/role_assignments?user.id=c4192bd98cd24e289022a82073365dbc&scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:41.564952 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdf461-2506-457c-890c-22f62b70a0e9 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:41.581218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7f178-1b70-4af5-975a-d3d57c6df4f4 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:41.635250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193a996-2681-48fa-8c65-21ac7f4f91cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:41.636329 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193a996-2681-48fa-8c65-21ac7f4f91cd None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:41.636889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193a996-2681-48fa-8c65-21ac7f4f91cd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:41.637355 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193a996-2681-48fa-8c65-21ac7f4f91cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:41.638384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193a996-2681-48fa-8c65-21ac7f4f91cd None admin] RBAC: Adding query filter params (role.id=49763e40fa024aaa9522c00cea577eca, scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695, user.id=fe727ca16f464f80a1fe24f7038c113c) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:41.638910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193a996-2681-48fa-8c65-21ac7f4f91cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:41.640782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193a996-2681-48fa-8c65-21ac7f4f91cd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:41.647387 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 50/96] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:20:41 2022] GET /identity/v3/role_assignments?user.id=fe727ca16f464f80a1fe24f7038c113c&scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695&role.id=49763e40fa024aaa9522c00cea577eca => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:41.705913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdf461-2506-457c-890c-22f62b70a0e9 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:41.749574 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab28c8-f472-47b0-a5b1-90c586aa5322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:41.750120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab28c8-f472-47b0-a5b1-90c586aa5322 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:41.750402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab28c8-f472-47b0-a5b1-90c586aa5322 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:41.750697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab28c8-f472-47b0-a5b1-90c586aa5322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:41.751453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab28c8-f472-47b0-a5b1-90c586aa5322 None admin] RBAC: Adding query filter params (role.id=d912a7e672bb441099f4ef85d61e7c46, scope.project.id=b7909f8e3f9b48e9820881cc91531db8, user.id=fe727ca16f464f80a1fe24f7038c113c) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:41.751766 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab28c8-f472-47b0-a5b1-90c586aa5322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:41.753246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab28c8-f472-47b0-a5b1-90c586aa5322 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:41.760033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 47/97] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:20:41 2022] GET /identity/v3/role_assignments?user.id=fe727ca16f464f80a1fe24f7038c113c&scope.project.id=b7909f8e3f9b48e9820881cc91531db8&role.id=d912a7e672bb441099f4ef85d61e7c46 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:42.465268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d3a17-1452-4caf-a3ba-53247562d0f1 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:42.465766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d3a17-1452-4caf-a3ba-53247562d0f1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:42.465874 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d3a17-1452-4caf-a3ba-53247562d0f1 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:42.467275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 51/98] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:42.472590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea4e9d-eda1-4676-9cf9-90e9564704b7 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:42.472976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea4e9d-eda1-4676-9cf9-90e9564704b7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:42.473140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea4e9d-eda1-4676-9cf9-90e9564704b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:42.495969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-39ea4e9d-eda1-4676-9cf9-90e9564704b7 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:42.497102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-39ea4e9d-eda1-4676-9cf9-90e9564704b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:42.518216 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:42.592852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 48/99] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:42.657596 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9980c18-3d5f-4e8a-8af3-ea1fb2086176 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:42.657895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9980c18-3d5f-4e8a-8af3-ea1fb2086176 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:42.658159 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9980c18-3d5f-4e8a-8af3-ea1fb2086176 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:42.659570 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 52/100] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:42.667492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f992e-476f-4cae-90fc-06c30e7ff984 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:42.667782 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f992e-476f-4cae-90fc-06c30e7ff984 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:42.668058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f992e-476f-4cae-90fc-06c30e7ff984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:42.695493 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-d20f992e-476f-4cae-90fc-06c30e7ff984 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:42.696705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d20f992e-476f-4cae-90fc-06c30e7ff984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:42.779623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 49/101] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:43.100937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9980c18-3d5f-4e8a-8af3-ea1fb2086176 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:43.115183 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:43.215973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9980c18-3d5f-4e8a-8af3-ea1fb2086176 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:43.258256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c8478-a800-472b-81a6-57fa46f68a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:43.259092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c8478-a800-472b-81a6-57fa46f68a28 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:43.259384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c8478-a800-472b-81a6-57fa46f68a28 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:43.259658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c8478-a800-472b-81a6-57fa46f68a28 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:43.273930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c8478-a800-472b-81a6-57fa46f68a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-8d4c8478-a800-472b-81a6-57fa46f68a28 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:43.279398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:43.280300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:43.281062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:43.281062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:43.281062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:43.281062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:43.281062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:43.281062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:43.281062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:43.281062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:43.281062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:43.281062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:43.281062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:20:43.281062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:43.281062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 53/102] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:43.286452 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f992e-476f-4cae-90fc-06c30e7ff984 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:43.305412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c8478-a800-472b-81a6-57fa46f68a28 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:43.428409 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:43.435348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:43.472203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f992e-476f-4cae-90fc-06c30e7ff984 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:43.490838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c8478-a800-472b-81a6-57fa46f68a28 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:43.537372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05c29f-eb82-4a09-befc-80edcfe47791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:43.538164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05c29f-eb82-4a09-befc-80edcfe47791 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:43.538449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05c29f-eb82-4a09-befc-80edcfe47791 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:43.538745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05c29f-eb82-4a09-befc-80edcfe47791 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:43.539416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05c29f-eb82-4a09-befc-80edcfe47791 None admin] RBAC: Adding query filter params (name=reader) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:43.539716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05c29f-eb82-4a09-befc-80edcfe47791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:43.541103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05c29f-eb82-4a09-befc-80edcfe47791 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:43.554743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 50/103] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:20:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:43.556435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb1c24-7336-412c-88e2-63de3f164f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:43.557144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb1c24-7336-412c-88e2-63de3f164f07 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:43.557496 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb1c24-7336-412c-88e2-63de3f164f07 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:43.557837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb1c24-7336-412c-88e2-63de3f164f07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:43.559273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb1c24-7336-412c-88e2-63de3f164f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:43.565219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05c29f-eb82-4a09-befc-80edcfe47791 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:43.571276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb1c24-7336-412c-88e2-63de3f164f07 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:43.579439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 54/104] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:20:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:20:43.585690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb1c24-7336-412c-88e2-63de3f164f07 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:43.784736 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05c29f-eb82-4a09-befc-80edcfe47791 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:43.801274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb1c24-7336-412c-88e2-63de3f164f07 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:43.833986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cce226-38a2-4e2d-b260-e5839c201803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:43.834755 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cce226-38a2-4e2d-b260-e5839c201803 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:43.836737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cce226-38a2-4e2d-b260-e5839c201803 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:43.837086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cce226-38a2-4e2d-b260-e5839c201803 None admin] PATH_INFO: `/v3/users/0dd44e420acf415d80d80217790d2581` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:43.861446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:43.866618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cce226-38a2-4e2d-b260-e5839c201803 None admin] RBAC: Authorizing `identity:get_user(user_id=0dd44e420acf415d80d80217790d2581)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:43.874334 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cce226-38a2-4e2d-b260-e5839c201803 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:43.876707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f3ef4-2b5a-403a-a84c-58287e062a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:43.877347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f3ef4-2b5a-403a-a84c-58287e062a90 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:43.877708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f3ef4-2b5a-403a-a84c-58287e062a90 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:43.877990 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f3ef4-2b5a-403a-a84c-58287e062a90 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:43.878680 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f3ef4-2b5a-403a-a84c-58287e062a90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:43.879353 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 51/105] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:43 2022] GET /identity/v3/users/0dd44e420acf415d80d80217790d2581 => generated 289 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:43.881118 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f3ef4-2b5a-403a-a84c-58287e062a90 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:43.883091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cce226-38a2-4e2d-b260-e5839c201803 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:43.903018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:43.930423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 55/106] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:20:43 2022] POST /identity/v3/projects => generated 302 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:20:44.045125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cce226-38a2-4e2d-b260-e5839c201803 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:44.097726 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435fca8-6230-4ba1-a4da-7684a666e2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:44.098338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435fca8-6230-4ba1-a4da-7684a666e2f5 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:44.098643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435fca8-6230-4ba1-a4da-7684a666e2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:44.098913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435fca8-6230-4ba1-a4da-7684a666e2f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:44.194131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:44.197241 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435fca8-6230-4ba1-a4da-7684a666e2f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:44.198825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435fca8-6230-4ba1-a4da-7684a666e2f5 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:44.242158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b315d2-0315-4821-9d4e-da6924758f7b None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:44.242246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b315d2-0315-4821-9d4e-da6924758f7b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:44.244208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b315d2-0315-4821-9d4e-da6924758f7b None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:44.244208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 56/107] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:20:44.249264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f24f-3e46-4a95-b7f4-7fcefff63f59 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:44.249673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f24f-3e46-4a95-b7f4-7fcefff63f59 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:44.250160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f24f-3e46-4a95-b7f4-7fcefff63f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:44.280682 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-f841f24f-3e46-4a95-b7f4-7fcefff63f59 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:44.282218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f841f24f-3e46-4a95-b7f4-7fcefff63f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:44.400308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 57/108] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:44.417478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 52/109] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:20:44.423356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841f24f-3e46-4a95-b7f4-7fcefff63f59 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:44.530294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841f24f-3e46-4a95-b7f4-7fcefff63f59 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:44.554951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:44.573262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fbc4f-4732-4cc9-8bc5-1619e2b79e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:44.573913 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fbc4f-4732-4cc9-8bc5-1619e2b79e83 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:44.574194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fbc4f-4732-4cc9-8bc5-1619e2b79e83 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:44.574471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fbc4f-4732-4cc9-8bc5-1619e2b79e83 None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:44.575721 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fbc4f-4732-4cc9-8bc5-1619e2b79e83 None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:44.577204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fbc4f-4732-4cc9-8bc5-1619e2b79e83 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:44.579212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 58/110] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:44 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:44.585264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435fca8-6230-4ba1-a4da-7684a666e2f5 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:44.649890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044efc6e-a40f-4e60-a0ed-9ff570d84b92 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:44.650616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044efc6e-a40f-4e60-a0ed-9ff570d84b92 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:44.651102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044efc6e-a40f-4e60-a0ed-9ff570d84b92 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:44.652793 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 59/111] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:20:44.659242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdf2d9-81b3-4801-954f-8630d8951452 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:44.659809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdf2d9-81b3-4801-954f-8630d8951452 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:44.660316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdf2d9-81b3-4801-954f-8630d8951452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:44.683776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-3acdf2d9-81b3-4801-954f-8630d8951452 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:44.684985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3acdf2d9-81b3-4801-954f-8630d8951452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:44.714834 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:44.719319 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435fca8-6230-4ba1-a4da-7684a666e2f5 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:44.788631 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0348c37-75ba-4d0f-9c96-982400b25f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:44.789249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348c37-75ba-4d0f-9c96-982400b25f2e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:44.789528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348c37-75ba-4d0f-9c96-982400b25f2e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:44.789799 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348c37-75ba-4d0f-9c96-982400b25f2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:44.793045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0348c37-75ba-4d0f-9c96-982400b25f2e None admin] RBAC: Adding query filter params (role.id=1032cdf216bb48c38c1c98860da25d9f, scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695, user.id=0dd44e420acf415d80d80217790d2581) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:44.793364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0348c37-75ba-4d0f-9c96-982400b25f2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:44.794851 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0348c37-75ba-4d0f-9c96-982400b25f2e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:44.798620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 60/112] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:20:44.803595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 53/113] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:20:44 2022] GET /identity/v3/role_assignments?user.id=0dd44e420acf415d80d80217790d2581&scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695&role.id=1032cdf216bb48c38c1c98860da25d9f => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:44.953498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdf2d9-81b3-4801-954f-8630d8951452 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:45.047385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2472f-e30c-4511-ad64-959029dcd562 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:45.048011 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2472f-e30c-4511-ad64-959029dcd562 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:45.048491 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2472f-e30c-4511-ad64-959029dcd562 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:45.050054 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 54/114] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:20:45.055891 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c5887-d12f-4b77-bf03-bb9ab62ac543 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:45.056455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c5887-d12f-4b77-bf03-bb9ab62ac543 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:45.056951 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c5887-d12f-4b77-bf03-bb9ab62ac543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:45.099658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-0d7c5887-d12f-4b77-bf03-bb9ab62ac543 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:45.102992 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0d7c5887-d12f-4b77-bf03-bb9ab62ac543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:45.124713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdf2d9-81b3-4801-954f-8630d8951452 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:45.155897 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:45.196079 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6532b9-5ddc-4c83-a758-5445bd228baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:45.197101 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6532b9-5ddc-4c83-a758-5445bd228baf None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:45.197585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6532b9-5ddc-4c83-a758-5445bd228baf None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:45.198105 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6532b9-5ddc-4c83-a758-5445bd228baf None admin] PATH_INFO: `/v3/roles/member` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:45.220758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6532b9-5ddc-4c83-a758-5445bd228baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-2a6532b9-5ddc-4c83-a758-5445bd228baf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:45.227838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:45.228726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:45.229497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:45.229497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:45.229497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:45.229497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:45.229497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:45.229497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:45.229497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:45.229497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:45.229497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:45.229497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:45.229497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:45.229497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:45.233383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 61/115] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:45.234068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6532b9-5ddc-4c83-a758-5445bd228baf None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:45.244224 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 55/116] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 16 05:20:45.246389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c5887-d12f-4b77-bf03-bb9ab62ac543 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:45.409463 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6532b9-5ddc-4c83-a758-5445bd228baf None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:45.412131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:45.428523 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c5887-d12f-4b77-bf03-bb9ab62ac543 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:45.452224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cb407-97d2-4cf7-b263-29330a8c69c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:45.453327 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cb407-97d2-4cf7-b263-29330a8c69c2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:45.453803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cb407-97d2-4cf7-b263-29330a8c69c2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:45.454331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cb407-97d2-4cf7-b263-29330a8c69c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:45.466172 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cb407-97d2-4cf7-b263-29330a8c69c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-751cb407-97d2-4cf7-b263-29330a8c69c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:45.471485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:45.472391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:45.473185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:45.473185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:45.473185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:45.473185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:45.473185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:45.473185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:45.473185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:45.473185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:45.473185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:45.473185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:45.473185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:45.473185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:45.475847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 62/117] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:45.477338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa98628-7db9-47fc-a963-86804f3e3ec7 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:45.477814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa98628-7db9-47fc-a963-86804f3e3ec7 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:45.478275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa98628-7db9-47fc-a963-86804f3e3ec7 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:45.479939 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 63/118] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:45.485003 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa98628-7db9-47fc-a963-86804f3e3ec7 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:45.492590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164da0b-8f98-4ba6-a1b3-4a19c50541b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:45.493539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164da0b-8f98-4ba6-a1b3-4a19c50541b7 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:45.495747 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164da0b-8f98-4ba6-a1b3-4a19c50541b7 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:45.497781 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164da0b-8f98-4ba6-a1b3-4a19c50541b7 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:45.498683 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164da0b-8f98-4ba6-a1b3-4a19c50541b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:45.499189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164da0b-8f98-4ba6-a1b3-4a19c50541b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:45.502839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164da0b-8f98-4ba6-a1b3-4a19c50541b7 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:45.519688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 56/119] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:20:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:45.523186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b85982-ac8f-40a0-ab7a-d2d7612da9e5 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:45.524904 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b85982-ac8f-40a0-ab7a-d2d7612da9e5 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:45.526680 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b85982-ac8f-40a0-ab7a-d2d7612da9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:45.554173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c7b85982-ac8f-40a0-ab7a-d2d7612da9e5 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:45.555428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c7b85982-ac8f-40a0-ab7a-d2d7612da9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:45.558330 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:45.633121 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa98628-7db9-47fc-a963-86804f3e3ec7 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:45.647104 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 57/120] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:45.648437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b85982-ac8f-40a0-ab7a-d2d7612da9e5 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:45.677766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fb72b-9bac-4803-8b05-fc7bedf8e395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:45.678403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fb72b-9bac-4803-8b05-fc7bedf8e395 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:45.678711 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fb72b-9bac-4803-8b05-fc7bedf8e395 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:45.678987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fb72b-9bac-4803-8b05-fc7bedf8e395 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:45.679800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fb72b-9bac-4803-8b05-fc7bedf8e395 None admin] RBAC: Adding query filter params (name=member) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:45.680116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fb72b-9bac-4803-8b05-fc7bedf8e395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:45.681754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fb72b-9bac-4803-8b05-fc7bedf8e395 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:45.701915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 64/121] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:20:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:45.702906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fb72b-9bac-4803-8b05-fc7bedf8e395 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:45.747230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:45.765476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b85982-ac8f-40a0-ab7a-d2d7612da9e5 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:45.805576 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157d836-2422-498c-b256-1508ca93d7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:45.806212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157d836-2422-498c-b256-1508ca93d7d8 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:45.806496 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157d836-2422-498c-b256-1508ca93d7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:45.806797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157d836-2422-498c-b256-1508ca93d7d8 None admin] PATH_INFO: `/v3/users/fe727ca16f464f80a1fe24f7038c113c` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:45.808217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157d836-2422-498c-b256-1508ca93d7d8 None admin] RBAC: Authorizing `identity:get_user(user_id=fe727ca16f464f80a1fe24f7038c113c)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:45.809831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157d836-2422-498c-b256-1508ca93d7d8 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:45.811469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 58/122] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:45 2022] GET /identity/v3/users/fe727ca16f464f80a1fe24f7038c113c => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:45.812319 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157d836-2422-498c-b256-1508ca93d7d8 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:45.893436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:45.897580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fb72b-9bac-4803-8b05-fc7bedf8e395 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:45.927120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157d836-2422-498c-b256-1508ca93d7d8 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:45.964119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477d674-08a2-4373-bec1-4f967ad16ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:45.964755 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477d674-08a2-4373-bec1-4f967ad16ac7 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:45.965038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477d674-08a2-4373-bec1-4f967ad16ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:45.965313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477d674-08a2-4373-bec1-4f967ad16ac7 None admin] PATH_INFO: `/v3/users/fe727ca16f464f80a1fe24f7038c113c` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:45.966457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477d674-08a2-4373-bec1-4f967ad16ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=fe727ca16f464f80a1fe24f7038c113c)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:45.968073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477d674-08a2-4373-bec1-4f967ad16ac7 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:45.969667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 59/123] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:45 2022] GET /identity/v3/users/fe727ca16f464f80a1fe24f7038c113c => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:45.970685 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477d674-08a2-4373-bec1-4f967ad16ac7 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:45.999891 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aaf92-59a8-49e8-b3f4-debfc2c70a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:46.000465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aaf92-59a8-49e8-b3f4-debfc2c70a8e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:46.000745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aaf92-59a8-49e8-b3f4-debfc2c70a8e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:46.001020 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aaf92-59a8-49e8-b3f4-debfc2c70a8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:46.009034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:46.033488 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aaf92-59a8-49e8-b3f4-debfc2c70a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-9e3aaf92-59a8-49e8-b3f4-debfc2c70a8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:46.039421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:46.040268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:46.041037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:46.041037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:46.041037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:46.041037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:46.041037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:46.041037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:46.041037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:46.041037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:46.041037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:46.041037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:46.041037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:46.041037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:46.046657 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 65/124] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:20:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:46.047485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aaf92-59a8-49e8-b3f4-debfc2c70a8e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:46.081134 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477d674-08a2-4373-bec1-4f967ad16ac7 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:46.117419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40e2ed-df4f-4f12-a6ec-fd67feb536ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:46.118057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40e2ed-df4f-4f12-a6ec-fd67feb536ec None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:46.118339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40e2ed-df4f-4f12-a6ec-fd67feb536ec None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:46.118643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40e2ed-df4f-4f12-a6ec-fd67feb536ec None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:46.120234 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40e2ed-df4f-4f12-a6ec-fd67feb536ec None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:46.122093 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40e2ed-df4f-4f12-a6ec-fd67feb536ec None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:46.124567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 60/125] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:45 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:46.125252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40e2ed-df4f-4f12-a6ec-fd67feb536ec None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:46.199155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aaf92-59a8-49e8-b3f4-debfc2c70a8e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:46.237259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:46.238963 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42c4a5-fe79-4564-9002-1ea30d67581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:46.239901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42c4a5-fe79-4564-9002-1ea30d67581b None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:46.240429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42c4a5-fe79-4564-9002-1ea30d67581b None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:46.240958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42c4a5-fe79-4564-9002-1ea30d67581b None admin] PATH_INFO: `/v3/projects/b7909f8e3f9b48e9820881cc91531db8` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:46.243053 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42c4a5-fe79-4564-9002-1ea30d67581b None admin] RBAC: Authorizing `identity:get_project(project_id=b7909f8e3f9b48e9820881cc91531db8)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:46.244695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42c4a5-fe79-4564-9002-1ea30d67581b None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:46.246591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 66/126] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:46 2022] GET /identity/v3/projects/b7909f8e3f9b48e9820881cc91531db8 => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:46.247685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42c4a5-fe79-4564-9002-1ea30d67581b None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:46.248121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40e2ed-df4f-4f12-a6ec-fd67feb536ec None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:46.278730 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:46.296254 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc99ce-39dc-46c6-bb2e-3183c6e6ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:46.296870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc99ce-39dc-46c6-bb2e-3183c6e6ea48 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:46.297161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc99ce-39dc-46c6-bb2e-3183c6e6ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:46.297437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc99ce-39dc-46c6-bb2e-3183c6e6ea48 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:46.298426 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc99ce-39dc-46c6-bb2e-3183c6e6ea48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:46.298769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc99ce-39dc-46c6-bb2e-3183c6e6ea48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:46.300465 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc99ce-39dc-46c6-bb2e-3183c6e6ea48 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:46.310679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 61/127] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:46.311626 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc99ce-39dc-46c6-bb2e-3183c6e6ea48 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:46.366822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42c4a5-fe79-4564-9002-1ea30d67581b None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:46.410253 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915a309-3891-47c7-b937-a1d79a6deb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:46.410908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915a309-3891-47c7-b937-a1d79a6deb12 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:46.411187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915a309-3891-47c7-b937-a1d79a6deb12 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:46.411485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915a309-3891-47c7-b937-a1d79a6deb12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:46.428099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915a309-3891-47c7-b937-a1d79a6deb12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-2915a309-3891-47c7-b937-a1d79a6deb12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:46.435307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:46.436171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:46.437332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:46.437332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:46.437332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:46.437332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:46.437332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:46.437332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:46.437332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:46.437332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:46.437332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:46.437332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:46.437332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:20:46.437332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:46.437332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 67/128] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:20:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:46.438127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915a309-3891-47c7-b937-a1d79a6deb12 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:46.451022 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc99ce-39dc-46c6-bb2e-3183c6e6ea48 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:46.494768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387bf64-26a1-4d61-8bf1-355ad3473a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:46.495434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387bf64-26a1-4d61-8bf1-355ad3473a00 None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:46.495719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387bf64-26a1-4d61-8bf1-355ad3473a00 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:46.495997 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387bf64-26a1-4d61-8bf1-355ad3473a00 None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695/users/fe727ca16f464f80a1fe24f7038c113c/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:46.498780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387bf64-26a1-4d61-8bf1-355ad3473a00 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d2682aa15ad4d469e37e5c1e8c4a695, user_id=fe727ca16f464f80a1fe24f7038c113c, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:46.500359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387bf64-26a1-4d61-8bf1-355ad3473a00 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:46.518913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 62/129] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:20:46 2022] PUT /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695/users/fe727ca16f464f80a1fe24f7038c113c/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:20:46.519588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387bf64-26a1-4d61-8bf1-355ad3473a00 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:46.537187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:46.544495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:46.556378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915a309-3891-47c7-b937-a1d79a6deb12 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:46.596479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773fa79-3400-4706-9008-5f6df534be46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:46.597288 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773fa79-3400-4706-9008-5f6df534be46 None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:46.597735 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773fa79-3400-4706-9008-5f6df534be46 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:46.598083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773fa79-3400-4706-9008-5f6df534be46 None admin] PATH_INFO: `/v3/projects/b7909f8e3f9b48e9820881cc91531db8/users/fe727ca16f464f80a1fe24f7038c113c/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:46.600333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773fa79-3400-4706-9008-5f6df534be46 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7909f8e3f9b48e9820881cc91531db8, user_id=fe727ca16f464f80a1fe24f7038c113c, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:46.601983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773fa79-3400-4706-9008-5f6df534be46 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:46.641671 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 68/130] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:20:46 2022] PUT /identity/v3/projects/b7909f8e3f9b48e9820881cc91531db8/users/fe727ca16f464f80a1fe24f7038c113c/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:20:46.642531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773fa79-3400-4706-9008-5f6df534be46 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:46.676101 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387bf64-26a1-4d61-8bf1-355ad3473a00 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:46.728053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c522a-670d-4aa7-b3aa-1e9e5827b044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:46.728804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c522a-670d-4aa7-b3aa-1e9e5827b044 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:46.729092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c522a-670d-4aa7-b3aa-1e9e5827b044 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:46.729371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c522a-670d-4aa7-b3aa-1e9e5827b044 None admin] PATH_INFO: `/v3/users/c4192bd98cd24e289022a82073365dbc` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:46.730665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c522a-670d-4aa7-b3aa-1e9e5827b044 None admin] RBAC: Authorizing `identity:get_user(user_id=c4192bd98cd24e289022a82073365dbc)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:46.733064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c522a-670d-4aa7-b3aa-1e9e5827b044 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:46.736110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 63/131] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:46 2022] GET /identity/v3/users/c4192bd98cd24e289022a82073365dbc => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:46.744317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c522a-670d-4aa7-b3aa-1e9e5827b044 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:46.887860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773fa79-3400-4706-9008-5f6df534be46 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:46.904056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:46.941044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c522a-670d-4aa7-b3aa-1e9e5827b044 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:46.948798 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644130c-7c0a-4802-a291-f015922d7813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:46.949675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644130c-7c0a-4802-a291-f015922d7813 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:46.949957 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644130c-7c0a-4802-a291-f015922d7813 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:46.950227 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644130c-7c0a-4802-a291-f015922d7813 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:46.950919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644130c-7c0a-4802-a291-f015922d7813 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:46.951221 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644130c-7c0a-4802-a291-f015922d7813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:46.960235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644130c-7c0a-4802-a291-f015922d7813 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:46.968897 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 69/132] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:20:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:46.976078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644130c-7c0a-4802-a291-f015922d7813 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:46.984988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97a4b4-8220-47bb-8e66-72bd462e9974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:46.985631 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97a4b4-8220-47bb-8e66-72bd462e9974 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:46.985908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97a4b4-8220-47bb-8e66-72bd462e9974 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:46.986178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97a4b4-8220-47bb-8e66-72bd462e9974 None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:46.987337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97a4b4-8220-47bb-8e66-72bd462e9974 None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:46.988830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97a4b4-8220-47bb-8e66-72bd462e9974 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:46.990667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 64/133] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:46 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:46.997434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97a4b4-8220-47bb-8e66-72bd462e9974 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:47.010450 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:47.198562 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644130c-7c0a-4802-a291-f015922d7813 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:47.198960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97a4b4-8220-47bb-8e66-72bd462e9974 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:47.268444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acbe38-a989-443f-b3da-572a69c6622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:47.269131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acbe38-a989-443f-b3da-572a69c6622f None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:47.269415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acbe38-a989-443f-b3da-572a69c6622f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:47.269693 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acbe38-a989-443f-b3da-572a69c6622f None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695/users/c4192bd98cd24e289022a82073365dbc/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:47.272318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acbe38-a989-443f-b3da-572a69c6622f None admin] RBAC: Authorizing `identity:create_grant(project_id=2d2682aa15ad4d469e37e5c1e8c4a695, user_id=c4192bd98cd24e289022a82073365dbc, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:47.273798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acbe38-a989-443f-b3da-572a69c6622f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:47.273907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de10bd-e917-4f3b-87ac-f9ecf48833ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:47.274464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de10bd-e917-4f3b-87ac-f9ecf48833ce None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:47.274772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de10bd-e917-4f3b-87ac-f9ecf48833ce None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:47.275046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de10bd-e917-4f3b-87ac-f9ecf48833ce None admin] PATH_INFO: `/v3/users/fe727ca16f464f80a1fe24f7038c113c` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:47.279358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de10bd-e917-4f3b-87ac-f9ecf48833ce None admin] RBAC: Authorizing `identity:get_user(user_id=fe727ca16f464f80a1fe24f7038c113c)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:47.280892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de10bd-e917-4f3b-87ac-f9ecf48833ce None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:47.282874 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 70/134] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:46 2022] GET /identity/v3/users/fe727ca16f464f80a1fe24f7038c113c => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:20:47.290607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de10bd-e917-4f3b-87ac-f9ecf48833ce None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:47.303463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 65/135] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:20:46 2022] PUT /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695/users/c4192bd98cd24e289022a82073365dbc/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:20:47.390500 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae72bd-c4a7-46dd-8d06-b933afc78e16 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:47.391170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae72bd-c4a7-46dd-8d06-b933afc78e16 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:47.391702 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae72bd-c4a7-46dd-8d06-b933afc78e16 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:47.393409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 66/136] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:20:47.399790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b6980-0754-4769-a0ca-dbee2c823693 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:47.400367 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b6980-0754-4769-a0ca-dbee2c823693 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:47.400840 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b6980-0754-4769-a0ca-dbee2c823693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:47.405550 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:47.424094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-120b6980-0754-4769-a0ca-dbee2c823693 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:47.425786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-120b6980-0754-4769-a0ca-dbee2c823693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:47.430555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de10bd-e917-4f3b-87ac-f9ecf48833ce None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:47.430734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:47.485262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaed39-65e1-472e-8cd3-b6b8054edd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:47.485924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaed39-65e1-472e-8cd3-b6b8054edd94 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:47.486170 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaed39-65e1-472e-8cd3-b6b8054edd94 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:47.486439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaed39-65e1-472e-8cd3-b6b8054edd94 None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:47.488275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaed39-65e1-472e-8cd3-b6b8054edd94 None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:47.490325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaed39-65e1-472e-8cd3-b6b8054edd94 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:47.492417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 71/137] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:47 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:47.497866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaed39-65e1-472e-8cd3-b6b8054edd94 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:47.507840 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 67/138] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:20:47.649937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaed39-65e1-472e-8cd3-b6b8054edd94 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:47.700724 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7b38d-fe1f-47fb-a924-c82b0a76998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:47.701395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7b38d-fe1f-47fb-a924-c82b0a76998d None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:47.701673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7b38d-fe1f-47fb-a924-c82b0a76998d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:47.701947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7b38d-fe1f-47fb-a924-c82b0a76998d None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695/users/fe727ca16f464f80a1fe24f7038c113c/roles/49763e40fa024aaa9522c00cea577eca` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:47.704190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7b38d-fe1f-47fb-a924-c82b0a76998d None admin] RBAC: Authorizing `identity:create_grant(project_id=2d2682aa15ad4d469e37e5c1e8c4a695, user_id=fe727ca16f464f80a1fe24f7038c113c, role_id=49763e40fa024aaa9522c00cea577eca)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:47.705652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7b38d-fe1f-47fb-a924-c82b0a76998d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:47.731163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 72/139] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:20:47 2022] PUT /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695/users/fe727ca16f464f80a1fe24f7038c113c/roles/49763e40fa024aaa9522c00cea577eca => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:20:47.821016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b6980-0754-4769-a0ca-dbee2c823693 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:47.867194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee1f0d-90e8-4f3c-a42c-df8a8d5b6542 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:47.867511 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee1f0d-90e8-4f3c-a42c-df8a8d5b6542 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:47.867776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee1f0d-90e8-4f3c-a42c-df8a8d5b6542 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:47.869572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 73/140] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:47.881001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aabed-0e4c-4239-b19d-8ccb7feca95f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:47.881330 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aabed-0e4c-4239-b19d-8ccb7feca95f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:47.881588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aabed-0e4c-4239-b19d-8ccb7feca95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:47.903132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:47.912963 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-423aabed-0e4c-4239-b19d-8ccb7feca95f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:47.918214 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-423aabed-0e4c-4239-b19d-8ccb7feca95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:47.940191 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b6980-0754-4769-a0ca-dbee2c823693 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:47.979777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63d553-c14a-4a55-b2a2-2f46e62e500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:47.980858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63d553-c14a-4a55-b2a2-2f46e62e500e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:47.981483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63d553-c14a-4a55-b2a2-2f46e62e500e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:47.981954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63d553-c14a-4a55-b2a2-2f46e62e500e None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:47.983389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63d553-c14a-4a55-b2a2-2f46e62e500e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:47.985100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63d553-c14a-4a55-b2a2-2f46e62e500e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:47.987220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 68/141] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:20:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:47.993040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63d553-c14a-4a55-b2a2-2f46e62e500e None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:48.003219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:48.046521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 74/142] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:48.104753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63d553-c14a-4a55-b2a2-2f46e62e500e None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:48.147510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94f58f-4807-41c9-8ae1-f4be08874e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:48.148123 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94f58f-4807-41c9-8ae1-f4be08874e7b None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:48.148402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94f58f-4807-41c9-8ae1-f4be08874e7b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:48.148677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94f58f-4807-41c9-8ae1-f4be08874e7b None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:48.149392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94f58f-4807-41c9-8ae1-f4be08874e7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:48.150921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94f58f-4807-41c9-8ae1-f4be08874e7b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:48.187924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 69/143] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:20:47 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:20:48.497906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423aabed-0e4c-4239-b19d-8ccb7feca95f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:48.621587 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423aabed-0e4c-4239-b19d-8ccb7feca95f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:48.660450 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a9eef-73bd-4f5a-ab71-b4fb08cd0365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:48.661905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a9eef-73bd-4f5a-ab71-b4fb08cd0365 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:48.662382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a9eef-73bd-4f5a-ab71-b4fb08cd0365 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:48.662867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a9eef-73bd-4f5a-ab71-b4fb08cd0365 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:48.671298 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:48.679690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a9eef-73bd-4f5a-ab71-b4fb08cd0365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-c21a9eef-73bd-4f5a-ab71-b4fb08cd0365 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:48.684869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:48.685708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:48.687102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:48.687102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:48.687102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:48.687102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:48.687102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:48.687102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:48.687102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:48.687102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:48.687102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:48.687102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:48.687102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:20:48.687102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:48.689183 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 75/144] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:48.696545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94f58f-4807-41c9-8ae1-f4be08874e7b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:48.765985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:48.812429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94f58f-4807-41c9-8ae1-f4be08874e7b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:48.853906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da62c7-f34d-4a49-8c48-61676c4a981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:48.855381 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da62c7-f34d-4a49-8c48-61676c4a981f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:48.855863 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da62c7-f34d-4a49-8c48-61676c4a981f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:48.856332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da62c7-f34d-4a49-8c48-61676c4a981f None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:48.857290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da62c7-f34d-4a49-8c48-61676c4a981f None admin] RBAC: Adding query filter params (name=reader) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:48.857818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da62c7-f34d-4a49-8c48-61676c4a981f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:48.859590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da62c7-f34d-4a49-8c48-61676c4a981f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:48.871277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 70/145] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:20:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:48.876847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a9eef-73bd-4f5a-ab71-b4fb08cd0365 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:48.992593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a9eef-73bd-4f5a-ab71-b4fb08cd0365 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:49.029542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21006b1-268f-46dc-b7fd-413ef777d036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:49.030493 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21006b1-268f-46dc-b7fd-413ef777d036 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:49.031005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21006b1-268f-46dc-b7fd-413ef777d036 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:49.031471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21006b1-268f-46dc-b7fd-413ef777d036 None admin] PATH_INFO: `/v3/users/0dd44e420acf415d80d80217790d2581` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:49.032870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21006b1-268f-46dc-b7fd-413ef777d036 None admin] RBAC: Authorizing `identity:get_user(user_id=0dd44e420acf415d80d80217790d2581)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:49.034584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21006b1-268f-46dc-b7fd-413ef777d036 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:49.036440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 76/146] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:48 2022] GET /identity/v3/users/0dd44e420acf415d80d80217790d2581 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:20:49.042846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da62c7-f34d-4a49-8c48-61676c4a981f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:49.160162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da62c7-f34d-4a49-8c48-61676c4a981f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:49.184389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:49.197580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8fb23-bfdf-4bc1-8cb7-897529788416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:49.198219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fb23-bfdf-4bc1-8cb7-897529788416 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:49.198522 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fb23-bfdf-4bc1-8cb7-897529788416 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:49.198814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fb23-bfdf-4bc1-8cb7-897529788416 None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:49.199963 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8fb23-bfdf-4bc1-8cb7-897529788416 None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:49.201407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8fb23-bfdf-4bc1-8cb7-897529788416 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:49.203312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 71/147] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:49 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:49.210001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21006b1-268f-46dc-b7fd-413ef777d036 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:49.285128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:49.326117 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21006b1-268f-46dc-b7fd-413ef777d036 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:49.363328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f78694-e9cb-436c-a1f1-e8a61464c818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:49.363989 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f78694-e9cb-436c-a1f1-e8a61464c818 None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:49.364802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f78694-e9cb-436c-a1f1-e8a61464c818 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:49.365218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f78694-e9cb-436c-a1f1-e8a61464c818 None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695/users/0dd44e420acf415d80d80217790d2581/roles/1032cdf216bb48c38c1c98860da25d9f` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:49.367258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f78694-e9cb-436c-a1f1-e8a61464c818 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d2682aa15ad4d469e37e5c1e8c4a695, user_id=0dd44e420acf415d80d80217790d2581, role_id=1032cdf216bb48c38c1c98860da25d9f)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:49.368807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f78694-e9cb-436c-a1f1-e8a61464c818 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:49.384841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 77/148] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:20:49 2022] PUT /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695/users/0dd44e420acf415d80d80217790d2581/roles/1032cdf216bb48c38c1c98860da25d9f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:20:50.084156 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b69d15-111a-432d-bfc0-d72931be8001 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:50.084659 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b69d15-111a-432d-bfc0-d72931be8001 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:50.084760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b69d15-111a-432d-bfc0-d72931be8001 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:50.086061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 72/149] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:50.106125 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d2a77-ef16-40fd-95b5-a90495bcf895 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:50.106638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d2a77-ef16-40fd-95b5-a90495bcf895 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:50.106710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d2a77-ef16-40fd-95b5-a90495bcf895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:50.129204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-4b0d2a77-ef16-40fd-95b5-a90495bcf895 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:50.130986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4b0d2a77-ef16-40fd-95b5-a90495bcf895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:50.214125 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 78/150] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:50.261978 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7c377-95c4-41b0-b58e-e11d927fead2 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:50.262267 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7c377-95c4-41b0-b58e-e11d927fead2 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:50.262559 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7c377-95c4-41b0-b58e-e11d927fead2 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:50.264255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 73/151] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:50.269171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071eadf-4fce-415e-b24c-b2c49138b33b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:50.269701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071eadf-4fce-415e-b24c-b2c49138b33b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:50.270178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071eadf-4fce-415e-b24c-b2c49138b33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:50.297964 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-2071eadf-4fce-415e-b24c-b2c49138b33b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:50.299545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2071eadf-4fce-415e-b24c-b2c49138b33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:50.366274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:50.391729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 79/152] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:50.814056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7c377-95c4-41b0-b58e-e11d927fead2 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:50.862746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071eadf-4fce-415e-b24c-b2c49138b33b None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:50.968183 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7c377-95c4-41b0-b58e-e11d927fead2 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:51.001894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071eadf-4fce-415e-b24c-b2c49138b33b None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:51.038698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7fe67-1579-4f9c-b029-9eff2aa95af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:51.039360 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7fe67-1579-4f9c-b029-9eff2aa95af3 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:51.039638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7fe67-1579-4f9c-b029-9eff2aa95af3 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:51.039910 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7fe67-1579-4f9c-b029-9eff2aa95af3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:51.049651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04afea1-9ad8-4640-bca5-f45d462302db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:51.049651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04afea1-9ad8-4640-bca5-f45d462302db None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:51.049651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04afea1-9ad8-4640-bca5-f45d462302db None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:51.049651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04afea1-9ad8-4640-bca5-f45d462302db None admin] PATH_INFO: `/v3/roles/member` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:51.072720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04afea1-9ad8-4640-bca5-f45d462302db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:51.072885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7fe67-1579-4f9c-b029-9eff2aa95af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-f6f7fe67-1579-4f9c-b029-9eff2aa95af3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:51.077553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:51.078387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:51.079174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:51.079174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:51.079174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:51.079174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:51.079174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:51.079174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:51.079174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:51.079174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:51.079174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:51.079174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:51.079174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:51.079174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:20:51.079174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 74/153] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:51.080273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987e536-8a1b-46ff-90ab-6136d5ac6896 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:51.080273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987e536-8a1b-46ff-90ab-6136d5ac6896 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:51.080423 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987e536-8a1b-46ff-90ab-6136d5ac6896 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-f04afea1-9ad8-4640-bca5-f45d462302db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:51.081229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:51.082047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:51.083100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:51.083100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:51.083100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:51.083100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:51.083100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:51.083100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:51.083100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:51.083100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:51.083100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:51.083100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:51.083100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:51.083100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:51.083684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 75/154] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:51.085379 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 80/155] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:51.092139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04afea1-9ad8-4640-bca5-f45d462302db None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:51.092534 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c99396-c54e-4c01-9b8a-70fb44458261 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:51.093297 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c99396-c54e-4c01-9b8a-70fb44458261 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:51.093705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c99396-c54e-4c01-9b8a-70fb44458261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:51.138132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-33c99396-c54e-4c01-9b8a-70fb44458261 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:51.139598 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-33c99396-c54e-4c01-9b8a-70fb44458261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:51.200041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:51.238764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:51.285679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 76/156] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:51.288121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c99396-c54e-4c01-9b8a-70fb44458261 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:51.329277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04afea1-9ad8-4640-bca5-f45d462302db None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:51.402896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c36402-048e-460f-b7ac-5f2ce35c6c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:51.403508 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c36402-048e-460f-b7ac-5f2ce35c6c14 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:51.403782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c36402-048e-460f-b7ac-5f2ce35c6c14 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:51.404047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c36402-048e-460f-b7ac-5f2ce35c6c14 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:51.404705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c36402-048e-460f-b7ac-5f2ce35c6c14 None admin] RBAC: Adding query filter params (name=member) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:51.405001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c36402-048e-460f-b7ac-5f2ce35c6c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:51.406396 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c36402-048e-460f-b7ac-5f2ce35c6c14 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:51.422816 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 81/157] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:20:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:51.429184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bce89-4d82-4f71-a6d0-12f306844c15 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:51.429465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bce89-4d82-4f71-a6d0-12f306844c15 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:51.429736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bce89-4d82-4f71-a6d0-12f306844c15 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:51.431030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 82/158] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:51.434366 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bce89-4d82-4f71-a6d0-12f306844c15 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:51.507598 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c99396-c54e-4c01-9b8a-70fb44458261 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:51.576568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505910e-5413-4271-aef9-08938d3fc26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:51.577192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505910e-5413-4271-aef9-08938d3fc26c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:51.577470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505910e-5413-4271-aef9-08938d3fc26c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:51.577750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505910e-5413-4271-aef9-08938d3fc26c None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:51.578418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505910e-5413-4271-aef9-08938d3fc26c None admin] RBAC: Adding query filter params (name=member) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:51.581564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505910e-5413-4271-aef9-08938d3fc26c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:51.583556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505910e-5413-4271-aef9-08938d3fc26c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:51.597094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 77/159] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:20:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:51.598359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1215-90fe-4f65-8e7e-b687998e1d3e None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:51.599220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1215-90fe-4f65-8e7e-b687998e1d3e None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:51.599501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1215-90fe-4f65-8e7e-b687998e1d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:51.637243 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-125e1215-90fe-4f65-8e7e-b687998e1d3e None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:51.638459 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-125e1215-90fe-4f65-8e7e-b687998e1d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:51.652162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bce89-4d82-4f71-a6d0-12f306844c15 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:51.664474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:51.709110 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37a396-8a67-40bb-9fdf-4f2ac357c45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:51.710117 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37a396-8a67-40bb-9fdf-4f2ac357c45c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:51.710642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37a396-8a67-40bb-9fdf-4f2ac357c45c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:51.711252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37a396-8a67-40bb-9fdf-4f2ac357c45c None admin] PATH_INFO: `/v3/users/fe727ca16f464f80a1fe24f7038c113c` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:51.715245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37a396-8a67-40bb-9fdf-4f2ac357c45c None admin] RBAC: Authorizing `identity:get_user(user_id=fe727ca16f464f80a1fe24f7038c113c)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:51.717043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37a396-8a67-40bb-9fdf-4f2ac357c45c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:51.718935 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 83/160] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:51 2022] GET /identity/v3/users/fe727ca16f464f80a1fe24f7038c113c => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:51.719460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:51.720005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37a396-8a67-40bb-9fdf-4f2ac357c45c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:51.775714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 78/161] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:51.776471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e1215-90fe-4f65-8e7e-b687998e1d3e None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:51.873024 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37a396-8a67-40bb-9fdf-4f2ac357c45c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:51.937143 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e1215-90fe-4f65-8e7e-b687998e1d3e None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:51.938415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9406a70-5ee5-41fc-a922-f602ecb72192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:51.939253 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9406a70-5ee5-41fc-a922-f602ecb72192 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:51.939919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9406a70-5ee5-41fc-a922-f602ecb72192 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:51.940328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9406a70-5ee5-41fc-a922-f602ecb72192 None admin] PATH_INFO: `/v3/users/fe727ca16f464f80a1fe24f7038c113c` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:51.941650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9406a70-5ee5-41fc-a922-f602ecb72192 None admin] RBAC: Authorizing `identity:get_user(user_id=fe727ca16f464f80a1fe24f7038c113c)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:51.943860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9406a70-5ee5-41fc-a922-f602ecb72192 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:51.945992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 84/162] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:51 2022] GET /identity/v3/users/fe727ca16f464f80a1fe24f7038c113c => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:51.947010 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9406a70-5ee5-41fc-a922-f602ecb72192 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:51.992589 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58672d8f-88b5-4aec-af5b-8fef6bcfec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:51.993257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58672d8f-88b5-4aec-af5b-8fef6bcfec50 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:51.993566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58672d8f-88b5-4aec-af5b-8fef6bcfec50 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:51.993840 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58672d8f-88b5-4aec-af5b-8fef6bcfec50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:52.003748 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:52.070967 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:52.094339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58672d8f-88b5-4aec-af5b-8fef6bcfec50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:52.095862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58672d8f-88b5-4aec-af5b-8fef6bcfec50 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:52.138614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9406a70-5ee5-41fc-a922-f602ecb72192 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:52.195932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 79/163] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:20:52.197255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58672d8f-88b5-4aec-af5b-8fef6bcfec50 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:52.219226 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b2ea3-9fb2-45ac-9398-7aa0844dc758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:52.219880 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b2ea3-9fb2-45ac-9398-7aa0844dc758 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:52.220164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b2ea3-9fb2-45ac-9398-7aa0844dc758 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:52.220437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b2ea3-9fb2-45ac-9398-7aa0844dc758 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:52.243937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b2ea3-9fb2-45ac-9398-7aa0844dc758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-043b2ea3-9fb2-45ac-9398-7aa0844dc758 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:52.254530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:52.255997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:52.256762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:52.256762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:52.256762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:52.256762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:52.256762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:52.256762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:52.256762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:52.256762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:52.256762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:52.256762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:52.256762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:52.256762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:52.259087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 85/164] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:20:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:52.260102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b2ea3-9fb2-45ac-9398-7aa0844dc758 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:52.290897 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:52.318827 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58672d8f-88b5-4aec-af5b-8fef6bcfec50 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:52.378767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a727a3-1f8c-4941-a719-6e28cd10b56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:52.380491 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a727a3-1f8c-4941-a719-6e28cd10b56a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:52.380981 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a727a3-1f8c-4941-a719-6e28cd10b56a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:52.381396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a727a3-1f8c-4941-a719-6e28cd10b56a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:52.482086 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b2ea3-9fb2-45ac-9398-7aa0844dc758 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:52.486902 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:52.535101 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a727a3-1f8c-4941-a719-6e28cd10b56a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:52.537648 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a727a3-1f8c-4941-a719-6e28cd10b56a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:52.552542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69310fd-dd89-478b-b8a8-914e798e655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:52.553445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69310fd-dd89-478b-b8a8-914e798e655a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:52.553901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69310fd-dd89-478b-b8a8-914e798e655a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:52.554348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69310fd-dd89-478b-b8a8-914e798e655a None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:52.559317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69310fd-dd89-478b-b8a8-914e798e655a None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:52.561948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69310fd-dd89-478b-b8a8-914e798e655a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:52.566109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 86/165] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:52 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:52.572119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69310fd-dd89-478b-b8a8-914e798e655a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:52.690851 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:52.756964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 80/166] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:20:52.757751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a727a3-1f8c-4941-a719-6e28cd10b56a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:52.784090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69310fd-dd89-478b-b8a8-914e798e655a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:52.867237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dd0c4-a3c2-42a7-96c6-9c225b558dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:52.868290 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd0c4-a3c2-42a7-96c6-9c225b558dea None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:52.868755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd0c4-a3c2-42a7-96c6-9c225b558dea None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:52.869249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd0c4-a3c2-42a7-96c6-9c225b558dea None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:52.870098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dd0c4-a3c2-42a7-96c6-9c225b558dea None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:52.870606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dd0c4-a3c2-42a7-96c6-9c225b558dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:52.872192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dd0c4-a3c2-42a7-96c6-9c225b558dea None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:52.886129 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 87/167] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:52.887282 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dd0c4-a3c2-42a7-96c6-9c225b558dea None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:52.962936 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:52.980641 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a727a3-1f8c-4941-a719-6e28cd10b56a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:53.074634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e24377-c5ee-4129-b451-5a5d27e4f802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:53.075609 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e24377-c5ee-4129-b451-5a5d27e4f802 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.076071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e24377-c5ee-4129-b451-5a5d27e4f802 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.076694 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e24377-c5ee-4129-b451-5a5d27e4f802 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.103950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e24377-c5ee-4129-b451-5a5d27e4f802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-56e24377-c5ee-4129-b451-5a5d27e4f802 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:53.109714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:53.110722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:53.111540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:53.111540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:53.111540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:53.111540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:53.111540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:53.111540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:53.111540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:53.111540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:53.111540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:53.111540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:53.111540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:20:53.111540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:20:53.111540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 81/168] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:20:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:53.112202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e24377-c5ee-4129-b451-5a5d27e4f802 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:53.128700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dd0c4-a3c2-42a7-96c6-9c225b558dea None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:53.194126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:53.202797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b987e-b67a-440a-a894-a270eed5f3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:53.203411 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b987e-b67a-440a-a894-a270eed5f3fd None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.203859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b987e-b67a-440a-a894-a270eed5f3fd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.204278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b987e-b67a-440a-a894-a270eed5f3fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.205237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b987e-b67a-440a-a894-a270eed5f3fd None admin] RBAC: Adding query filter params (role.id=d912a7e672bb441099f4ef85d61e7c46, scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695, user.id=fe727ca16f464f80a1fe24f7038c113c) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:53.205691 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b987e-b67a-440a-a894-a270eed5f3fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:53.207401 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b987e-b67a-440a-a894-a270eed5f3fd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:53.222388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 88/169] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:20:52 2022] GET /identity/v3/role_assignments?user.id=fe727ca16f464f80a1fe24f7038c113c&scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695&role.id=d912a7e672bb441099f4ef85d61e7c46 => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:53.224098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b987e-b67a-440a-a894-a270eed5f3fd None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:53.317342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e24377-c5ee-4129-b451-5a5d27e4f802 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:53.386787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316463-6186-4d49-973a-b0c7b2cc1490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:53.387348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316463-6186-4d49-973a-b0c7b2cc1490 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.387623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316463-6186-4d49-973a-b0c7b2cc1490 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.389328 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316463-6186-4d49-973a-b0c7b2cc1490 None admin] PATH_INFO: `/v3/projects/b7909f8e3f9b48e9820881cc91531db8` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.390922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad316463-6186-4d49-973a-b0c7b2cc1490 None admin] RBAC: Authorizing `identity:get_project(project_id=b7909f8e3f9b48e9820881cc91531db8)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:53.392446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad316463-6186-4d49-973a-b0c7b2cc1490 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:53.400249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 82/170] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:53 2022] GET /identity/v3/projects/b7909f8e3f9b48e9820881cc91531db8 => generated 312 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:53.406107 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a909de8-9c3a-412e-bbf8-127a08e5b4db None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.406772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a909de8-9c3a-412e-bbf8-127a08e5b4db None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.407205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a909de8-9c3a-412e-bbf8-127a08e5b4db None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.408810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 83/171] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:53.412311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a909de8-9c3a-412e-bbf8-127a08e5b4db None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:53.430769 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:53.444045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b987e-b67a-440a-a894-a270eed5f3fd None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:53.500509 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e09ae2-8fb1-40cd-a9e4-14a77a7554f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:53.501483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e09ae2-8fb1-40cd-a9e4-14a77a7554f7 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.501973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e09ae2-8fb1-40cd-a9e4-14a77a7554f7 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.502437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e09ae2-8fb1-40cd-a9e4-14a77a7554f7 None admin] PATH_INFO: `/v3/users/c4192bd98cd24e289022a82073365dbc` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.505319 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e09ae2-8fb1-40cd-a9e4-14a77a7554f7 None admin] RBAC: Authorizing `identity:get_user(user_id=c4192bd98cd24e289022a82073365dbc)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:53.507079 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e09ae2-8fb1-40cd-a9e4-14a77a7554f7 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:53.508934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 89/172] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:53 2022] GET /identity/v3/users/c4192bd98cd24e289022a82073365dbc => generated 247 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:53.510340 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540fde8-74c2-4494-97cf-e948c0cd164e None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.511628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540fde8-74c2-4494-97cf-e948c0cd164e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.512145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540fde8-74c2-4494-97cf-e948c0cd164e None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.513732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 90/173] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:53.514702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540fde8-74c2-4494-97cf-e948c0cd164e None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:53.561908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a909de8-9c3a-412e-bbf8-127a08e5b4db None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:53.563750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:53.618144 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fa9f4-9137-4b73-a3f8-f2bd280a0edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:53.619087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fa9f4-9137-4b73-a3f8-f2bd280a0edf None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.619480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fa9f4-9137-4b73-a3f8-f2bd280a0edf None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.619757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fa9f4-9137-4b73-a3f8-f2bd280a0edf None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.620427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fa9f4-9137-4b73-a3f8-f2bd280a0edf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:53.620719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fa9f4-9137-4b73-a3f8-f2bd280a0edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:53.623099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fa9f4-9137-4b73-a3f8-f2bd280a0edf None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:53.632438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 84/174] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:20:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:53.634003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da8c2-1e06-42b0-a586-3b5e3310e96c None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.634467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da8c2-1e06-42b0-a586-3b5e3310e96c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.634945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3da8c2-1e06-42b0-a586-3b5e3310e96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.650144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540fde8-74c2-4494-97cf-e948c0cd164e None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:53.654247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-fb3da8c2-1e06-42b0-a586-3b5e3310e96c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:53.655461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-fb3da8c2-1e06-42b0-a586-3b5e3310e96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:53.683464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a4a0a-d029-4008-8b95-c8b8c722f40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:53.684088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a4a0a-d029-4008-8b95-c8b8c722f40e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.684363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a4a0a-d029-4008-8b95-c8b8c722f40e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.684629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a4a0a-d029-4008-8b95-c8b8c722f40e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.685341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a4a0a-d029-4008-8b95-c8b8c722f40e None admin] RBAC: Adding query filter params (role.id=d912a7e672bb441099f4ef85d61e7c46, scope.project.id=b7909f8e3f9b48e9820881cc91531db8, user.id=fe727ca16f464f80a1fe24f7038c113c) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:53.685645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a4a0a-d029-4008-8b95-c8b8c722f40e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:53.687120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a4a0a-d029-4008-8b95-c8b8c722f40e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:53.693631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 91/175] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:20:53 2022] GET /identity/v3/role_assignments?user.id=fe727ca16f464f80a1fe24f7038c113c&scope.project.id=b7909f8e3f9b48e9820881cc91531db8&role.id=d912a7e672bb441099f4ef85d61e7c46 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:53.694617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a55713-02bb-40f3-8f5a-68022743ae52 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.694886 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a55713-02bb-40f3-8f5a-68022743ae52 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.695154 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a55713-02bb-40f3-8f5a-68022743ae52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.714091 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-d0a55713-02bb-40f3-8f5a-68022743ae52 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:53.715373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d0a55713-02bb-40f3-8f5a-68022743ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:53.739621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 85/176] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:53.740295 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:53.743787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3da8c2-1e06-42b0-a586-3b5e3310e96c None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:53.797112 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 92/177] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:53.798918 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5aa24-7729-4a4b-9d87-45ef04dec7b1 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.799464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5aa24-7729-4a4b-9d87-45ef04dec7b1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.799977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5aa24-7729-4a4b-9d87-45ef04dec7b1 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.801870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 93/178] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:53.802912 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5aa24-7729-4a4b-9d87-45ef04dec7b1 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:53.855116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:53.862819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3da8c2-1e06-42b0-a586-3b5e3310e96c None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:53.915331 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075c6d9-f913-46b9-9b07-d217818a477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:53.916433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075c6d9-f913-46b9-9b07-d217818a477e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.916433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075c6d9-f913-46b9-9b07-d217818a477e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.916611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075c6d9-f913-46b9-9b07-d217818a477e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.935436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5aa24-7729-4a4b-9d87-45ef04dec7b1 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:53.986778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996ac68-95d1-4f36-a1bb-b36493625fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:53.987905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ac68-95d1-4f36-a1bb-b36493625fbb None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.988180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ac68-95d1-4f36-a1bb-b36493625fbb None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.988586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ac68-95d1-4f36-a1bb-b36493625fbb None admin] PATH_INFO: `/v3/users/fe727ca16f464f80a1fe24f7038c113c` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.990379 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996ac68-95d1-4f36-a1bb-b36493625fbb None admin] RBAC: Authorizing `identity:get_user(user_id=fe727ca16f464f80a1fe24f7038c113c)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:53.992783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996ac68-95d1-4f36-a1bb-b36493625fbb None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:53.995268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 94/179] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:53 2022] GET /identity/v3/users/fe727ca16f464f80a1fe24f7038c113c => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:53.996486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993a0f4-746f-4391-9921-da3444f2aa0a None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.996764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993a0f4-746f-4391-9921-da3444f2aa0a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:53.997030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993a0f4-746f-4391-9921-da3444f2aa0a None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:53.998351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 95/180] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:53.999305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb41ff5-6122-48b6-8da2-fbf5d93ba2a6 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:53.999713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb41ff5-6122-48b6-8da2-fbf5d93ba2a6 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:54.000128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb41ff5-6122-48b6-8da2-fbf5d93ba2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:54.007575 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075c6d9-f913-46b9-9b07-d217818a477e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:54.009358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075c6d9-f913-46b9-9b07-d217818a477e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:54.021841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-beb41ff5-6122-48b6-8da2-fbf5d93ba2a6 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:54.024272 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-beb41ff5-6122-48b6-8da2-fbf5d93ba2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:54.057465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:54.115374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 96/181] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:54.116501 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb41ff5-6122-48b6-8da2-fbf5d93ba2a6 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:54.124804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:54.135307 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 86/182] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:20:54.139884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad358e-93a0-4af8-a99b-a6db5c67c0aa None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:54.140176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad358e-93a0-4af8-a99b-a6db5c67c0aa None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:54.140447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad358e-93a0-4af8-a99b-a6db5c67c0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:54.157885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-27ad358e-93a0-4af8-a99b-a6db5c67c0aa None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:54.159121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-27ad358e-93a0-4af8-a99b-a6db5c67c0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:54.228434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb41ff5-6122-48b6-8da2-fbf5d93ba2a6 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:54.242347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 87/183] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:54.243305 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad358e-93a0-4af8-a99b-a6db5c67c0aa None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:54.273304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f9afe-86d2-4fed-8de6-348ad89d7d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:54.274412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f9afe-86d2-4fed-8de6-348ad89d7d9a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:54.275154 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f9afe-86d2-4fed-8de6-348ad89d7d9a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:54.275962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f9afe-86d2-4fed-8de6-348ad89d7d9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:54.312411 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:54.356936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad358e-93a0-4af8-a99b-a6db5c67c0aa None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:54.372863 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f9afe-86d2-4fed-8de6-348ad89d7d9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:54.375345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f9afe-86d2-4fed-8de6-348ad89d7d9a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:54.383926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:54.395669 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e427e09-5eb1-49a6-b559-0ed6a3000c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:54.396350 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e427e09-5eb1-49a6-b559-0ed6a3000c21 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:54.396676 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e427e09-5eb1-49a6-b559-0ed6a3000c21 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:54.396949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e427e09-5eb1-49a6-b559-0ed6a3000c21 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:54.408013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e427e09-5eb1-49a6-b559-0ed6a3000c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-7e427e09-5eb1-49a6-b559-0ed6a3000c21 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:54.413476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:54.414392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 88/184] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:54.415464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e427e09-5eb1-49a6-b559-0ed6a3000c21 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:54.486730 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 97/185] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:20:54.487532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f9afe-86d2-4fed-8de6-348ad89d7d9a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:54.532356 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e427e09-5eb1-49a6-b559-0ed6a3000c21 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:54.545553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:54.567280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c388df1-0e9a-4c37-b592-804468ff1252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:54.567908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c388df1-0e9a-4c37-b592-804468ff1252 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:54.568183 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c388df1-0e9a-4c37-b592-804468ff1252 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:54.568450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c388df1-0e9a-4c37-b592-804468ff1252 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:54.578217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c388df1-0e9a-4c37-b592-804468ff1252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-7c388df1-0e9a-4c37-b592-804468ff1252 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:54.583658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:54.584571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:54.585359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:54.585359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:54.585359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:54.585359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:54.585359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:54.585359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:54.585359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:54.585359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:54.585359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:54.585359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:54.585359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:54.585359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:20:54.585359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 89/186] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:54.586124 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c388df1-0e9a-4c37-b592-804468ff1252 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:54.592637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f9afe-86d2-4fed-8de6-348ad89d7d9a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:54.625435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67acfa5-cac9-44f0-a96b-9ce0d5caeb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:54.626051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67acfa5-cac9-44f0-a96b-9ce0d5caeb7c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:54.626333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67acfa5-cac9-44f0-a96b-9ce0d5caeb7c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:54.626633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67acfa5-cac9-44f0-a96b-9ce0d5caeb7c None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:54.627754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67acfa5-cac9-44f0-a96b-9ce0d5caeb7c None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:54.629207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67acfa5-cac9-44f0-a96b-9ce0d5caeb7c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:54.630221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:54.630876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 98/187] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:54 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:54.631631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67acfa5-cac9-44f0-a96b-9ce0d5caeb7c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:54.687972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c388df1-0e9a-4c37-b592-804468ff1252 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:54.721012 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4753ce-ba2f-4c4b-938d-5ec425dcbe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:54.721627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4753ce-ba2f-4c4b-938d-5ec425dcbe5a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:54.721902 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4753ce-ba2f-4c4b-938d-5ec425dcbe5a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:54.722170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4753ce-ba2f-4c4b-938d-5ec425dcbe5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:54.723350 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4753ce-ba2f-4c4b-938d-5ec425dcbe5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:54.725317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4753ce-ba2f-4c4b-938d-5ec425dcbe5a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:54.727052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 90/188] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:20:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:54.727719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4753ce-ba2f-4c4b-938d-5ec425dcbe5a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:54.736587 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67acfa5-cac9-44f0-a96b-9ce0d5caeb7c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:54.761539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:54.772675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2cab-30fe-42cd-a253-b217a0b01e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:54.773282 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2cab-30fe-42cd-a253-b217a0b01e6b None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:54.773553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2cab-30fe-42cd-a253-b217a0b01e6b None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:54.773821 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2cab-30fe-42cd-a253-b217a0b01e6b None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:54.774480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda2cab-30fe-42cd-a253-b217a0b01e6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:54.774820 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda2cab-30fe-42cd-a253-b217a0b01e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:54.776201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda2cab-30fe-42cd-a253-b217a0b01e6b None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:54.784439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 99/189] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:20:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:54.785425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2cab-30fe-42cd-a253-b217a0b01e6b None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:54.837578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4753ce-ba2f-4c4b-938d-5ec425dcbe5a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:54.850674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:54.871555 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f3e64-8497-4a52-b207-c3b389e1b21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:54.872279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f3e64-8497-4a52-b207-c3b389e1b21d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:54.872560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f3e64-8497-4a52-b207-c3b389e1b21d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:54.872878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f3e64-8497-4a52-b207-c3b389e1b21d None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:54.874151 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f3e64-8497-4a52-b207-c3b389e1b21d None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:54.875716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f3e64-8497-4a52-b207-c3b389e1b21d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:54.877323 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 91/190] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:54 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:54.879314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f3e64-8497-4a52-b207-c3b389e1b21d None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:54.885112 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2cab-30fe-42cd-a253-b217a0b01e6b None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:54.919221 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5b76b-ce58-43b6-ab09-9eacb233b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:54.919845 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5b76b-ce58-43b6-ab09-9eacb233b197 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:54.920127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5b76b-ce58-43b6-ab09-9eacb233b197 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:54.920401 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5b76b-ce58-43b6-ab09-9eacb233b197 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:54.930296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5b76b-ce58-43b6-ab09-9eacb233b197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-1fe5b76b-ce58-43b6-ab09-9eacb233b197 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:54.935782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:54.936686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 100/191] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:20:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:54.939480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5b76b-ce58-43b6-ab09-9eacb233b197 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:54.976423 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f3e64-8497-4a52-b207-c3b389e1b21d None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:54.986255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:55.010786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecb6d0-3111-4662-82cc-3612d586ea87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:55.011385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecb6d0-3111-4662-82cc-3612d586ea87 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:55.011707 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecb6d0-3111-4662-82cc-3612d586ea87 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:55.011919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecb6d0-3111-4662-82cc-3612d586ea87 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:55.012573 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecb6d0-3111-4662-82cc-3612d586ea87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:55.012870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecb6d0-3111-4662-82cc-3612d586ea87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:55.014228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecb6d0-3111-4662-82cc-3612d586ea87 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:55.022772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 92/192] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:55.023569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecb6d0-3111-4662-82cc-3612d586ea87 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:55.041050 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5b76b-ce58-43b6-ab09-9eacb233b197 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:55.068765 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:55.074641 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01c009-ac4c-4678-91e4-3cedc4828999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:55.075250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c009-ac4c-4678-91e4-3cedc4828999 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:55.075528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c009-ac4c-4678-91e4-3cedc4828999 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:55.075805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c009-ac4c-4678-91e4-3cedc4828999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:55.076524 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01c009-ac4c-4678-91e4-3cedc4828999 None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695, user.id=c4192bd98cd24e289022a82073365dbc) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:55.076832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01c009-ac4c-4678-91e4-3cedc4828999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:55.078296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01c009-ac4c-4678-91e4-3cedc4828999 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:55.084743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 101/193] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:20:54 2022] GET /identity/v3/role_assignments?user.id=c4192bd98cd24e289022a82073365dbc&scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:55.085358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01c009-ac4c-4678-91e4-3cedc4828999 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:55.148119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecb6d0-3111-4662-82cc-3612d586ea87 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:55.188720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3917-3543-44fc-bc5b-417e86424b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:55.189717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3917-3543-44fc-bc5b-417e86424b23 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:55.190061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3917-3543-44fc-bc5b-417e86424b23 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:55.190342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3917-3543-44fc-bc5b-417e86424b23 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:55.191046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa3917-3543-44fc-bc5b-417e86424b23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:55.193114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa3917-3543-44fc-bc5b-417e86424b23 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:55.219233 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 93/194] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:20:55 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:20:55.220089 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3917-3543-44fc-bc5b-417e86424b23 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:55.233135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01c009-ac4c-4678-91e4-3cedc4828999 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:55.251492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:55.288068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315532c-2aad-430e-ac9e-81ee9dff3466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:55.289555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315532c-2aad-430e-ac9e-81ee9dff3466 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:55.289834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315532c-2aad-430e-ac9e-81ee9dff3466 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:55.290102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315532c-2aad-430e-ac9e-81ee9dff3466 None admin] PATH_INFO: `/v3/users/0dd44e420acf415d80d80217790d2581` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:55.291988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315532c-2aad-430e-ac9e-81ee9dff3466 None admin] RBAC: Authorizing `identity:get_user(user_id=0dd44e420acf415d80d80217790d2581)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:55.293986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315532c-2aad-430e-ac9e-81ee9dff3466 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:55.296026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 102/195] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:55 2022] GET /identity/v3/users/0dd44e420acf415d80d80217790d2581 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:55.297998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315532c-2aad-430e-ac9e-81ee9dff3466 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:55.363682 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:55.368565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3917-3543-44fc-bc5b-417e86424b23 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:55.417486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a2cdb-4c60-437d-8797-1942b7c19675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:55.418152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a2cdb-4c60-437d-8797-1942b7c19675 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:55.418426 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a2cdb-4c60-437d-8797-1942b7c19675 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:55.418721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a2cdb-4c60-437d-8797-1942b7c19675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:55.419454 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a2cdb-4c60-437d-8797-1942b7c19675 None admin] RBAC: Adding query filter params (role.id=49763e40fa024aaa9522c00cea577eca, scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695, user.id=fe727ca16f464f80a1fe24f7038c113c) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:55.419815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a2cdb-4c60-437d-8797-1942b7c19675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:55.421752 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a2cdb-4c60-437d-8797-1942b7c19675 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:55.428536 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 94/196] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:20:55 2022] GET /identity/v3/role_assignments?user.id=fe727ca16f464f80a1fe24f7038c113c&scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695&role.id=49763e40fa024aaa9522c00cea577eca => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:55.430897 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a2cdb-4c60-437d-8797-1942b7c19675 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:55.432498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315532c-2aad-430e-ac9e-81ee9dff3466 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:55.491426 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f8b4a-2eaf-40a0-b9f4-1f85b9e03788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:55.492068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f8b4a-2eaf-40a0-b9f4-1f85b9e03788 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:55.492401 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f8b4a-2eaf-40a0-b9f4-1f85b9e03788 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:55.493565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f8b4a-2eaf-40a0-b9f4-1f85b9e03788 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:55.493565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f8b4a-2eaf-40a0-b9f4-1f85b9e03788 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:55.493759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f8b4a-2eaf-40a0-b9f4-1f85b9e03788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:55.495234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f8b4a-2eaf-40a0-b9f4-1f85b9e03788 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:55.509263 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 103/197] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:20:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:55.509263 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f8b4a-2eaf-40a0-b9f4-1f85b9e03788 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:55.569225 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:55.571287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a2cdb-4c60-437d-8797-1942b7c19675 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:55.622744 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff84d7-3bd6-4349-b142-9f67e4ab4057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:55.623722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff84d7-3bd6-4349-b142-9f67e4ab4057 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:55.624207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff84d7-3bd6-4349-b142-9f67e4ab4057 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:55.624700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff84d7-3bd6-4349-b142-9f67e4ab4057 None admin] PATH_INFO: `/v3/users/8a3ad561dfc84ea98dbd339e164a6d71` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:55.644500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f8b4a-2eaf-40a0-b9f4-1f85b9e03788 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:55.647930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff84d7-3bd6-4349-b142-9f67e4ab4057 None admin] RBAC: Authorizing `identity:get_user(user_id=8a3ad561dfc84ea98dbd339e164a6d71)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:55.649481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff84d7-3bd6-4349-b142-9f67e4ab4057 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:55.651282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 95/198] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:55 2022] GET /identity/v3/users/8a3ad561dfc84ea98dbd339e164a6d71 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:55.652271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff84d7-3bd6-4349-b142-9f67e4ab4057 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:55.674869 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:55.688781 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2858c8-7a7b-417d-91e0-d49afef6f2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:55.690612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2858c8-7a7b-417d-91e0-d49afef6f2ed None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:55.691293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2858c8-7a7b-417d-91e0-d49afef6f2ed None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:55.691847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2858c8-7a7b-417d-91e0-d49afef6f2ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:55.773433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2858c8-7a7b-417d-91e0-d49afef6f2ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:55.775060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2858c8-7a7b-417d-91e0-d49afef6f2ed None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:55.787398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff84d7-3bd6-4349-b142-9f67e4ab4057 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:55.825146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ce84a-4026-4b0e-ba26-6905a5d5e60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:55.825733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ce84a-4026-4b0e-ba26-6905a5d5e60c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:55.826063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ce84a-4026-4b0e-ba26-6905a5d5e60c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:55.826456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ce84a-4026-4b0e-ba26-6905a5d5e60c None admin] PATH_INFO: `/v3/users/8a3ad561dfc84ea98dbd339e164a6d71` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:55.827736 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ce84a-4026-4b0e-ba26-6905a5d5e60c None admin] RBAC: Authorizing `identity:get_user(user_id=8a3ad561dfc84ea98dbd339e164a6d71)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:55.828876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:55.830291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ce84a-4026-4b0e-ba26-6905a5d5e60c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:55.832473 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 96/199] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:55 2022] GET /identity/v3/users/8a3ad561dfc84ea98dbd339e164a6d71 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:55.834112 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ce84a-4026-4b0e-ba26-6905a5d5e60c None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:55.908074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 104/200] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:20:55.909649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2858c8-7a7b-417d-91e0-d49afef6f2ed None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:55.947005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:55.963561 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ce84a-4026-4b0e-ba26-6905a5d5e60c None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:56.003354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dd886-76e7-4704-8a17-2c27401d2187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:56.004138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dd886-76e7-4704-8a17-2c27401d2187 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:56.004588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dd886-76e7-4704-8a17-2c27401d2187 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:56.004957 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dd886-76e7-4704-8a17-2c27401d2187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:56.039661 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2858c8-7a7b-417d-91e0-d49afef6f2ed None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:56.080142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dd886-76e7-4704-8a17-2c27401d2187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:56.081585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dd886-76e7-4704-8a17-2c27401d2187 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:56.086760 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916f3ab-7bf8-40b3-bbea-27641670e907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:56.087532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916f3ab-7bf8-40b3-bbea-27641670e907 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:56.087946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916f3ab-7bf8-40b3-bbea-27641670e907 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:56.088375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916f3ab-7bf8-40b3-bbea-27641670e907 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:56.102617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:56.178423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916f3ab-7bf8-40b3-bbea-27641670e907 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:56.180139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916f3ab-7bf8-40b3-bbea-27641670e907 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:56.192797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:56.211857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 97/201] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:20:56.213057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dd886-76e7-4704-8a17-2c27401d2187 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:56.308737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 105/202] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:20:56.309664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916f3ab-7bf8-40b3-bbea-27641670e907 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:56.335133 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dd886-76e7-4704-8a17-2c27401d2187 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:56.352578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:56.376299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca6194-d1c9-4112-9523-01907de979bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:56.377344 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca6194-d1c9-4112-9523-01907de979bc None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:56.377954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca6194-d1c9-4112-9523-01907de979bc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:56.378444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca6194-d1c9-4112-9523-01907de979bc None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:56.380017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca6194-d1c9-4112-9523-01907de979bc None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:56.382024 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca6194-d1c9-4112-9523-01907de979bc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:56.384137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 98/203] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:56 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:56.385205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca6194-d1c9-4112-9523-01907de979bc None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:56.415114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916f3ab-7bf8-40b3-bbea-27641670e907 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:56.454906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5c281-5555-4ade-92c7-f8318158a255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:56.455726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5c281-5555-4ade-92c7-f8318158a255 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:56.456002 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5c281-5555-4ade-92c7-f8318158a255 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:56.456266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5c281-5555-4ade-92c7-f8318158a255 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:56.457297 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:56.457405 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5c281-5555-4ade-92c7-f8318158a255 None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:56.459854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5c281-5555-4ade-92c7-f8318158a255 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:56.466560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 106/204] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:56 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:56.466560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5c281-5555-4ade-92c7-f8318158a255 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:56.520810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca6194-d1c9-4112-9523-01907de979bc None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:56.561197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492b1a6-e294-4eca-a8ad-8059010a6814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:56.562223 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492b1a6-e294-4eca-a8ad-8059010a6814 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:56.562861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492b1a6-e294-4eca-a8ad-8059010a6814 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:56.563432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492b1a6-e294-4eca-a8ad-8059010a6814 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:56.565118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492b1a6-e294-4eca-a8ad-8059010a6814 None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:56.567552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492b1a6-e294-4eca-a8ad-8059010a6814 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:56.569407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 99/205] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:56 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:56.570465 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492b1a6-e294-4eca-a8ad-8059010a6814 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:56.590139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5c281-5555-4ade-92c7-f8318158a255 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:56.602488 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:56.635844 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96132ce3-b489-4cd2-9c9c-176c9586e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:56.637301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96132ce3-b489-4cd2-9c9c-176c9586e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:56.637898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96132ce3-b489-4cd2-9c9c-176c9586e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:56.638349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96132ce3-b489-4cd2-9c9c-176c9586e1c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:56.639435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96132ce3-b489-4cd2-9c9c-176c9586e1c2 None admin] RBAC: Adding query filter params (role.id=1032cdf216bb48c38c1c98860da25d9f, scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695, user.id=0dd44e420acf415d80d80217790d2581) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:56.640208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96132ce3-b489-4cd2-9c9c-176c9586e1c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:56.641905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96132ce3-b489-4cd2-9c9c-176c9586e1c2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:56.650294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 107/206] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:20:56 2022] GET /identity/v3/role_assignments?user.id=0dd44e420acf415d80d80217790d2581&scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695&role.id=1032cdf216bb48c38c1c98860da25d9f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:56.651799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96132ce3-b489-4cd2-9c9c-176c9586e1c2 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:56.705311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492b1a6-e294-4eca-a8ad-8059010a6814 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:56.737458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:56.762674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5f1d0-ae63-49cc-9740-149db073be1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:56.763291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5f1d0-ae63-49cc-9740-149db073be1a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:56.763559 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5f1d0-ae63-49cc-9740-149db073be1a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:56.763832 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5f1d0-ae63-49cc-9740-149db073be1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:56.764779 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5f1d0-ae63-49cc-9740-149db073be1a None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e, user.id=8a3ad561dfc84ea98dbd339e164a6d71) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:56.765083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5f1d0-ae63-49cc-9740-149db073be1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:56.767082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5f1d0-ae63-49cc-9740-149db073be1a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:56.775776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 100/207] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:20:56 2022] GET /identity/v3/role_assignments?user.id=8a3ad561dfc84ea98dbd339e164a6d71&scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:56.803785 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96132ce3-b489-4cd2-9c9c-176c9586e1c2 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:56.865090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f906f1b-a545-44f1-9517-fb8614a93144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:56.865643 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f906f1b-a545-44f1-9517-fb8614a93144 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:56.865921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f906f1b-a545-44f1-9517-fb8614a93144 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:56.866192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f906f1b-a545-44f1-9517-fb8614a93144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:56.866987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f906f1b-a545-44f1-9517-fb8614a93144 None admin] RBAC: Adding query filter params (role.id=49763e40fa024aaa9522c00cea577eca, scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e, user.id=8a3ad561dfc84ea98dbd339e164a6d71) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:56.867294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f906f1b-a545-44f1-9517-fb8614a93144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:56.868819 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f906f1b-a545-44f1-9517-fb8614a93144 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:56.878097 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 108/208] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:20:56 2022] GET /identity/v3/role_assignments?user.id=8a3ad561dfc84ea98dbd339e164a6d71&scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e&role.id=49763e40fa024aaa9522c00cea577eca => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:57.734186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193d0b-2b9c-42af-968a-d18311302adc None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:57.734722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193d0b-2b9c-42af-968a-d18311302adc None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:57.734722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193d0b-2b9c-42af-968a-d18311302adc None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:57.736228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 101/209] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:57.741652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891130c5-fb1e-480a-817e-d2c3acebce22 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:57.742038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891130c5-fb1e-480a-817e-d2c3acebce22 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:57.742198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891130c5-fb1e-480a-817e-d2c3acebce22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:57.760673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-891130c5-fb1e-480a-817e-d2c3acebce22 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:57.761887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-891130c5-fb1e-480a-817e-d2c3acebce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:57.797915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:57.841814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 109/210] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:57.912067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787af26-a762-4d9d-8b14-1a2795c40d2b None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:57.912621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787af26-a762-4d9d-8b14-1a2795c40d2b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:57.913092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787af26-a762-4d9d-8b14-1a2795c40d2b None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:57.914600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 102/211] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:57.919798 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d706c45-2d9a-4868-8284-4c9691146667 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:57.920263 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d706c45-2d9a-4868-8284-4c9691146667 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:57.920702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d706c45-2d9a-4868-8284-4c9691146667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:57.939830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-5d706c45-2d9a-4868-8284-4c9691146667 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:57.941215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5d706c45-2d9a-4868-8284-4c9691146667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:58.008612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 110/212] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:58.114036 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787af26-a762-4d9d-8b14-1a2795c40d2b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:58.218520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787af26-a762-4d9d-8b14-1a2795c40d2b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:58.256725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad09bd1-34a2-4d97-8e40-9bf90c2285ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:58.257612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad09bd1-34a2-4d97-8e40-9bf90c2285ad None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:58.258096 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad09bd1-34a2-4d97-8e40-9bf90c2285ad None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:58.258597 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad09bd1-34a2-4d97-8e40-9bf90c2285ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:58.269103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad09bd1-34a2-4d97-8e40-9bf90c2285ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-9ad09bd1-34a2-4d97-8e40-9bf90c2285ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:58.275131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:58.275987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:58.276783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:58.276783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:58.276783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:58.276783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:58.276783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:58.276783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:58.276783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:58.276783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:58.276783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:58.276783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:58.276783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:20:58.276783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:20:58.278984 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 103/213] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:58.287523 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d706c45-2d9a-4868-8284-4c9691146667 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:58.321050 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad09bd1-34a2-4d97-8e40-9bf90c2285ad None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:58.386598 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:58.397352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:58.404230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d706c45-2d9a-4868-8284-4c9691146667 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:58.448249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98e0cb-6a56-48f7-af61-8d586688460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:58.449221 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e0cb-6a56-48f7-af61-8d586688460d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:58.449711 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e0cb-6a56-48f7-af61-8d586688460d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:58.449814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad09bd1-34a2-4d97-8e40-9bf90c2285ad None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:58.450284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e0cb-6a56-48f7-af61-8d586688460d None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:58.451484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98e0cb-6a56-48f7-af61-8d586688460d None admin] RBAC: Adding query filter params (name=member) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:58.452855 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98e0cb-6a56-48f7-af61-8d586688460d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:58.454545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98e0cb-6a56-48f7-af61-8d586688460d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:58.470253 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 111/214] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:20:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:58.471880 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98e0cb-6a56-48f7-af61-8d586688460d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:58.490640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc0417-42a2-4177-ae31-921303fce592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:58.491264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc0417-42a2-4177-ae31-921303fce592 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:58.491540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc0417-42a2-4177-ae31-921303fce592 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:58.491811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc0417-42a2-4177-ae31-921303fce592 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:58.493180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc0417-42a2-4177-ae31-921303fce592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:58.494750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc0417-42a2-4177-ae31-921303fce592 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:58.500643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 104/215] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:20:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:20:58.502643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc0417-42a2-4177-ae31-921303fce592 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:58.607273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98e0cb-6a56-48f7-af61-8d586688460d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:58.609586 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc0417-42a2-4177-ae31-921303fce592 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:58.632187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:58.650415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cfd51-56ae-41ad-85e6-269b5a6ca7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:58.651254 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cfd51-56ae-41ad-85e6-269b5a6ca7a0 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:58.651431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cfd51-56ae-41ad-85e6-269b5a6ca7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:58.651671 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cfd51-56ae-41ad-85e6-269b5a6ca7a0 None admin] PATH_INFO: `/v3/users/61ee94b85e734f42a4b42a64cd4ca485` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:58.656519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05144bf-1557-4561-93b7-461dfc61fd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:58.657350 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05144bf-1557-4561-93b7-461dfc61fd41 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:58.657842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05144bf-1557-4561-93b7-461dfc61fd41 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:58.658319 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05144bf-1557-4561-93b7-461dfc61fd41 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:58.659188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05144bf-1557-4561-93b7-461dfc61fd41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:58.660981 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05144bf-1557-4561-93b7-461dfc61fd41 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:58.665966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cfd51-56ae-41ad-85e6-269b5a6ca7a0 None admin] RBAC: Authorizing `identity:get_user(user_id=61ee94b85e734f42a4b42a64cd4ca485)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:58.667455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cfd51-56ae-41ad-85e6-269b5a6ca7a0 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:58.673615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 112/216] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:20:58 2022] GET /identity/v3/users/61ee94b85e734f42a4b42a64cd4ca485 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:58.677031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cfd51-56ae-41ad-85e6-269b5a6ca7a0 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:58.702540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 105/217] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:20:58 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:20:58.710848 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:58.811852 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cfd51-56ae-41ad-85e6-269b5a6ca7a0 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:58.851380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80eeadb-7fc6-4e14-a50d-d1595a212735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:58.852372 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80eeadb-7fc6-4e14-a50d-d1595a212735 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:58.852847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80eeadb-7fc6-4e14-a50d-d1595a212735 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:58.853309 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80eeadb-7fc6-4e14-a50d-d1595a212735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:58.931459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80eeadb-7fc6-4e14-a50d-d1595a212735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:58.933244 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80eeadb-7fc6-4e14-a50d-d1595a212735 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:58.951472 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:59.053157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 113/218] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:20:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:20:59.058444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05144bf-1557-4561-93b7-461dfc61fd41 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:59.122734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f835a-d469-45b9-b985-a61a3dc60e2e None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:59.123073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f835a-d469-45b9-b985-a61a3dc60e2e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:59.123293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f835a-d469-45b9-b985-a61a3dc60e2e None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:59.124791 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 114/219] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:59.125666 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ada36-7f41-4841-a923-e9e90fa39b58 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:59.125950 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ada36-7f41-4841-a923-e9e90fa39b58 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:59.126228 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ada36-7f41-4841-a923-e9e90fa39b58 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:59.127458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 115/220] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:20:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:20:59.131420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3fdb1-3db1-4871-a5a9-c83423d1628c None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:59.131701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3fdb1-3db1-4871-a5a9-c83423d1628c None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:59.131973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3fdb1-3db1-4871-a5a9-c83423d1628c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:59.153947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b3e3fdb1-3db1-4871-a5a9-c83423d1628c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:59.155175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b3e3fdb1-3db1-4871-a5a9-c83423d1628c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:59.189390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05144bf-1557-4561-93b7-461dfc61fd41 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:59.229849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b82b6b-64cb-4595-bd9a-e36fd749a1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:59.230885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b82b6b-64cb-4595-bd9a-e36fd749a1ea None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:59.231364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b82b6b-64cb-4595-bd9a-e36fd749a1ea None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:59.232063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b82b6b-64cb-4595-bd9a-e36fd749a1ea None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:59.234068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b82b6b-64cb-4595-bd9a-e36fd749a1ea None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:59.235855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b82b6b-64cb-4595-bd9a-e36fd749a1ea None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:59.238081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 106/221] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:20:59 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:59.240022 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196534e1-3234-4bfa-8ae7-c7080edac5a4 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:59.240544 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196534e1-3234-4bfa-8ae7-c7080edac5a4 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:59.240993 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196534e1-3234-4bfa-8ae7-c7080edac5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:59.242595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 116/222] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:59.244350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3fdb1-3db1-4871-a5a9-c83423d1628c None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:59.263974 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-196534e1-3234-4bfa-8ae7-c7080edac5a4 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:20:59.265404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-196534e1-3234-4bfa-8ae7-c7080edac5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:20:59.306834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:59.309917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:59.359986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 107/223] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:20:59.397776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3fdb1-3db1-4871-a5a9-c83423d1628c None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:59.450036 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8f20f-7e8c-40b8-988a-8ecc0a7b103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:59.450955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8f20f-7e8c-40b8-988a-8ecc0a7b103d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:59.451411 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8f20f-7e8c-40b8-988a-8ecc0a7b103d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:59.451857 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8f20f-7e8c-40b8-988a-8ecc0a7b103d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:59.452760 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8f20f-7e8c-40b8-988a-8ecc0a7b103d None admin] RBAC: Adding query filter params (role.id=d912a7e672bb441099f4ef85d61e7c46, scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e, user.id=61ee94b85e734f42a4b42a64cd4ca485) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:59.453264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8f20f-7e8c-40b8-988a-8ecc0a7b103d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:59.454934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8f20f-7e8c-40b8-988a-8ecc0a7b103d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:20:59.466725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 117/224] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:20:59 2022] GET /identity/v3/role_assignments?user.id=61ee94b85e734f42a4b42a64cd4ca485&scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e&role.id=d912a7e672bb441099f4ef85d61e7c46 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:20:59.535565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196534e1-3234-4bfa-8ae7-c7080edac5a4 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:59.676170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196534e1-3234-4bfa-8ae7-c7080edac5a4 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:59.717770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6698c4-9ee9-459a-af46-669fa32cab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:59.718364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6698c4-9ee9-459a-af46-669fa32cab88 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:59.718694 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6698c4-9ee9-459a-af46-669fa32cab88 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:59.718969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6698c4-9ee9-459a-af46-669fa32cab88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:59.729807 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6698c4-9ee9-459a-af46-669fa32cab88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-4b6698c4-9ee9-459a-af46-669fa32cab88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:59.734756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:59.735616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:59.736412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:59.736412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:59.736412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:59.736412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:59.736412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:59.736412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:59.736412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:59.736412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:59.736412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:59.736412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:59.736412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:20:59.736412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:20:59.736412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 108/225] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:20:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:59.741859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8f20f-7e8c-40b8-988a-8ecc0a7b103d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:59.766067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6698c4-9ee9-459a-af46-669fa32cab88 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:59.798044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:59.871814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6698c4-9ee9-459a-af46-669fa32cab88 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:59.914773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d853a1-9ec5-4d43-a5d8-93915c33661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:59.915407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d853a1-9ec5-4d43-a5d8-93915c33661e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:59.915680 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d853a1-9ec5-4d43-a5d8-93915c33661e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:59.915943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d853a1-9ec5-4d43-a5d8-93915c33661e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:59.921104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8f20f-7e8c-40b8-988a-8ecc0a7b103d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:20:59.936197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:20:59.947944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d853a1-9ec5-4d43-a5d8-93915c33661e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-b8d853a1-9ec5-4d43-a5d8-93915c33661e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:20:59.953174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:20:59.954047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:20:59.955317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:20:59.955317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:20:59.955317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:20:59.955317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:20:59.955317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:20:59.955317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:20:59.955317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:20:59.955317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:20:59.955317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:20:59.955317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:20:59.955317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:20:59.955317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:20:59.964254 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 109/226] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:20:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:20:59.974634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d853a1-9ec5-4d43-a5d8-93915c33661e None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:20:59.987224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722fed0-05d3-4840-bcbe-5f53ba1de9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:20:59.987849 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722fed0-05d3-4840-bcbe-5f53ba1de9e7 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:20:59.988127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722fed0-05d3-4840-bcbe-5f53ba1de9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:20:59.988400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722fed0-05d3-4840-bcbe-5f53ba1de9e7 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:20:59.989699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722fed0-05d3-4840-bcbe-5f53ba1de9e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:20:59.989998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722fed0-05d3-4840-bcbe-5f53ba1de9e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:20:59.991420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722fed0-05d3-4840-bcbe-5f53ba1de9e7 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:00.007362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 118/227] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:20:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:00.013049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722fed0-05d3-4840-bcbe-5f53ba1de9e7 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:00.122850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:00.141814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d853a1-9ec5-4d43-a5d8-93915c33661e None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:00.196303 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722fed0-05d3-4840-bcbe-5f53ba1de9e7 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:00.206023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60517e9-02d2-4d27-9167-387f10d85df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:00.206871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60517e9-02d2-4d27-9167-387f10d85df9 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:00.207875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60517e9-02d2-4d27-9167-387f10d85df9 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:00.209926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60517e9-02d2-4d27-9167-387f10d85df9 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:00.210788 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60517e9-02d2-4d27-9167-387f10d85df9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:00.211236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60517e9-02d2-4d27-9167-387f10d85df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:00.214470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60517e9-02d2-4d27-9167-387f10d85df9 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:00.233827 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 110/228] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:20:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:00.240904 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60517e9-02d2-4d27-9167-387f10d85df9 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:00.265124 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d43529-adb7-4570-b3bb-2ce75d3039cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:00.266033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d43529-adb7-4570-b3bb-2ce75d3039cc None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:00.267295 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d43529-adb7-4570-b3bb-2ce75d3039cc None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:00.267577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d43529-adb7-4570-b3bb-2ce75d3039cc None admin] PATH_INFO: `/v3/users/8a3ad561dfc84ea98dbd339e164a6d71` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:00.269437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d43529-adb7-4570-b3bb-2ce75d3039cc None admin] RBAC: Authorizing `identity:get_user(user_id=8a3ad561dfc84ea98dbd339e164a6d71)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:00.271587 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d43529-adb7-4570-b3bb-2ce75d3039cc None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:00.273355 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 119/229] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:00 2022] GET /identity/v3/users/8a3ad561dfc84ea98dbd339e164a6d71 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:00.280108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d43529-adb7-4570-b3bb-2ce75d3039cc None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:00.358890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:00.423012 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60517e9-02d2-4d27-9167-387f10d85df9 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:00.470464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d43529-adb7-4570-b3bb-2ce75d3039cc None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:00.488418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee57ca5-dccd-44ad-b5d0-b0ed187a48e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:00.489625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee57ca5-dccd-44ad-b5d0-b0ed187a48e3 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:00.489908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee57ca5-dccd-44ad-b5d0-b0ed187a48e3 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:00.490179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee57ca5-dccd-44ad-b5d0-b0ed187a48e3 None admin] PATH_INFO: `/v3/users/8a3ad561dfc84ea98dbd339e164a6d71` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:00.492027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee57ca5-dccd-44ad-b5d0-b0ed187a48e3 None admin] RBAC: Authorizing `identity:get_user(user_id=8a3ad561dfc84ea98dbd339e164a6d71)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:00.493498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee57ca5-dccd-44ad-b5d0-b0ed187a48e3 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:00.497040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 111/230] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:00 2022] GET /identity/v3/users/8a3ad561dfc84ea98dbd339e164a6d71 => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:00.501273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee57ca5-dccd-44ad-b5d0-b0ed187a48e3 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:00.534181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fea0e-e143-4a5b-8c62-84ba667b3ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:00.535064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fea0e-e143-4a5b-8c62-84ba667b3ee4 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:00.536775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fea0e-e143-4a5b-8c62-84ba667b3ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:00.537077 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fea0e-e143-4a5b-8c62-84ba667b3ee4 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:00.540285 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fea0e-e143-4a5b-8c62-84ba667b3ee4 None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:00.542348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:00.543232 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fea0e-e143-4a5b-8c62-84ba667b3ee4 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:00.546080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 120/231] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:00 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:00.552514 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fea0e-e143-4a5b-8c62-84ba667b3ee4 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:00.694068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee57ca5-dccd-44ad-b5d0-b0ed187a48e3 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:00.741972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fea0e-e143-4a5b-8c62-84ba667b3ee4 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:00.766534 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:00.766714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb33210-fb7c-4893-a9f2-9cbf4239a02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:00.766960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb33210-fb7c-4893-a9f2-9cbf4239a02c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:00.770462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb33210-fb7c-4893-a9f2-9cbf4239a02c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:00.770462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb33210-fb7c-4893-a9f2-9cbf4239a02c None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:00.771612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb33210-fb7c-4893-a9f2-9cbf4239a02c None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:00.772517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb33210-fb7c-4893-a9f2-9cbf4239a02c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:00.782539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 112/232] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:00 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:00.782539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb33210-fb7c-4893-a9f2-9cbf4239a02c None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:00.821720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c17f1-6aad-4744-a64a-4af8cfc6e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:00.825171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c17f1-6aad-4744-a64a-4af8cfc6e94c None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:00.825452 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c17f1-6aad-4744-a64a-4af8cfc6e94c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:00.825731 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c17f1-6aad-4744-a64a-4af8cfc6e94c None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e/users/8a3ad561dfc84ea98dbd339e164a6d71/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:00.828926 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c17f1-6aad-4744-a64a-4af8cfc6e94c None admin] RBAC: Authorizing `identity:create_grant(project_id=537e7cd0d44a4708ada4ac38cc6ef13e, user_id=8a3ad561dfc84ea98dbd339e164a6d71, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:00.830410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c17f1-6aad-4744-a64a-4af8cfc6e94c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:00.857250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 121/233] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:21:00 2022] PUT /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e/users/8a3ad561dfc84ea98dbd339e164a6d71/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:00.915708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:00.930808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb33210-fb7c-4893-a9f2-9cbf4239a02c None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:00.979888 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66179699-c389-49f8-92f7-3d02aebb1188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:00.980616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66179699-c389-49f8-92f7-3d02aebb1188 None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:00.980901 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66179699-c389-49f8-92f7-3d02aebb1188 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:00.981175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66179699-c389-49f8-92f7-3d02aebb1188 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e/users/8a3ad561dfc84ea98dbd339e164a6d71/roles/49763e40fa024aaa9522c00cea577eca` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:00.983608 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66179699-c389-49f8-92f7-3d02aebb1188 None admin] RBAC: Authorizing `identity:create_grant(project_id=537e7cd0d44a4708ada4ac38cc6ef13e, user_id=8a3ad561dfc84ea98dbd339e164a6d71, role_id=49763e40fa024aaa9522c00cea577eca)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:00.985071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66179699-c389-49f8-92f7-3d02aebb1188 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:01.010826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 113/234] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:21:00 2022] PUT /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e/users/8a3ad561dfc84ea98dbd339e164a6d71/roles/49763e40fa024aaa9522c00cea577eca => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:01.414429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac4656-3695-4d29-9b7f-3cbec9ff9ede None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:01.415461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac4656-3695-4d29-9b7f-3cbec9ff9ede None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:01.415944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac4656-3695-4d29-9b7f-3cbec9ff9ede None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:01.417521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 122/235] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:01.423186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc061d-17b4-44c2-82b4-c69dad757384 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:01.424011 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc061d-17b4-44c2-82b4-c69dad757384 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:01.424498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc061d-17b4-44c2-82b4-c69dad757384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:01.444975 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-9bbc061d-17b4-44c2-82b4-c69dad757384 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:01.446487 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9bbc061d-17b4-44c2-82b4-c69dad757384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:01.540041 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 114/236] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:01.713560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f1e21-4ead-49ca-9fb0-b41d05b2ced3 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:01.714170 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f1e21-4ead-49ca-9fb0-b41d05b2ced3 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:01.714666 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f1e21-4ead-49ca-9fb0-b41d05b2ced3 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:01.716300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 123/237] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:01.728248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5ae9-ded8-447e-aea9-403a008edc69 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:01.728770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5ae9-ded8-447e-aea9-403a008edc69 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:01.729251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5ae9-ded8-447e-aea9-403a008edc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:01.755499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-158c5ae9-ded8-447e-aea9-403a008edc69 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:01.757067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-158c5ae9-ded8-447e-aea9-403a008edc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:01.836340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 115/238] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:01.887807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f1e21-4ead-49ca-9fb0-b41d05b2ced3 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:01.998836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f1e21-4ead-49ca-9fb0-b41d05b2ced3 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:02.034179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185261e1-90c6-4331-ad1d-b1abc9795903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:02.035279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185261e1-90c6-4331-ad1d-b1abc9795903 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:02.035755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185261e1-90c6-4331-ad1d-b1abc9795903 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:02.036238 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185261e1-90c6-4331-ad1d-b1abc9795903 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:02.048477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185261e1-90c6-4331-ad1d-b1abc9795903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:02.051777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f507497-abec-41b6-93a6-4d06152eea96 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:02.052319 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f507497-abec-41b6-93a6-4d06152eea96 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:02.052804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f507497-abec-41b6-93a6-4d06152eea96 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:02.054329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 116/239] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-185261e1-90c6-4331-ad1d-b1abc9795903 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:02.058095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:02.058983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:02.059799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:02.059799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:02.059799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:02.059799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:02.059799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:02.059799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:02.059799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:02.059799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:02.059799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:02.059799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:02.059799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:21:02.059799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:02.060387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f762b-0ba2-4ff7-9e75-125c92ae0f27 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:02.060387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f762b-0ba2-4ff7-9e75-125c92ae0f27 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:02.060387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f762b-0ba2-4ff7-9e75-125c92ae0f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:02.062471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 124/240] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:02.072794 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185261e1-90c6-4331-ad1d-b1abc9795903 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:02.097460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-d82f762b-0ba2-4ff7-9e75-125c92ae0f27 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:02.098819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d82f762b-0ba2-4ff7-9e75-125c92ae0f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:02.104534 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:02.111914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:02.217638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 117/241] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:02.218775 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f762b-0ba2-4ff7-9e75-125c92ae0f27 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:02.229713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185261e1-90c6-4331-ad1d-b1abc9795903 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:02.288654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c19372-eed4-435e-a5fe-f9e1863248b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:02.289602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c19372-eed4-435e-a5fe-f9e1863248b7 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:02.290161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c19372-eed4-435e-a5fe-f9e1863248b7 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:02.290665 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c19372-eed4-435e-a5fe-f9e1863248b7 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:02.291569 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c19372-eed4-435e-a5fe-f9e1863248b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:02.292061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c19372-eed4-435e-a5fe-f9e1863248b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:02.293671 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c19372-eed4-435e-a5fe-f9e1863248b7 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:02.313551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 125/242] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:02.324198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c19372-eed4-435e-a5fe-f9e1863248b7 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:02.341833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f762b-0ba2-4ff7-9e75-125c92ae0f27 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:02.380473 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85de6f-bd2d-4824-8fb1-23ebe291e386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:02.381238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85de6f-bd2d-4824-8fb1-23ebe291e386 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:02.381519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85de6f-bd2d-4824-8fb1-23ebe291e386 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:02.381790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85de6f-bd2d-4824-8fb1-23ebe291e386 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:02.383082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85de6f-bd2d-4824-8fb1-23ebe291e386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:02.384897 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85de6f-bd2d-4824-8fb1-23ebe291e386 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:02.386789 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 118/243] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:02.392083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85de6f-bd2d-4824-8fb1-23ebe291e386 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:02.401579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:02.508614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:02.513729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85de6f-bd2d-4824-8fb1-23ebe291e386 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:02.530125 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c19372-eed4-435e-a5fe-f9e1863248b7 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:02.559599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1c677-53db-4e9a-86f2-3890814c58ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:02.560212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1c677-53db-4e9a-86f2-3890814c58ae None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:02.560492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1c677-53db-4e9a-86f2-3890814c58ae None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:02.560762 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1c677-53db-4e9a-86f2-3890814c58ae None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:02.561418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1c677-53db-4e9a-86f2-3890814c58ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:02.563755 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1c677-53db-4e9a-86f2-3890814c58ae None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:02.597342 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb036255-0bf0-4907-8aa0-63f440818046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:02.598033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb036255-0bf0-4907-8aa0-63f440818046 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:02.598309 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb036255-0bf0-4907-8aa0-63f440818046 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:02.605759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb036255-0bf0-4907-8aa0-63f440818046 None admin] PATH_INFO: `/v3/users/e40eed4d7b734c8e8ec1dd13c90a18fb` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:02.606666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 119/244] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:21:02 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:21:02.625166 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb036255-0bf0-4907-8aa0-63f440818046 None admin] RBAC: Authorizing `identity:get_user(user_id=e40eed4d7b734c8e8ec1dd13c90a18fb)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:02.626789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb036255-0bf0-4907-8aa0-63f440818046 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:02.628843 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 126/245] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:02 2022] GET /identity/v3/users/e40eed4d7b734c8e8ec1dd13c90a18fb => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:02.635202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1c677-53db-4e9a-86f2-3890814c58ae None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:02.643586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb036255-0bf0-4907-8aa0-63f440818046 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:02.712061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:02.759040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1c677-53db-4e9a-86f2-3890814c58ae None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:02.800171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283f400-ef8a-4ec5-99c2-315382962247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:02.801122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283f400-ef8a-4ec5-99c2-315382962247 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:02.801611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283f400-ef8a-4ec5-99c2-315382962247 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:02.802162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283f400-ef8a-4ec5-99c2-315382962247 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:02.860681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb036255-0bf0-4907-8aa0-63f440818046 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:02.880845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283f400-ef8a-4ec5-99c2-315382962247 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:02.882782 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283f400-ef8a-4ec5-99c2-315382962247 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:02.922363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76992eb9-35c0-48c4-a9b9-c0149ea2eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:02.923321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76992eb9-35c0-48c4-a9b9-c0149ea2eb38 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:02.923802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76992eb9-35c0-48c4-a9b9-c0149ea2eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:02.924252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76992eb9-35c0-48c4-a9b9-c0149ea2eb38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:02.937291 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76992eb9-35c0-48c4-a9b9-c0149ea2eb38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-76992eb9-35c0-48c4-a9b9-c0149ea2eb38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:02.943400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:02.944251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:02.945060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:02.945060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:02.945060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:02.945060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:02.945060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:02.945060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:02.945060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:02.945060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:02.945060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:02.945060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:02.945060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:02.945060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:02.947992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 127/246] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:02.953744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76992eb9-35c0-48c4-a9b9-c0149ea2eb38 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:02.960155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:02.968209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:03.008791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 120/247] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:03.014294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283f400-ef8a-4ec5-99c2-315382962247 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:03.084422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76992eb9-35c0-48c4-a9b9-c0149ea2eb38 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:03.133926 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a0767-4f5d-4aa8-9e9a-de3eb5d21cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:03.134592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a0767-4f5d-4aa8-9e9a-de3eb5d21cca None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:03.134879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a0767-4f5d-4aa8-9e9a-de3eb5d21cca None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:03.135152 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a0767-4f5d-4aa8-9e9a-de3eb5d21cca None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:03.136096 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a0767-4f5d-4aa8-9e9a-de3eb5d21cca None admin] RBAC: Adding query filter params (name=member) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:03.136204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a0767-4f5d-4aa8-9e9a-de3eb5d21cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:03.137620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a0767-4f5d-4aa8-9e9a-de3eb5d21cca None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:03.139609 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283f400-ef8a-4ec5-99c2-315382962247 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:03.148078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 128/248] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:03.154486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a0767-4f5d-4aa8-9e9a-de3eb5d21cca None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:03.189377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8984055-5dad-4fd1-b8bf-059f862caeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:03.190014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8984055-5dad-4fd1-b8bf-059f862caeab None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:03.190289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8984055-5dad-4fd1-b8bf-059f862caeab None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:03.190582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8984055-5dad-4fd1-b8bf-059f862caeab None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:03.192668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8984055-5dad-4fd1-b8bf-059f862caeab None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:03.194541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8984055-5dad-4fd1-b8bf-059f862caeab None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:03.196593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 121/249] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:03 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:03.202568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8984055-5dad-4fd1-b8bf-059f862caeab None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:03.255665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:03.281978 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:03.348362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a0767-4f5d-4aa8-9e9a-de3eb5d21cca None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:03.387118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8984055-5dad-4fd1-b8bf-059f862caeab None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:03.412055 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3ac17-1d8e-4d66-8121-fc14bf948543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:03.412697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ac17-1d8e-4d66-8121-fc14bf948543 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:03.412974 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ac17-1d8e-4d66-8121-fc14bf948543 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:03.413242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ac17-1d8e-4d66-8121-fc14bf948543 None admin] PATH_INFO: `/v3/users/61ee94b85e734f42a4b42a64cd4ca485` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:03.419270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3ac17-1d8e-4d66-8121-fc14bf948543 None admin] RBAC: Authorizing `identity:get_user(user_id=61ee94b85e734f42a4b42a64cd4ca485)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:03.420758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3ac17-1d8e-4d66-8121-fc14bf948543 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:03.423894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 129/250] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:03 2022] GET /identity/v3/users/61ee94b85e734f42a4b42a64cd4ca485 => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:03.430737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3ac17-1d8e-4d66-8121-fc14bf948543 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:03.458766 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374cc64-caa2-446b-b5b6-47cdde69402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:03.459839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374cc64-caa2-446b-b5b6-47cdde69402d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:03.459839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374cc64-caa2-446b-b5b6-47cdde69402d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:03.460015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374cc64-caa2-446b-b5b6-47cdde69402d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:03.460931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374cc64-caa2-446b-b5b6-47cdde69402d None admin] RBAC: Adding query filter params (role.id=1032cdf216bb48c38c1c98860da25d9f, scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e, user.id=e40eed4d7b734c8e8ec1dd13c90a18fb) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:03.462528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374cc64-caa2-446b-b5b6-47cdde69402d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:03.463154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374cc64-caa2-446b-b5b6-47cdde69402d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:03.475593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 122/251] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:03 2022] GET /identity/v3/role_assignments?user.id=e40eed4d7b734c8e8ec1dd13c90a18fb&scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e&role.id=1032cdf216bb48c38c1c98860da25d9f => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:03.641420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3ac17-1d8e-4d66-8121-fc14bf948543 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:03.720089 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664fc36-a42d-42f5-b379-4847d68c75f4 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:03.720616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664fc36-a42d-42f5-b379-4847d68c75f4 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:03.720616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664fc36-a42d-42f5-b379-4847d68c75f4 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:03.722014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 123/252] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:03.725948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e788c-95d4-4038-8fb8-dde39dc8236e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:03.728204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e788c-95d4-4038-8fb8-dde39dc8236e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:03.730295 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e788c-95d4-4038-8fb8-dde39dc8236e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:03.731380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e788c-95d4-4038-8fb8-dde39dc8236e None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:03.731993 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35055f-6508-4090-bf89-99404b0b89aa None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:03.732279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35055f-6508-4090-bf89-99404b0b89aa None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:03.732556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35055f-6508-4090-bf89-99404b0b89aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:03.735639 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e788c-95d4-4038-8fb8-dde39dc8236e None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:03.738933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e788c-95d4-4038-8fb8-dde39dc8236e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:03.744259 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 130/253] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:03 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:03.753394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e788c-95d4-4038-8fb8-dde39dc8236e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:03.790955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:03.803127 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-4e35055f-6508-4090-bf89-99404b0b89aa None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:03.806538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4e35055f-6508-4090-bf89-99404b0b89aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:03.936487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e788c-95d4-4038-8fb8-dde39dc8236e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:03.994523 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 124/254] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:21:03.998375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3937bd-9a08-4d06-823a-ddfe89a7b8cf None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:03.998685 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3937bd-9a08-4d06-823a-ddfe89a7b8cf None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:03.998953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3937bd-9a08-4d06-823a-ddfe89a7b8cf None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:04.007741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 125/255] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:04.008998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5ed5a-4cef-4dec-b6e2-8296fa968f94 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:04.009272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5ed5a-4cef-4dec-b6e2-8296fa968f94 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:04.009537 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5ed5a-4cef-4dec-b6e2-8296fa968f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:04.014834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d2bfb-6987-49e3-8529-afa44f01eb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:04.015550 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d2bfb-6987-49e3-8529-afa44f01eb6b None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:04.015829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d2bfb-6987-49e3-8529-afa44f01eb6b None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:04.016098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d2bfb-6987-49e3-8529-afa44f01eb6b None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e/users/61ee94b85e734f42a4b42a64cd4ca485/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:04.019079 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d2bfb-6987-49e3-8529-afa44f01eb6b None admin] RBAC: Authorizing `identity:create_grant(project_id=537e7cd0d44a4708ada4ac38cc6ef13e, user_id=61ee94b85e734f42a4b42a64cd4ca485, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:04.021073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d2bfb-6987-49e3-8529-afa44f01eb6b None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:04.041271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-d3d5ed5a-4cef-4dec-b6e2-8296fa968f94 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:04.042596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d3d5ed5a-4cef-4dec-b6e2-8296fa968f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:04.052103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 131/256] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:21:03 2022] PUT /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e/users/61ee94b85e734f42a4b42a64cd4ca485/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:21:04.123080 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:04.214766 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 126/257] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:04.534048 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d2bfb-6987-49e3-8529-afa44f01eb6b None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:04.553616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5ed5a-4cef-4dec-b6e2-8296fa968f94 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:04.612873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:04.654722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d2bfb-6987-49e3-8529-afa44f01eb6b None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:04.699674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c8447-e011-4812-a57c-e7bd447f28b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:04.700724 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c8447-e011-4812-a57c-e7bd447f28b7 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:04.703551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c8447-e011-4812-a57c-e7bd447f28b7 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:04.704024 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c8447-e011-4812-a57c-e7bd447f28b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:04.726130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c8447-e011-4812-a57c-e7bd447f28b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-053c8447-e011-4812-a57c-e7bd447f28b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:04.733803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:04.734700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:04.735494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:04.735494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:04.735494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:04.735494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:04.735494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:04.735494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:04.735494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:04.735494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:04.735494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:04.735494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:04.735494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:21:04.735494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:04.744087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 132/258] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:21:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:04.751609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c8447-e011-4812-a57c-e7bd447f28b7 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:04.766362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5ed5a-4cef-4dec-b6e2-8296fa968f94 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:04.822640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71bbc3-9e8c-409d-be90-b35468db5ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:04.824235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71bbc3-9e8c-409d-be90-b35468db5ec6 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:04.824712 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71bbc3-9e8c-409d-be90-b35468db5ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:04.825175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71bbc3-9e8c-409d-be90-b35468db5ec6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:04.848635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71bbc3-9e8c-409d-be90-b35468db5ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-8a71bbc3-9e8c-409d-be90-b35468db5ec6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:04.854147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:04.855042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:04.855905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:04.855905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:04.855905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:04.855905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:04.855905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:04.855905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:04.855905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:04.855905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:04.855905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:04.855905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:04.855905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:04.855905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:04.864908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 127/259] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:21:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:04.870827 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71bbc3-9e8c-409d-be90-b35468db5ec6 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:04.926882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:04.995216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c8447-e011-4812-a57c-e7bd447f28b7 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:05.020771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71bbc3-9e8c-409d-be90-b35468db5ec6 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:05.021288 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:05.031371 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf846b7-ac7f-45e1-b9f4-f02f06e813b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:05.031987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf846b7-ac7f-45e1-b9f4-f02f06e813b8 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:05.032261 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf846b7-ac7f-45e1-b9f4-f02f06e813b8 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:05.032536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf846b7-ac7f-45e1-b9f4-f02f06e813b8 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:05.033199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf846b7-ac7f-45e1-b9f4-f02f06e813b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:05.033498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf846b7-ac7f-45e1-b9f4-f02f06e813b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:05.038541 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf846b7-ac7f-45e1-b9f4-f02f06e813b8 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:05.044250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 133/260] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:05.054533 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf846b7-ac7f-45e1-b9f4-f02f06e813b8 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:05.077864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e3ae9-3a3a-40f6-9739-3e238ad9f5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:05.078828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3ae9-3a3a-40f6-9739-3e238ad9f5ea None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:05.079456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3ae9-3a3a-40f6-9739-3e238ad9f5ea None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:05.079918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3ae9-3a3a-40f6-9739-3e238ad9f5ea None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:05.080913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e3ae9-3a3a-40f6-9739-3e238ad9f5ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:05.081430 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e3ae9-3a3a-40f6-9739-3e238ad9f5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:05.083753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e3ae9-3a3a-40f6-9739-3e238ad9f5ea None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:05.098174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 128/261] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:05.104227 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e3ae9-3a3a-40f6-9739-3e238ad9f5ea None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:05.156129 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf846b7-ac7f-45e1-b9f4-f02f06e813b8 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:05.192690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722968e-9ced-4730-946c-86cf1d14eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:05.193326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722968e-9ced-4730-946c-86cf1d14eb55 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:05.193601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722968e-9ced-4730-946c-86cf1d14eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:05.193868 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722968e-9ced-4730-946c-86cf1d14eb55 None admin] PATH_INFO: `/v3/users/8a3ad561dfc84ea98dbd339e164a6d71` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:05.195044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722968e-9ced-4730-946c-86cf1d14eb55 None admin] RBAC: Authorizing `identity:get_user(user_id=8a3ad561dfc84ea98dbd339e164a6d71)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:05.196512 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722968e-9ced-4730-946c-86cf1d14eb55 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:05.198393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 134/262] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:05 2022] GET /identity/v3/users/8a3ad561dfc84ea98dbd339e164a6d71 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:05.203737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722968e-9ced-4730-946c-86cf1d14eb55 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:05.266906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:05.310858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722968e-9ced-4730-946c-86cf1d14eb55 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:05.336699 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:05.351155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783cc64-5812-412e-8611-a8dd7669ce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:05.351762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783cc64-5812-412e-8611-a8dd7669ce71 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:05.352039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783cc64-5812-412e-8611-a8dd7669ce71 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:05.352308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783cc64-5812-412e-8611-a8dd7669ce71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:05.410868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e3ae9-3a3a-40f6-9739-3e238ad9f5ea None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:05.423649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783cc64-5812-412e-8611-a8dd7669ce71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:05.425187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783cc64-5812-412e-8611-a8dd7669ce71 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:05.486867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:05.499203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b39c-a075-4032-bf20-cf723f4be5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:05.499879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b39c-a075-4032-bf20-cf723f4be5d5 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:05.500169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b39c-a075-4032-bf20-cf723f4be5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:05.500456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b39c-a075-4032-bf20-cf723f4be5d5 None admin] PATH_INFO: `/v3/users/8a3ad561dfc84ea98dbd339e164a6d71` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:05.507229 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878b39c-a075-4032-bf20-cf723f4be5d5 None admin] RBAC: Authorizing `identity:get_user(user_id=8a3ad561dfc84ea98dbd339e164a6d71)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:05.508696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878b39c-a075-4032-bf20-cf723f4be5d5 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:05.510660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 129/263] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:05 2022] GET /identity/v3/users/8a3ad561dfc84ea98dbd339e164a6d71 => generated 283 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:05.519443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b39c-a075-4032-bf20-cf723f4be5d5 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:05.533672 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 135/264] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 05:21:05.539637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783cc64-5812-412e-8611-a8dd7669ce71 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:05.646607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783cc64-5812-412e-8611-a8dd7669ce71 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:05.685021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8118e1-c663-43b9-b7e4-1ba9b73030b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:05.685628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8118e1-c663-43b9-b7e4-1ba9b73030b9 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:05.685911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8118e1-c663-43b9-b7e4-1ba9b73030b9 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:05.686185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8118e1-c663-43b9-b7e4-1ba9b73030b9 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:05.687493 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8118e1-c663-43b9-b7e4-1ba9b73030b9 None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:05.689214 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8118e1-c663-43b9-b7e4-1ba9b73030b9 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:05.691020 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 136/265] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:05 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:05.697290 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8118e1-c663-43b9-b7e4-1ba9b73030b9 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:05.725671 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:05.807107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8118e1-c663-43b9-b7e4-1ba9b73030b9 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:05.829529 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b39c-a075-4032-bf20-cf723f4be5d5 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:05.841805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8545558-a4c4-4cc9-83fd-66f9ce9419d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:05.842439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8545558-a4c4-4cc9-83fd-66f9ce9419d0 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:05.842743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8545558-a4c4-4cc9-83fd-66f9ce9419d0 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:05.843017 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8545558-a4c4-4cc9-83fd-66f9ce9419d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:05.843742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8545558-a4c4-4cc9-83fd-66f9ce9419d0 None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e, user.id=8a3ad561dfc84ea98dbd339e164a6d71) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:05.844049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8545558-a4c4-4cc9-83fd-66f9ce9419d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:05.845509 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8545558-a4c4-4cc9-83fd-66f9ce9419d0 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:05.852334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 137/266] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:05 2022] GET /identity/v3/role_assignments?user.id=8a3ad561dfc84ea98dbd339e164a6d71&scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:05.914367 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b71500-7a49-4092-8aea-8ff898600b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:05.914948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b71500-7a49-4092-8aea-8ff898600b36 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:05.915231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b71500-7a49-4092-8aea-8ff898600b36 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:05.915506 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b71500-7a49-4092-8aea-8ff898600b36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:05.942415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:06.026724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b71500-7a49-4092-8aea-8ff898600b36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:06.028240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b71500-7a49-4092-8aea-8ff898600b36 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:06.148165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 130/267] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:06.154074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8545558-a4c4-4cc9-83fd-66f9ce9419d0 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:06.304888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:06.319651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8545558-a4c4-4cc9-83fd-66f9ce9419d0 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:06.361193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adf389-8a31-4c85-ab8c-10004ec3394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:06.362185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adf389-8a31-4c85-ab8c-10004ec3394a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:06.362683 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adf389-8a31-4c85-ab8c-10004ec3394a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:06.363189 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adf389-8a31-4c85-ab8c-10004ec3394a None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:06.364539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adf389-8a31-4c85-ab8c-10004ec3394a None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:06.366216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adf389-8a31-4c85-ab8c-10004ec3394a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:06.368091 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 138/268] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:06 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:06.374155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b71500-7a49-4092-8aea-8ff898600b36 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:06.452777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:06.521099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b71500-7a49-4092-8aea-8ff898600b36 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:06.561082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bcbac-5857-42ce-bcb4-95ed3733371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:06.561687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bcbac-5857-42ce-bcb4-95ed3733371e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:06.561962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bcbac-5857-42ce-bcb4-95ed3733371e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:06.562295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bcbac-5857-42ce-bcb4-95ed3733371e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:06.563063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bcbac-5857-42ce-bcb4-95ed3733371e None admin] RBAC: Adding query filter params (role.id=49763e40fa024aaa9522c00cea577eca, scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e, user.id=8a3ad561dfc84ea98dbd339e164a6d71) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:06.563371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bcbac-5857-42ce-bcb4-95ed3733371e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:06.565076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bcbac-5857-42ce-bcb4-95ed3733371e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:06.571726 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 131/269] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:06 2022] GET /identity/v3/role_assignments?user.id=8a3ad561dfc84ea98dbd339e164a6d71&scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e&role.id=49763e40fa024aaa9522c00cea577eca => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:06.580428 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a654f3-d7d6-4ba8-ac3a-cceead65f603 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:06.580731 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a654f3-d7d6-4ba8-ac3a-cceead65f603 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:06.580986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a654f3-d7d6-4ba8-ac3a-cceead65f603 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:06.583029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 139/270] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:06.589049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a3ba4-07c1-49d8-a88b-c75f04367f5b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:06.589335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a3ba4-07c1-49d8-a88b-c75f04367f5b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:06.589607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a3ba4-07c1-49d8-a88b-c75f04367f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:06.609715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-960a3ba4-07c1-49d8-a88b-c75f04367f5b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:06.610982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-960a3ba4-07c1-49d8-a88b-c75f04367f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:06.687873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 132/271] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:06.761017 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf0d7-e1b3-4892-a470-69e9ab73ea93 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:06.761930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf0d7-e1b3-4892-a470-69e9ab73ea93 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:06.762388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf0d7-e1b3-4892-a470-69e9ab73ea93 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:06.764118 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 140/272] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:06.776472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83d40a-3a12-4c98-9973-51881047d97b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:06.776761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83d40a-3a12-4c98-9973-51881047d97b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:06.776944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83d40a-3a12-4c98-9973-51881047d97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:06.799752 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-7f83d40a-3a12-4c98-9973-51881047d97b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:06.801511 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7f83d40a-3a12-4c98-9973-51881047d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:06.837558 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:06.885563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 133/273] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:06.935113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa7f7-ce80-46ec-8760-fb80285132db None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:06.935720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa7f7-ce80-46ec-8760-fb80285132db None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:06.936186 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa7f7-ce80-46ec-8760-fb80285132db None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:06.937981 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 141/274] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:06.944044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e069cf8-9af8-48cc-af5a-ece108d04a89 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:06.944545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e069cf8-9af8-48cc-af5a-ece108d04a89 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:06.945012 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e069cf8-9af8-48cc-af5a-ece108d04a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:06.964816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-9e069cf8-9af8-48cc-af5a-ece108d04a89 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:06.966352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9e069cf8-9af8-48cc-af5a-ece108d04a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:07.032588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa7f7-ce80-46ec-8760-fb80285132db None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:07.063218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 134/275] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:07.158542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa7f7-ce80-46ec-8760-fb80285132db None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:07.174896 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0390a-7f3d-4774-8bfd-a25ab22b809f None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:07.175659 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0390a-7f3d-4774-8bfd-a25ab22b809f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:07.176427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0390a-7f3d-4774-8bfd-a25ab22b809f None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:07.182544 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 135/276] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:21:07.182544 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0390a-7f3d-4774-8bfd-a25ab22b809f None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:07.195231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a388c-802d-458b-a478-d80cda914bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:07.195855 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a388c-802d-458b-a478-d80cda914bcb None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:07.196133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a388c-802d-458b-a478-d80cda914bcb None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:07.196403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a388c-802d-458b-a478-d80cda914bcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:07.208935 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a388c-802d-458b-a478-d80cda914bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-ce8a388c-802d-458b-a478-d80cda914bcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:07.214439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:07.215490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:07.216507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:07.216507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:07.216507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:07.216507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:07.216507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:07.216507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:07.216507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:07.216507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:07.216507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:07.216507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:07.216507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:07.216507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:07.216507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 142/277] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:21:07.217177 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ef43-cc51-4915-845a-c0c32e4b858f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:07.217177 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ef43-cc51-4915-845a-c0c32e4b858f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:07.217177 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ef43-cc51-4915-845a-c0c32e4b858f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:07.238250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-9ef4ef43-cc51-4915-845a-c0c32e4b858f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:07.239497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-9ef4ef43-cc51-4915-845a-c0c32e4b858f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:07.251438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:07.298371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:07.303970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0390a-7f3d-4774-8bfd-a25ab22b809f None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:07.310705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 143/278] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:07.314982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ef43-cc51-4915-845a-c0c32e4b858f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:07.342771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e52eab-08ac-4c47-9b1d-94fa4fcce513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:07.343407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52eab-08ac-4c47-9b1d-94fa4fcce513 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:07.343717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52eab-08ac-4c47-9b1d-94fa4fcce513 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:07.344021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e52eab-08ac-4c47-9b1d-94fa4fcce513 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:07.345089 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e52eab-08ac-4c47-9b1d-94fa4fcce513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:07.346698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e52eab-08ac-4c47-9b1d-94fa4fcce513 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:07.348206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 136/279] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:07.353468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e52eab-08ac-4c47-9b1d-94fa4fcce513 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:07.425362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ef43-cc51-4915-845a-c0c32e4b858f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:07.454369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e52eab-08ac-4c47-9b1d-94fa4fcce513 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:07.461998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39e20e-e4b9-4560-a011-196f919ed046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:07.462628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39e20e-e4b9-4560-a011-196f919ed046 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:07.462910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39e20e-e4b9-4560-a011-196f919ed046 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:07.463184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39e20e-e4b9-4560-a011-196f919ed046 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:07.463944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39e20e-e4b9-4560-a011-196f919ed046 None admin] RBAC: Adding query filter params (name=member) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:07.464244 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39e20e-e4b9-4560-a011-196f919ed046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:07.465786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39e20e-e4b9-4560-a011-196f919ed046 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:07.479565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 144/280] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:07.479565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39e20e-e4b9-4560-a011-196f919ed046 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:07.489018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:07.497582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b411e-a70f-43bb-a6d8-7718df05f178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:07.498186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b411e-a70f-43bb-a6d8-7718df05f178 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:07.498466 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b411e-a70f-43bb-a6d8-7718df05f178 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:07.498767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b411e-a70f-43bb-a6d8-7718df05f178 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:07.499418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b411e-a70f-43bb-a6d8-7718df05f178 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:07.500975 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b411e-a70f-43bb-a6d8-7718df05f178 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:07.536118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 137/281] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:21:07 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:21:07.536118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b411e-a70f-43bb-a6d8-7718df05f178 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:07.568336 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:07.591927 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39e20e-e4b9-4560-a011-196f919ed046 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:07.630586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bc42e-fef8-4a1b-9880-910825476aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:07.631231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bc42e-fef8-4a1b-9880-910825476aa0 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:07.631505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bc42e-fef8-4a1b-9880-910825476aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:07.631776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bc42e-fef8-4a1b-9880-910825476aa0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:07.643821 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903bc42e-fef8-4a1b-9880-910825476aa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-903bc42e-fef8-4a1b-9880-910825476aa0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:07.649392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:07.650345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:07.651390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:07.651390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:07.651390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:07.651390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:07.651390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:07.651390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:07.651390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:07.651390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:07.651390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:07.651390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:07.651390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:21:07.651390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:07.651390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 145/282] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:07.652576 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bc42e-fef8-4a1b-9880-910825476aa0 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:07.666544 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b411e-a70f-43bb-a6d8-7718df05f178 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:07.710081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b267048-c9a9-4d95-b628-8ed1e43733ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:07.710743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b267048-c9a9-4d95-b628-8ed1e43733ed None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:07.711023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b267048-c9a9-4d95-b628-8ed1e43733ed None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:07.711291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b267048-c9a9-4d95-b628-8ed1e43733ed None admin] PATH_INFO: `/v3/users/5d47eb1dc0404e82aa99e69abcf45060` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:07.729324 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b267048-c9a9-4d95-b628-8ed1e43733ed None admin] RBAC: Authorizing `identity:get_user(user_id=5d47eb1dc0404e82aa99e69abcf45060)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:07.730843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b267048-c9a9-4d95-b628-8ed1e43733ed None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:07.732655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 138/283] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:07 2022] GET /identity/v3/users/5d47eb1dc0404e82aa99e69abcf45060 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:07.733255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:07.733378 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b267048-c9a9-4d95-b628-8ed1e43733ed None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:07.770811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bc42e-fef8-4a1b-9880-910825476aa0 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:07.815028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164318c2-397a-4075-9b22-aa19e20cbc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:07.815669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164318c2-397a-4075-9b22-aa19e20cbc12 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:07.816960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164318c2-397a-4075-9b22-aa19e20cbc12 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:07.817234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164318c2-397a-4075-9b22-aa19e20cbc12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:07.830729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164318c2-397a-4075-9b22-aa19e20cbc12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:07.833480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-164318c2-397a-4075-9b22-aa19e20cbc12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:07.837921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:07.839092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:07.839895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:07.839895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:07.839895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:07.839895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:07.839895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:07.839895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:07.839895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:07.839895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:07.839895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:07.839895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:07.839895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:07.839895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:07.839895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 146/284] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:07.840562 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164318c2-397a-4075-9b22-aa19e20cbc12 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:07.860791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b267048-c9a9-4d95-b628-8ed1e43733ed None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:07.910483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db70da4-7d23-49e1-b8d5-5b8bc8283992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:07.911118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db70da4-7d23-49e1-b8d5-5b8bc8283992 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:07.911394 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db70da4-7d23-49e1-b8d5-5b8bc8283992 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:07.911661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db70da4-7d23-49e1-b8d5-5b8bc8283992 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:07.912320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db70da4-7d23-49e1-b8d5-5b8bc8283992 None admin] RBAC: Adding query filter params (name=reader) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:07.912615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db70da4-7d23-49e1-b8d5-5b8bc8283992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:07.913994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db70da4-7d23-49e1-b8d5-5b8bc8283992 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:07.923803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 139/285] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:07.924709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db70da4-7d23-49e1-b8d5-5b8bc8283992 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:07.966757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164318c2-397a-4075-9b22-aa19e20cbc12 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:08.005893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:08.017752 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046e204-992e-488a-87ce-7f2e3428a9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:08.018710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046e204-992e-488a-87ce-7f2e3428a9ef None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:08.019502 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046e204-992e-488a-87ce-7f2e3428a9ef None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:08.020357 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046e204-992e-488a-87ce-7f2e3428a9ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:08.021272 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046e204-992e-488a-87ce-7f2e3428a9ef None admin] RBAC: Adding query filter params (role.id=d912a7e672bb441099f4ef85d61e7c46, user.id=5d47eb1dc0404e82aa99e69abcf45060, scope.system=all) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:08.021753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046e204-992e-488a-87ce-7f2e3428a9ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:08.023420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046e204-992e-488a-87ce-7f2e3428a9ef None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:08.031923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 147/286] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 16 05:21:07 2022] GET /identity/v3/role_assignments?user.id=5d47eb1dc0404e82aa99e69abcf45060&scope.system=all&role.id=d912a7e672bb441099f4ef85d61e7c46 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:08.032831 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046e204-992e-488a-87ce-7f2e3428a9ef None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:08.039823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db70da4-7d23-49e1-b8d5-5b8bc8283992 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:08.086006 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfd170-b4ad-41db-a4f9-552430edcbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:08.086978 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfd170-b4ad-41db-a4f9-552430edcbb2 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:08.087434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfd170-b4ad-41db-a4f9-552430edcbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:08.087899 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfd170-b4ad-41db-a4f9-552430edcbb2 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:08.088789 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfd170-b4ad-41db-a4f9-552430edcbb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:08.089302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfd170-b4ad-41db-a4f9-552430edcbb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:08.091814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfd170-b4ad-41db-a4f9-552430edcbb2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:08.101784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 140/287] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:08.107310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfd170-b4ad-41db-a4f9-552430edcbb2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:08.112499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:08.165076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046e204-992e-488a-87ce-7f2e3428a9ef None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:08.234722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4db75-a6fd-4212-9bd9-a5f4723a5bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:08.235750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4db75-a6fd-4212-9bd9-a5f4723a5bdf None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:08.236251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4db75-a6fd-4212-9bd9-a5f4723a5bdf None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:08.236714 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4db75-a6fd-4212-9bd9-a5f4723a5bdf None admin] PATH_INFO: `/v3/users/e40eed4d7b734c8e8ec1dd13c90a18fb` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:08.242136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4db75-a6fd-4212-9bd9-a5f4723a5bdf None admin] RBAC: Authorizing `identity:get_user(user_id=e40eed4d7b734c8e8ec1dd13c90a18fb)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:08.243805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4db75-a6fd-4212-9bd9-a5f4723a5bdf None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:08.245349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 148/288] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:08 2022] GET /identity/v3/users/e40eed4d7b734c8e8ec1dd13c90a18fb => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:08.252120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4db75-a6fd-4212-9bd9-a5f4723a5bdf None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:08.282260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfd170-b4ad-41db-a4f9-552430edcbb2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:08.328852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc2167-8ccf-435d-9d0a-1ba929cd059d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:08.330118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc2167-8ccf-435d-9d0a-1ba929cd059d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:08.330661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc2167-8ccf-435d-9d0a-1ba929cd059d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:08.331127 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc2167-8ccf-435d-9d0a-1ba929cd059d None admin] PATH_INFO: `/v3/users/61ee94b85e734f42a4b42a64cd4ca485` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:08.333368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc2167-8ccf-435d-9d0a-1ba929cd059d None admin] RBAC: Authorizing `identity:get_user(user_id=61ee94b85e734f42a4b42a64cd4ca485)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:08.335780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc2167-8ccf-435d-9d0a-1ba929cd059d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:08.338484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 141/289] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:08 2022] GET /identity/v3/users/61ee94b85e734f42a4b42a64cd4ca485 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:08.342419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:08.344290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc2167-8ccf-435d-9d0a-1ba929cd059d None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:08.395828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4db75-a6fd-4212-9bd9-a5f4723a5bdf None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:08.461272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:08.479234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a32310-5538-41a8-bf28-e9366d001e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:08.479880 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a32310-5538-41a8-bf28-e9366d001e80 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:08.480159 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a32310-5538-41a8-bf28-e9366d001e80 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:08.480431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a32310-5538-41a8-bf28-e9366d001e80 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:08.481642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a32310-5538-41a8-bf28-e9366d001e80 None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:08.483130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a32310-5538-41a8-bf28-e9366d001e80 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:08.485080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 149/290] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:08 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:08.502415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc2167-8ccf-435d-9d0a-1ba929cd059d None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:08.503512 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a32310-5538-41a8-bf28-e9366d001e80 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:08.551438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a00d54-aaa1-410a-b8bf-6781482de974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:08.552063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a00d54-aaa1-410a-b8bf-6781482de974 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:08.552338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a00d54-aaa1-410a-b8bf-6781482de974 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:08.552673 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a00d54-aaa1-410a-b8bf-6781482de974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:08.649872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a00d54-aaa1-410a-b8bf-6781482de974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:08.651294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a00d54-aaa1-410a-b8bf-6781482de974 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:08.724564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a32310-5538-41a8-bf28-e9366d001e80 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:08.729076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:08.764976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 142/291] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:08.770190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a00d54-aaa1-410a-b8bf-6781482de974 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:08.786903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:08.839246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae78113-d5cb-4083-a254-a625e5935254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:08.839915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae78113-d5cb-4083-a254-a625e5935254 None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:08.840193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae78113-d5cb-4083-a254-a625e5935254 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:08.840463 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae78113-d5cb-4083-a254-a625e5935254 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e/users/e40eed4d7b734c8e8ec1dd13c90a18fb/roles/1032cdf216bb48c38c1c98860da25d9f` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:08.851396 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae78113-d5cb-4083-a254-a625e5935254 None admin] RBAC: Authorizing `identity:create_grant(project_id=537e7cd0d44a4708ada4ac38cc6ef13e, user_id=e40eed4d7b734c8e8ec1dd13c90a18fb, role_id=1032cdf216bb48c38c1c98860da25d9f)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:08.852860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae78113-d5cb-4083-a254-a625e5935254 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:08.876855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a00d54-aaa1-410a-b8bf-6781482de974 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:08.893067 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 150/292] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:21:08 2022] PUT /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e/users/e40eed4d7b734c8e8ec1dd13c90a18fb/roles/1032cdf216bb48c38c1c98860da25d9f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:08.934114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89e1b4-89e6-4e6e-811d-dbaa401a6128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:08.934767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e1b4-89e6-4e6e-811d-dbaa401a6128 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:08.935033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e1b4-89e6-4e6e-811d-dbaa401a6128 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:08.935307 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e1b4-89e6-4e6e-811d-dbaa401a6128 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:08.936670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89e1b4-89e6-4e6e-811d-dbaa401a6128 None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:08.938250 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89e1b4-89e6-4e6e-811d-dbaa401a6128 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:08.940599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 143/293] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:08 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:08.946536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae78113-d5cb-4083-a254-a625e5935254 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:09.121399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae78113-d5cb-4083-a254-a625e5935254 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:09.163506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942e435-0c6f-44ee-92be-2f8216e412e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:09.164166 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942e435-0c6f-44ee-92be-2f8216e412e4 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:09.164446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942e435-0c6f-44ee-92be-2f8216e412e4 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:09.164716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942e435-0c6f-44ee-92be-2f8216e412e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:09.165443 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942e435-0c6f-44ee-92be-2f8216e412e4 None admin] RBAC: Adding query filter params (role.id=d912a7e672bb441099f4ef85d61e7c46, scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e, user.id=61ee94b85e734f42a4b42a64cd4ca485) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:09.165745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942e435-0c6f-44ee-92be-2f8216e412e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:09.167252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942e435-0c6f-44ee-92be-2f8216e412e4 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:09.173765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 151/294] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:08 2022] GET /identity/v3/role_assignments?user.id=61ee94b85e734f42a4b42a64cd4ca485&scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e&role.id=d912a7e672bb441099f4ef85d61e7c46 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:10.110232 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad5d69-026c-466f-a364-5a9d9afec5b5 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:10.110810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad5d69-026c-466f-a364-5a9d9afec5b5 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:10.110810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad5d69-026c-466f-a364-5a9d9afec5b5 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:10.112433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 144/295] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:10.117774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf10e3-1b7e-4c9e-ae8a-f16143344d1e None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:10.118165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf10e3-1b7e-4c9e-ae8a-f16143344d1e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:10.118314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf10e3-1b7e-4c9e-ae8a-f16143344d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:10.137716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-91cf10e3-1b7e-4c9e-ae8a-f16143344d1e None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:10.138576 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed398f9c-076e-4793-bdce-25b16706d27b None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:10.139086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed398f9c-076e-4793-bdce-25b16706d27b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:10.139187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-91cf10e3-1b7e-4c9e-ae8a-f16143344d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:10.139664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed398f9c-076e-4793-bdce-25b16706d27b None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:10.141614 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 145/296] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:21:10.147455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9037f-da46-4984-869f-a913fea58c06 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:10.148009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9037f-da46-4984-869f-a913fea58c06 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:10.148475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9037f-da46-4984-869f-a913fea58c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:10.167176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f1d9037f-da46-4984-869f-a913fea58c06 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:10.168672 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f1d9037f-da46-4984-869f-a913fea58c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:10.199625 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:10.212988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:10.231162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 152/297] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:10.254893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 146/298] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:21:10.496682 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf10e3-1b7e-4c9e-ae8a-f16143344d1e None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:10.527201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9037f-da46-4984-869f-a913fea58c06 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:10.604531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf10e3-1b7e-4c9e-ae8a-f16143344d1e None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:10.640625 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0430c-2bed-46b0-b3af-0c21ec49b6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:10.641542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0430c-2bed-46b0-b3af-0c21ec49b6a0 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:10.642042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0430c-2bed-46b0-b3af-0c21ec49b6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:10.642413 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9037f-da46-4984-869f-a913fea58c06 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:10.642706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0430c-2bed-46b0-b3af-0c21ec49b6a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:10.643628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0430c-2bed-46b0-b3af-0c21ec49b6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:10.645317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0430c-2bed-46b0-b3af-0c21ec49b6a0 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:10.650945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 153/299] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:10.650945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5698-e619-41fd-b0a1-f375a1d39f5a None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:10.650945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5698-e619-41fd-b0a1-f375a1d39f5a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:10.650945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5698-e619-41fd-b0a1-f375a1d39f5a None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:10.650945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 154/300] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:10.654393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5698-e619-41fd-b0a1-f375a1d39f5a None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:10.678719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c17bc7-99ae-429a-becf-4d80af4a3ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:10.679348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c17bc7-99ae-429a-becf-4d80af4a3ae6 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:10.679627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c17bc7-99ae-429a-becf-4d80af4a3ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:10.679898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c17bc7-99ae-429a-becf-4d80af4a3ae6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:10.692697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c17bc7-99ae-429a-becf-4d80af4a3ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-a7c17bc7-99ae-429a-becf-4d80af4a3ae6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:10.697808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:10.698915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:10.699745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:10.699745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:10.699745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:10.699745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:10.699745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:10.699745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:10.699745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:10.699745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:10.699745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:10.699745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:10.699745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:21:10.699745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:10.700345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 147/301] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:21:10.701874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe419b-70c5-4b38-bd87-0536a1a74f47 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:10.702155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe419b-70c5-4b38-bd87-0536a1a74f47 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:10.702423 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe419b-70c5-4b38-bd87-0536a1a74f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:10.712804 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:10.721834 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-7ebe419b-70c5-4b38-bd87-0536a1a74f47 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:10.723599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7ebe419b-70c5-4b38-bd87-0536a1a74f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:10.747948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:10.771796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5698-e619-41fd-b0a1-f375a1d39f5a None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:10.802539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 148/302] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:10.802539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe419b-70c5-4b38-bd87-0536a1a74f47 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:10.828815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9650ba-5542-4816-a8a2-64fe51fcf250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:10.829417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9650ba-5542-4816-a8a2-64fe51fcf250 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:10.829690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9650ba-5542-4816-a8a2-64fe51fcf250 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:10.829952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9650ba-5542-4816-a8a2-64fe51fcf250 None admin] PATH_INFO: `/v3/groups` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:10.830814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9650ba-5542-4816-a8a2-64fe51fcf250 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:10.835485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9650ba-5542-4816-a8a2-64fe51fcf250 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:10.862547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 155/303] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Sep 16 05:21:10 2022] POST /identity/v3/groups => generated 229 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:21:10.918171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe419b-70c5-4b38-bd87-0536a1a74f47 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:10.966946 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685589ad-6734-4e0b-834f-28ce1d0c4b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:10.967566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685589ad-6734-4e0b-834f-28ce1d0c4b58 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:10.967888 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685589ad-6734-4e0b-834f-28ce1d0c4b58 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:10.968159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685589ad-6734-4e0b-834f-28ce1d0c4b58 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:10.968824 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685589ad-6734-4e0b-834f-28ce1d0c4b58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:10.969122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685589ad-6734-4e0b-834f-28ce1d0c4b58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:10.970699 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685589ad-6734-4e0b-834f-28ce1d0c4b58 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:10.980784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 149/304] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:10.986728 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9650ba-5542-4816-a8a2-64fe51fcf250 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:11.076724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685589ad-6734-4e0b-834f-28ce1d0c4b58 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:11.105326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9650ba-5542-4816-a8a2-64fe51fcf250 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:11.108803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:11.117734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:11.160892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7e2a1-49a1-4eca-bd51-1634db871467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:11.161551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7e2a1-49a1-4eca-bd51-1634db871467 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:11.161786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7e2a1-49a1-4eca-bd51-1634db871467 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:11.162064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7e2a1-49a1-4eca-bd51-1634db871467 None admin] PATH_INFO: `/v3/users/61decdb33fa8495487c6befab3546816` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:11.177302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7e2a1-49a1-4eca-bd51-1634db871467 None admin] RBAC: Authorizing `identity:get_user(user_id=61decdb33fa8495487c6befab3546816)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:11.178955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7e2a1-49a1-4eca-bd51-1634db871467 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:11.181003 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 156/305] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:10 2022] GET /identity/v3/users/61decdb33fa8495487c6befab3546816 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:11.186160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7e2a1-49a1-4eca-bd51-1634db871467 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:11.219296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685589ad-6734-4e0b-834f-28ce1d0c4b58 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:11.278397 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecbe8f-5e05-469a-b429-8fe80ca479a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:11.279166 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecbe8f-5e05-469a-b429-8fe80ca479a7 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:11.279450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecbe8f-5e05-469a-b429-8fe80ca479a7 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:11.279695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecbe8f-5e05-469a-b429-8fe80ca479a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:11.295192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecbe8f-5e05-469a-b429-8fe80ca479a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-67ecbe8f-5e05-469a-b429-8fe80ca479a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:11.300333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:11.301313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:11.302098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:11.302098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:11.302098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:11.302098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:11.302098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:11.302098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:11.302098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:11.302098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:11.302098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:11.302098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:11.302098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:11.302098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:11.302098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 150/306] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:21:11.308528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecbe8f-5e05-469a-b429-8fe80ca479a7 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:11.331197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7e2a1-49a1-4eca-bd51-1634db871467 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:11.375606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb151979-824f-49ee-8e69-066dc1acda18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:11.376310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb151979-824f-49ee-8e69-066dc1acda18 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:11.376677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb151979-824f-49ee-8e69-066dc1acda18 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:11.377019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb151979-824f-49ee-8e69-066dc1acda18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:11.377968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb151979-824f-49ee-8e69-066dc1acda18 None admin] RBAC: Adding query filter params (role.id=1032cdf216bb48c38c1c98860da25d9f, user.id=61decdb33fa8495487c6befab3546816, scope.system=all) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:11.378359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb151979-824f-49ee-8e69-066dc1acda18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:11.380430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb151979-824f-49ee-8e69-066dc1acda18 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:11.390555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 157/307] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 16 05:21:11 2022] GET /identity/v3/role_assignments?user.id=61decdb33fa8495487c6befab3546816&scope.system=all&role.id=1032cdf216bb48c38c1c98860da25d9f => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:11.398370 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af9022-e4c1-4eef-a02f-b01c918fccbe None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:11.398704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af9022-e4c1-4eef-a02f-b01c918fccbe None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:11.398953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af9022-e4c1-4eef-a02f-b01c918fccbe None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:11.401236 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 158/308] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:21:11.405847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:11.406923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917239-bae1-469e-a4f4-4909b25cf1ca None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:11.407210 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917239-bae1-469e-a4f4-4909b25cf1ca None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:11.407511 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917239-bae1-469e-a4f4-4909b25cf1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:11.427059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecbe8f-5e05-469a-b429-8fe80ca479a7 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:11.427601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-43917239-bae1-469e-a4f4-4909b25cf1ca None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:11.428845 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-43917239-bae1-469e-a4f4-4909b25cf1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:11.464700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:11.465009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76e15b-62e1-4f47-84cd-2c091a6c603a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:11.465579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e15b-62e1-4f47-84cd-2c091a6c603a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:11.465854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e15b-62e1-4f47-84cd-2c091a6c603a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:11.466121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e15b-62e1-4f47-84cd-2c091a6c603a None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:11.466826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76e15b-62e1-4f47-84cd-2c091a6c603a None admin] RBAC: Adding query filter params (name=member) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:11.467194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76e15b-62e1-4f47-84cd-2c091a6c603a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:11.468612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76e15b-62e1-4f47-84cd-2c091a6c603a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:11.479660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 151/309] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:11.485026 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76e15b-62e1-4f47-84cd-2c091a6c603a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:11.518481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 159/310] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:21:11.608001 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76e15b-62e1-4f47-84cd-2c091a6c603a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:11.644719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f423-fadd-4040-83a7-872f6180411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:11.645635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f423-fadd-4040-83a7-872f6180411a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:11.646082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f423-fadd-4040-83a7-872f6180411a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:11.646572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f423-fadd-4040-83a7-872f6180411a None admin] PATH_INFO: `/v3/users/5d47eb1dc0404e82aa99e69abcf45060` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:11.647840 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48f423-fadd-4040-83a7-872f6180411a None admin] RBAC: Authorizing `identity:get_user(user_id=5d47eb1dc0404e82aa99e69abcf45060)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:11.649474 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48f423-fadd-4040-83a7-872f6180411a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:11.651602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 152/311] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:11 2022] GET /identity/v3/users/5d47eb1dc0404e82aa99e69abcf45060 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:11.656886 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43917239-bae1-469e-a4f4-4909b25cf1ca None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:11.761724 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43917239-bae1-469e-a4f4-4909b25cf1ca None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:11.797287 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4166db0-1249-4621-ad0d-144cf97af647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:11.798308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166db0-1249-4621-ad0d-144cf97af647 None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:11.798830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166db0-1249-4621-ad0d-144cf97af647 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:11.799305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166db0-1249-4621-ad0d-144cf97af647 None admin] PATH_INFO: `/v3/system/users/5d47eb1dc0404e82aa99e69abcf45060/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:11.801456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4166db0-1249-4621-ad0d-144cf97af647 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5d47eb1dc0404e82aa99e69abcf45060, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:11.803107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4166db0-1249-4621-ad0d-144cf97af647 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:11.814790 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 160/312] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Sep 16 05:21:11 2022] PUT /identity/v3/system/users/5d47eb1dc0404e82aa99e69abcf45060/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:11.845468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f423-fadd-4040-83a7-872f6180411a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:11.867676 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:11.975681 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f423-fadd-4040-83a7-872f6180411a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:12.014536 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba19222-284e-443f-afc8-a42647e20368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:12.015194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba19222-284e-443f-afc8-a42647e20368 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:12.015474 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba19222-284e-443f-afc8-a42647e20368 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:12.015747 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba19222-284e-443f-afc8-a42647e20368 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:12.028543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba19222-284e-443f-afc8-a42647e20368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-cba19222-284e-443f-afc8-a42647e20368 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:12.034623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:12.036175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:12.037194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:12.037194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:12.037194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:12.037194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:12.037194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:12.037194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:12.037194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:12.037194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:12.037194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:12.037194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:12.037194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:21:12.037194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:12.037194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 153/313] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:12.043715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4166db0-1249-4621-ad0d-144cf97af647 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:12.074907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:12.153319 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4166db0-1249-4621-ad0d-144cf97af647 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:12.188545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f1eab-5a95-4911-9e6a-e24fddd0ad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:12.189393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f1eab-5a95-4911-9e6a-e24fddd0ad74 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:12.189669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f1eab-5a95-4911-9e6a-e24fddd0ad74 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:12.189940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f1eab-5a95-4911-9e6a-e24fddd0ad74 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:12.190630 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f1eab-5a95-4911-9e6a-e24fddd0ad74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:12.191559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f1eab-5a95-4911-9e6a-e24fddd0ad74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:12.192960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f1eab-5a95-4911-9e6a-e24fddd0ad74 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:12.201686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 161/314] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:12.207493 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba19222-284e-443f-afc8-a42647e20368 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:12.312484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:12.333808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba19222-284e-443f-afc8-a42647e20368 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:12.371084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933c463-1f12-4fcc-b9c3-7a859716a063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:12.371843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933c463-1f12-4fcc-b9c3-7a859716a063 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:12.372124 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933c463-1f12-4fcc-b9c3-7a859716a063 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:12.372393 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933c463-1f12-4fcc-b9c3-7a859716a063 None admin] PATH_INFO: `/v3/users/e40eed4d7b734c8e8ec1dd13c90a18fb` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:12.373526 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933c463-1f12-4fcc-b9c3-7a859716a063 None admin] RBAC: Authorizing `identity:get_user(user_id=e40eed4d7b734c8e8ec1dd13c90a18fb)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:12.375015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933c463-1f12-4fcc-b9c3-7a859716a063 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:12.376814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 154/315] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:12 2022] GET /identity/v3/users/e40eed4d7b734c8e8ec1dd13c90a18fb => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:12.382144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f1eab-5a95-4911-9e6a-e24fddd0ad74 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:12.476596 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:12.488792 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f1eab-5a95-4911-9e6a-e24fddd0ad74 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:12.522389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3d572-81b9-45c7-875d-e39d07d20a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:12.523027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3d572-81b9-45c7-875d-e39d07d20a90 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:12.523308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3d572-81b9-45c7-875d-e39d07d20a90 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:12.523580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3d572-81b9-45c7-875d-e39d07d20a90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:12.599970 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3d572-81b9-45c7-875d-e39d07d20a90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:12.601448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3d572-81b9-45c7-875d-e39d07d20a90 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:12.689603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:12.702683 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 162/316] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:12.711623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933c463-1f12-4fcc-b9c3-7a859716a063 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:12.816634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933c463-1f12-4fcc-b9c3-7a859716a063 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:12.853329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfe3a8-69bb-41e9-96db-a08f2ab3c606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:12.853972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe3a8-69bb-41e9-96db-a08f2ab3c606 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:12.854251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe3a8-69bb-41e9-96db-a08f2ab3c606 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:12.854541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe3a8-69bb-41e9-96db-a08f2ab3c606 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:12.855711 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfe3a8-69bb-41e9-96db-a08f2ab3c606 None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:12.857179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfe3a8-69bb-41e9-96db-a08f2ab3c606 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:12.859314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 155/317] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:12 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:12.867605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3d572-81b9-45c7-875d-e39d07d20a90 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:12.968172 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3d572-81b9-45c7-875d-e39d07d20a90 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:13.002548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079517d-5ff0-4f6c-929e-b9c11b50908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:13.003157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079517d-5ff0-4f6c-929e-b9c11b50908b None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:13.003962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079517d-5ff0-4f6c-929e-b9c11b50908b None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:13.004232 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079517d-5ff0-4f6c-929e-b9c11b50908b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:13.004952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079517d-5ff0-4f6c-929e-b9c11b50908b None admin] RBAC: Adding query filter params (role.id=1032cdf216bb48c38c1c98860da25d9f, scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e, user.id=e40eed4d7b734c8e8ec1dd13c90a18fb) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:13.005255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079517d-5ff0-4f6c-929e-b9c11b50908b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:13.006734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079517d-5ff0-4f6c-929e-b9c11b50908b None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:13.013020 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 163/318] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:12 2022] GET /identity/v3/role_assignments?user.id=e40eed4d7b734c8e8ec1dd13c90a18fb&scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e&role.id=1032cdf216bb48c38c1c98860da25d9f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:13.161735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd1f40-79b0-4aa3-a9a7-95f1049affb3 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:13.162028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd1f40-79b0-4aa3-a9a7-95f1049affb3 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:13.162212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd1f40-79b0-4aa3-a9a7-95f1049affb3 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:13.163818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 156/319] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:13.169614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a653bc-d9f6-4228-a1d3-918c9e787666 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:13.169892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a653bc-d9f6-4228-a1d3-918c9e787666 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:13.170156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a653bc-d9f6-4228-a1d3-918c9e787666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:13.190107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-59a653bc-d9f6-4228-a1d3-918c9e787666 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:13.190729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-59a653bc-d9f6-4228-a1d3-918c9e787666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:13.243975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:13.267482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 164/320] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:13.533380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd1f40-79b0-4aa3-a9a7-95f1049affb3 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:13.545734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:13.627704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f081e-8d0f-47f4-bf40-390ecdf6a9af None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:13.627985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f081e-8d0f-47f4-bf40-390ecdf6a9af None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:13.628280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f081e-8d0f-47f4-bf40-390ecdf6a9af None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:13.630133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 165/321] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:13.634892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244394d9-48b8-4adb-8ecf-088ec1758e65 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:13.635178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244394d9-48b8-4adb-8ecf-088ec1758e65 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:13.635446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244394d9-48b8-4adb-8ecf-088ec1758e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:13.640795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd1f40-79b0-4aa3-a9a7-95f1049affb3 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:13.653304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-244394d9-48b8-4adb-8ecf-088ec1758e65 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:13.654487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-244394d9-48b8-4adb-8ecf-088ec1758e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:13.679940 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5683cf-19c9-4a35-a9a6-1b0584e6fb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:13.680562 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5683cf-19c9-4a35-a9a6-1b0584e6fb50 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:13.680837 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5683cf-19c9-4a35-a9a6-1b0584e6fb50 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:13.681105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5683cf-19c9-4a35-a9a6-1b0584e6fb50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:13.682181 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5683cf-19c9-4a35-a9a6-1b0584e6fb50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:13.683686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5683cf-19c9-4a35-a9a6-1b0584e6fb50 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:13.685228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 157/322] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:13.690853 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5683cf-19c9-4a35-a9a6-1b0584e6fb50 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:13.732421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 166/323] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:21:13.772572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:13.797085 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5683cf-19c9-4a35-a9a6-1b0584e6fb50 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:13.831638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110d926-3cd9-4a9d-be50-4df3c4d98d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:13.832246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110d926-3cd9-4a9d-be50-4df3c4d98d97 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:13.832527 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110d926-3cd9-4a9d-be50-4df3c4d98d97 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:13.832797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110d926-3cd9-4a9d-be50-4df3c4d98d97 None admin] PATH_INFO: `/v3/groups` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:13.833496 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110d926-3cd9-4a9d-be50-4df3c4d98d97 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:13.834988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110d926-3cd9-4a9d-be50-4df3c4d98d97 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:13.859047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 158/324] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Sep 16 05:21:13 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:21:13.999682 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244394d9-48b8-4adb-8ecf-088ec1758e65 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:14.110142 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244394d9-48b8-4adb-8ecf-088ec1758e65 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:14.125727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:14.148403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75db82f-28ac-493e-8846-cefbad5e64f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:14.149043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75db82f-28ac-493e-8846-cefbad5e64f1 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:14.149322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75db82f-28ac-493e-8846-cefbad5e64f1 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:14.149589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75db82f-28ac-493e-8846-cefbad5e64f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:14.161698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75db82f-28ac-493e-8846-cefbad5e64f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-f75db82f-28ac-493e-8846-cefbad5e64f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:14.167041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:14.167932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:14.168758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:14.168758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:14.168758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:14.168758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:14.168758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:14.168758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:14.168758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:14.168758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:14.168758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:14.168758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:14.168758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:21:14.168758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:14.171273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 167/325] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:14.177503 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110d926-3cd9-4a9d-be50-4df3c4d98d97 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:14.179160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b919a-d079-4390-9267-f81f98b1db59 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:14.179442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b919a-d079-4390-9267-f81f98b1db59 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:14.179711 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b919a-d079-4390-9267-f81f98b1db59 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:14.181035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 168/326] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:21:14.186239 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e99315-838d-459f-8bc7-720b86e617ef None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:14.186568 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e99315-838d-459f-8bc7-720b86e617ef None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:14.186862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e99315-838d-459f-8bc7-720b86e617ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:14.206794 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-22e99315-838d-459f-8bc7-720b86e617ef None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:14.208020 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-22e99315-838d-459f-8bc7-720b86e617ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:14.299136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 169/327] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:21:14.309227 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110d926-3cd9-4a9d-be50-4df3c4d98d97 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:14.345715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7636a-5b24-4578-8ed3-ec1cb14a0092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:14.346613 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7636a-5b24-4578-8ed3-ec1cb14a0092 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:14.347077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7636a-5b24-4578-8ed3-ec1cb14a0092 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:14.347484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7636a-5b24-4578-8ed3-ec1cb14a0092 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:14.348282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7636a-5b24-4578-8ed3-ec1cb14a0092 None admin] RBAC: Adding query filter params (name=reader) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:14.348721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7636a-5b24-4578-8ed3-ec1cb14a0092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:14.350263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7636a-5b24-4578-8ed3-ec1cb14a0092 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:14.353373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:14.361076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 159/328] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:14.366668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e99315-838d-459f-8bc7-720b86e617ef None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:14.473163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e99315-838d-459f-8bc7-720b86e617ef None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:14.474774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:14.513150 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbf169-5b25-4117-a3e1-bb5092914830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:14.513783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf169-5b25-4117-a3e1-bb5092914830 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:14.514062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf169-5b25-4117-a3e1-bb5092914830 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:14.514331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf169-5b25-4117-a3e1-bb5092914830 None admin] PATH_INFO: `/v3/users/61decdb33fa8495487c6befab3546816` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:14.515498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbf169-5b25-4117-a3e1-bb5092914830 None admin] RBAC: Authorizing `identity:get_user(user_id=61decdb33fa8495487c6befab3546816)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:14.516968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbf169-5b25-4117-a3e1-bb5092914830 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:14.518925 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 170/329] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:14 2022] GET /identity/v3/users/61decdb33fa8495487c6befab3546816 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:14.527834 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7636a-5b24-4578-8ed3-ec1cb14a0092 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:14.590729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbf169-5b25-4117-a3e1-bb5092914830 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:14.658198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7636a-5b24-4578-8ed3-ec1cb14a0092 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:14.711326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b0ca7-9b93-4a94-b431-9554e835d855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:14.712341 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b0ca7-9b93-4a94-b431-9554e835d855 None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:14.712817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b0ca7-9b93-4a94-b431-9554e835d855 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:14.713289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b0ca7-9b93-4a94-b431-9554e835d855 None admin] PATH_INFO: `/v3/system/users/61decdb33fa8495487c6befab3546816/roles/1032cdf216bb48c38c1c98860da25d9f` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:14.717817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b0ca7-9b93-4a94-b431-9554e835d855 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=61decdb33fa8495487c6befab3546816, role_id=1032cdf216bb48c38c1c98860da25d9f)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:14.719519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b0ca7-9b93-4a94-b431-9554e835d855 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:14.722448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbf169-5b25-4117-a3e1-bb5092914830 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:14.731505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 160/330] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Sep 16 05:21:14 2022] PUT /identity/v3/system/users/61decdb33fa8495487c6befab3546816/roles/1032cdf216bb48c38c1c98860da25d9f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:14.763796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf24b7-9b64-47dc-add4-aaab2da751b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:14.764455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf24b7-9b64-47dc-add4-aaab2da751b0 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:14.764738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf24b7-9b64-47dc-add4-aaab2da751b0 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:14.765007 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf24b7-9b64-47dc-add4-aaab2da751b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:14.777171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf24b7-9b64-47dc-add4-aaab2da751b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-74cf24b7-9b64-47dc-add4-aaab2da751b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:14.782286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:14.783293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:14.784109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:14.784109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:14.784109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:14.784109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:14.784109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:14.784109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:14.784109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:14.784109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:14.784109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:14.784109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:14.784109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:14.784109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:14.784109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 171/331] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:14.791442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b0ca7-9b93-4a94-b431-9554e835d855 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:14.874685 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:14.932004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b0ca7-9b93-4a94-b431-9554e835d855 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:14.969545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec9d1e-ae59-429b-9440-cad87ab3202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:14.970159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec9d1e-ae59-429b-9440-cad87ab3202e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:14.970438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec9d1e-ae59-429b-9440-cad87ab3202e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:14.970805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec9d1e-ae59-429b-9440-cad87ab3202e None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:14.971484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec9d1e-ae59-429b-9440-cad87ab3202e None admin] RBAC: Adding query filter params (name=member) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:14.971783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec9d1e-ae59-429b-9440-cad87ab3202e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:14.973248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec9d1e-ae59-429b-9440-cad87ab3202e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:14.982791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 161/332] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:14.989116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf24b7-9b64-47dc-add4-aaab2da751b0 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:15.023324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:15.097823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf24b7-9b64-47dc-add4-aaab2da751b0 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:15.133518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30da4a-b910-47dd-93e3-5ae85ef944f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:15.134196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30da4a-b910-47dd-93e3-5ae85ef944f9 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:15.134477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30da4a-b910-47dd-93e3-5ae85ef944f9 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:15.134826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30da4a-b910-47dd-93e3-5ae85ef944f9 None admin] PATH_INFO: `/v3/users/5d47eb1dc0404e82aa99e69abcf45060` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:15.135980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30da4a-b910-47dd-93e3-5ae85ef944f9 None admin] RBAC: Authorizing `identity:get_user(user_id=5d47eb1dc0404e82aa99e69abcf45060)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:15.137447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30da4a-b910-47dd-93e3-5ae85ef944f9 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:15.139406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 172/333] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:14 2022] GET /identity/v3/users/5d47eb1dc0404e82aa99e69abcf45060 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:15.145326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec9d1e-ae59-429b-9440-cad87ab3202e None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:15.254536 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec9d1e-ae59-429b-9440-cad87ab3202e None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:15.290095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:15.296213 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413bf57-4770-4563-b583-d0fea31f712c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:15.296884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413bf57-4770-4563-b583-d0fea31f712c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:15.297168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413bf57-4770-4563-b583-d0fea31f712c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:15.297438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413bf57-4770-4563-b583-d0fea31f712c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:15.298227 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413bf57-4770-4563-b583-d0fea31f712c None admin] RBAC: Adding query filter params (role.id=d912a7e672bb441099f4ef85d61e7c46, user.id=5d47eb1dc0404e82aa99e69abcf45060, scope.system=all) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:15.298797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413bf57-4770-4563-b583-d0fea31f712c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:15.304111 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413bf57-4770-4563-b583-d0fea31f712c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:15.318095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 162/334] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 16 05:21:15 2022] GET /identity/v3/role_assignments?user.id=5d47eb1dc0404e82aa99e69abcf45060&scope.system=all&role.id=d912a7e672bb441099f4ef85d61e7c46 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:16.960929 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c6810-c0f8-45c9-975f-0cdd75c38b8e None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:16.961471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c6810-c0f8-45c9-975f-0cdd75c38b8e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:16.961555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c6810-c0f8-45c9-975f-0cdd75c38b8e None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:16.963187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 173/335] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:16.968409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99bcaf-d43b-430f-825b-1d1f5127d2b9 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:16.968806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99bcaf-d43b-430f-825b-1d1f5127d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:16.968971 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99bcaf-d43b-430f-825b-1d1f5127d2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:16.990442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8a99bcaf-d43b-430f-825b-1d1f5127d2b9 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:16.991744 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8a99bcaf-d43b-430f-825b-1d1f5127d2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:17.001829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15161329-7090-433c-a3f1-0de45e7b2726 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:17.002206 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15161329-7090-433c-a3f1-0de45e7b2726 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:17.002490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15161329-7090-433c-a3f1-0de45e7b2726 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:17.004135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 174/336] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:17.023963 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dd531-ed72-4fbc-92e3-5c5c0733e58a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:17.024249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dd531-ed72-4fbc-92e3-5c5c0733e58a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:17.024513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dd531-ed72-4fbc-92e3-5c5c0733e58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:17.054409 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-e95dd531-ed72-4fbc-92e3-5c5c0733e58a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:17.055645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e95dd531-ed72-4fbc-92e3-5c5c0733e58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:17.071947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 163/337] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:17.169214 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 175/338] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:21:17.690885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99bcaf-d43b-430f-825b-1d1f5127d2b9 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:17.700929 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dd531-ed72-4fbc-92e3-5c5c0733e58a None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:17.749736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:17.820136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99bcaf-d43b-430f-825b-1d1f5127d2b9 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:17.842703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:17.859877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c50b6-f237-43b3-ba48-5fd2af409c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:17.860873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c50b6-f237-43b3-ba48-5fd2af409c0f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:17.861295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c50b6-f237-43b3-ba48-5fd2af409c0f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:17.861710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c50b6-f237-43b3-ba48-5fd2af409c0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:17.892003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c50b6-f237-43b3-ba48-5fd2af409c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-791c50b6-f237-43b3-ba48-5fd2af409c0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:17.902812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:17.903900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:17.904858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:17.904858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:17.904858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:17.904858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:17.904858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:17.904858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:17.904858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:17.904858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:17.904858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:17.904858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:17.904858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:17.904858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:17.908179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 164/339] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:17.911850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dd531-ed72-4fbc-92e3-5c5c0733e58a None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:17.914866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c50b6-f237-43b3-ba48-5fd2af409c0f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:17.958161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1454f2-8d0e-4ae6-9dca-4d97a99e81c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:17.958754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1454f2-8d0e-4ae6-9dca-4d97a99e81c5 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:17.959035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1454f2-8d0e-4ae6-9dca-4d97a99e81c5 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:17.959317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1454f2-8d0e-4ae6-9dca-4d97a99e81c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:17.972899 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1454f2-8d0e-4ae6-9dca-4d97a99e81c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-cd1454f2-8d0e-4ae6-9dca-4d97a99e81c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:17.980240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:17.981336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:17.982314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:17.982314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:17.982314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:17.982314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:17.982314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:17.982314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:17.982314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:17.982314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:17.982314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:17.982314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:17.982314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:17.982314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:17.986032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 176/340] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:21:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:17.986338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797c1d6-9f6e-4b81-956c-080ce122636f None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:17.986675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797c1d6-9f6e-4b81-956c-080ce122636f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:17.986978 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797c1d6-9f6e-4b81-956c-080ce122636f None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:17.988776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 177/341] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:17.990519 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797c1d6-9f6e-4b81-956c-080ce122636f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:18.042338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c50b6-f237-43b3-ba48-5fd2af409c0f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:18.090700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0565e0c-6f6a-4584-a290-28c8da169017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:18.091653 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0565e0c-6f6a-4584-a290-28c8da169017 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:18.092137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0565e0c-6f6a-4584-a290-28c8da169017 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:18.092649 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0565e0c-6f6a-4584-a290-28c8da169017 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:18.093966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:18.095175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0565e0c-6f6a-4584-a290-28c8da169017 None admin] RBAC: Adding query filter params (name=member) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:18.096129 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0565e0c-6f6a-4584-a290-28c8da169017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:18.097990 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0565e0c-6f6a-4584-a290-28c8da169017 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:18.112863 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797c1d6-9f6e-4b81-956c-080ce122636f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:18.116293 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 165/342] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:18.117358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fb2f5-a847-4f1e-81f9-53c99f24f30b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:18.117640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fb2f5-a847-4f1e-81f9-53c99f24f30b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:18.117908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fb2f5-a847-4f1e-81f9-53c99f24f30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:18.139174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-bf9fb2f5-a847-4f1e-81f9-53c99f24f30b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:18.140382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-bf9fb2f5-a847-4f1e-81f9-53c99f24f30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:18.157232 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3f085-d775-4cb5-a810-92b47bc6163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:18.158179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3f085-d775-4cb5-a810-92b47bc6163e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:18.158694 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3f085-d775-4cb5-a810-92b47bc6163e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:18.159248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3f085-d775-4cb5-a810-92b47bc6163e None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:18.160118 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3f085-d775-4cb5-a810-92b47bc6163e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:18.160622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3f085-d775-4cb5-a810-92b47bc6163e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:18.162223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3f085-d775-4cb5-a810-92b47bc6163e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:18.172274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 178/343] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:18.173472 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3f085-d775-4cb5-a810-92b47bc6163e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:18.173770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:18.230248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 166/344] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:18.231361 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9a638-81b5-4c1b-8311-81bafcd4604f None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:18.231585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9a638-81b5-4c1b-8311-81bafcd4604f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:18.231858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9a638-81b5-4c1b-8311-81bafcd4604f None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:18.233454 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 167/345] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:18.234114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9a638-81b5-4c1b-8311-81bafcd4604f None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:18.321547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3f085-d775-4cb5-a810-92b47bc6163e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:18.349081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9a638-81b5-4c1b-8311-81bafcd4604f None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:18.364435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae88dbd-daeb-481d-99f3-b26ea662834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:18.365484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae88dbd-daeb-481d-99f3-b26ea662834c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:18.366018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae88dbd-daeb-481d-99f3-b26ea662834c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:18.366490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae88dbd-daeb-481d-99f3-b26ea662834c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:18.387574 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a59d4-c066-42ba-9cfb-7ab39ce62ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:18.388279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a59d4-c066-42ba-9cfb-7ab39ce62ec1 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:18.388561 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a59d4-c066-42ba-9cfb-7ab39ce62ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:18.388885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a59d4-c066-42ba-9cfb-7ab39ce62ec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:18.389426 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:18.423488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:18.453599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae88dbd-daeb-481d-99f3-b26ea662834c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:18.455699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae88dbd-daeb-481d-99f3-b26ea662834c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:18.467153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a59d4-c066-42ba-9cfb-7ab39ce62ec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:18.470444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a59d4-c066-42ba-9cfb-7ab39ce62ec1 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:18.586462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 179/346] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:18.587558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56787182-cf93-4085-ad17-051b8c2ad8f6 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:18.587850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56787182-cf93-4085-ad17-051b8c2ad8f6 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:18.588136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56787182-cf93-4085-ad17-051b8c2ad8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:18.614604 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 168/347] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:18.615922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a59d4-c066-42ba-9cfb-7ab39ce62ec1 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:18.624306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-56787182-cf93-4085-ad17-051b8c2ad8f6 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:18.630762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-56787182-cf93-4085-ad17-051b8c2ad8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:18.699831 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:18.721021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 180/348] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:18.722885 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56787182-cf93-4085-ad17-051b8c2ad8f6 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:18.750298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:18.797874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a59d4-c066-42ba-9cfb-7ab39ce62ec1 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:18.843497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b1721-e504-4f34-9944-843f0bb904b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:18.844713 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1721-e504-4f34-9944-843f0bb904b1 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:18.845633 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1721-e504-4f34-9944-843f0bb904b1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:18.846238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1721-e504-4f34-9944-843f0bb904b1 None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:18.848463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b1721-e504-4f34-9944-843f0bb904b1 None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:18.850237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b1721-e504-4f34-9944-843f0bb904b1 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:18.851754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56787182-cf93-4085-ad17-051b8c2ad8f6 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:18.852810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 169/349] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:18 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:18.854774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b1721-e504-4f34-9944-843f0bb904b1 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:18.890777 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88d7fa-62f3-4bb5-9e3b-74656c9824a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:18.891413 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88d7fa-62f3-4bb5-9e3b-74656c9824a4 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:18.891690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88d7fa-62f3-4bb5-9e3b-74656c9824a4 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:18.891959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88d7fa-62f3-4bb5-9e3b-74656c9824a4 None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:18.893104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88d7fa-62f3-4bb5-9e3b-74656c9824a4 None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:18.895133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88d7fa-62f3-4bb5-9e3b-74656c9824a4 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:18.896750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 181/350] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:18 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:18.897928 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305c23f-0145-4a69-aab1-771379362734 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:18.898208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305c23f-0145-4a69-aab1-771379362734 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:18.898476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305c23f-0145-4a69-aab1-771379362734 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:18.900468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 182/351] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:18.900684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305c23f-0145-4a69-aab1-771379362734 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:18.967078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:18.988380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b1721-e504-4f34-9944-843f0bb904b1 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:19.029148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:19.036732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc000-68cc-4e96-9d5a-e05025424618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:19.037373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc000-68cc-4e96-9d5a-e05025424618 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:19.037649 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc000-68cc-4e96-9d5a-e05025424618 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:19.037906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc000-68cc-4e96-9d5a-e05025424618 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:19.048688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305c23f-0145-4a69-aab1-771379362734 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:19.055736 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cc000-68cc-4e96-9d5a-e05025424618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-802cc000-68cc-4e96-9d5a-e05025424618 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:19.062258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:19.063221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:19.064284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:19.064284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:19.064284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:19.064284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:19.064284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:19.064284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:19.064284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:19.064284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:19.064284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:19.064284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:19.064284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 05:21:19.064284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:19.064284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 170/352] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:19.064941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc000-68cc-4e96-9d5a-e05025424618 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:19.093021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c0ab4-9ef8-4523-9acf-1f7d643d7cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:19.093720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c0ab4-9ef8-4523-9acf-1f7d643d7cda None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:19.093935 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c0ab4-9ef8-4523-9acf-1f7d643d7cda None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:19.094206 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c0ab4-9ef8-4523-9acf-1f7d643d7cda None admin] PATH_INFO: `/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:19.100619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c0ab4-9ef8-4523-9acf-1f7d643d7cda None admin] RBAC: Authorizing `identity:get_group(group_id=4ff274b280d44c49a8c6d253a8fc20d0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:19.102075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c0ab4-9ef8-4523-9acf-1f7d643d7cda None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:19.103755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 183/353] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:18 2022] GET /identity/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:19.104900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b261d-1644-4cdb-af42-c95a8d446ae9 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:19.105172 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b261d-1644-4cdb-af42-c95a8d446ae9 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:19.105504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b261d-1644-4cdb-af42-c95a8d446ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:19.127060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-822b261d-1644-4cdb-af42-c95a8d446ae9 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:19.129117 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-822b261d-1644-4cdb-af42-c95a8d446ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:19.186275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc000-68cc-4e96-9d5a-e05025424618 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:19.212071 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 184/354] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:19.212972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b261d-1644-4cdb-af42-c95a8d446ae9 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:19.225772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53668b33-ceaa-499e-9934-87391d24ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:19.226412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53668b33-ceaa-499e-9934-87391d24ccfa None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:19.226721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53668b33-ceaa-499e-9934-87391d24ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:19.226994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53668b33-ceaa-499e-9934-87391d24ccfa None admin] PATH_INFO: `/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:19.228142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53668b33-ceaa-499e-9934-87391d24ccfa None admin] RBAC: Authorizing `identity:get_group(group_id=4ff274b280d44c49a8c6d253a8fc20d0)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:19.229611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53668b33-ceaa-499e-9934-87391d24ccfa None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:19.231419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 171/355] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:19 2022] GET /identity/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:19.231998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53668b33-ceaa-499e-9934-87391d24ccfa None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:19.278236 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:19.307330 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:19.356643 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b261d-1644-4cdb-af42-c95a8d446ae9 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:19.359759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53668b33-ceaa-499e-9934-87391d24ccfa None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:19.407868 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9bf96-4c44-475f-a9b2-33852103c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:19.408591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9bf96-4c44-475f-a9b2-33852103c3de None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:19.408893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9bf96-4c44-475f-a9b2-33852103c3de None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:19.409242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9bf96-4c44-475f-a9b2-33852103c3de None admin] PATH_INFO: `/v3/roles/member` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:19.409920 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34380cc-73e4-4ecb-bb4b-b34a21dc564a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:19.410824 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34380cc-73e4-4ecb-bb4b-b34a21dc564a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:19.411414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34380cc-73e4-4ecb-bb4b-b34a21dc564a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:19.412003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34380cc-73e4-4ecb-bb4b-b34a21dc564a None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:19.412869 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34380cc-73e4-4ecb-bb4b-b34a21dc564a None admin] RBAC: Adding query filter params (name=reader) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:19.413372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34380cc-73e4-4ecb-bb4b-b34a21dc564a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:19.415004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34380cc-73e4-4ecb-bb4b-b34a21dc564a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:19.420938 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9bf96-4c44-475f-a9b2-33852103c3de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:19.426745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 172/356] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-2ca9bf96-4c44-475f-a9b2-33852103c3de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:19.427547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:19.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:19.429217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:19.429217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:19.429217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:19.429217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:19.429217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:19.429217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:19.429217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:19.429217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:19.429217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:19.429217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:19.429217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:19.429217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:19.429217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 185/357] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:19.429894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9bf96-4c44-475f-a9b2-33852103c3de None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:19.431221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d293f-bfa9-4165-bef2-b00f22558253 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:19.431723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d293f-bfa9-4165-bef2-b00f22558253 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:19.432201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d293f-bfa9-4165-bef2-b00f22558253 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:19.434055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 173/358] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:19.435060 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d293f-bfa9-4165-bef2-b00f22558253 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:19.554465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9bf96-4c44-475f-a9b2-33852103c3de None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:19.556084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:19.565412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d293f-bfa9-4165-bef2-b00f22558253 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:19.593097 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a0bc0-c483-4159-8448-fe41bc0058e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:19.593686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:19.593811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a0bc0-c483-4159-8448-fe41bc0058e0 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:19.593994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a0bc0-c483-4159-8448-fe41bc0058e0 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:19.594233 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a0bc0-c483-4159-8448-fe41bc0058e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:19.595364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a0bc0-c483-4159-8448-fe41bc0058e0 None admin] RBAC: Adding query filter params (group.id=4ff274b280d44c49a8c6d253a8fc20d0, role.id=d912a7e672bb441099f4ef85d61e7c46, scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:19.595765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a0bc0-c483-4159-8448-fe41bc0058e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:19.597867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a0bc0-c483-4159-8448-fe41bc0058e0 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:19.603979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 186/359] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 05:21:19 2022] GET /identity/v3/role_assignments?group.id=4ff274b280d44c49a8c6d253a8fc20d0&scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695&role.id=d912a7e672bb441099f4ef85d61e7c46 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:19.604782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a0bc0-c483-4159-8448-fe41bc0058e0 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:19.610566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a277e-4ada-4702-b13a-e9d844e21099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:19.611130 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a277e-4ada-4702-b13a-e9d844e21099 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:19.611406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a277e-4ada-4702-b13a-e9d844e21099 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:19.611670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a277e-4ada-4702-b13a-e9d844e21099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:19.612935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a277e-4ada-4702-b13a-e9d844e21099 None admin] RBAC: Adding query filter params (group.id=4ff274b280d44c49a8c6d253a8fc20d0, role.id=49763e40fa024aaa9522c00cea577eca, scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:19.613242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a277e-4ada-4702-b13a-e9d844e21099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:19.616678 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a277e-4ada-4702-b13a-e9d844e21099 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:19.630746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 174/360] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 05:21:19 2022] GET /identity/v3/role_assignments?group.id=4ff274b280d44c49a8c6d253a8fc20d0&scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695&role.id=49763e40fa024aaa9522c00cea577eca => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:19.630746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a277e-4ada-4702-b13a-e9d844e21099 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:19.779176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a277e-4ada-4702-b13a-e9d844e21099 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:19.799187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a0bc0-c483-4159-8448-fe41bc0058e0 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:19.826052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e88049-029b-4018-bfd6-5cefde9e3054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:19.826850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e88049-029b-4018-bfd6-5cefde9e3054 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:19.827133 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e88049-029b-4018-bfd6-5cefde9e3054 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:19.827407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e88049-029b-4018-bfd6-5cefde9e3054 None admin] PATH_INFO: `/v3/users/61decdb33fa8495487c6befab3546816` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:19.829107 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e88049-029b-4018-bfd6-5cefde9e3054 None admin] RBAC: Authorizing `identity:get_user(user_id=61decdb33fa8495487c6befab3546816)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:19.830747 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e88049-029b-4018-bfd6-5cefde9e3054 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:19.833438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 175/361] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:21:19 2022] GET /identity/v3/users/61decdb33fa8495487c6befab3546816 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:19.834350 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faaf6c-6c38-45a5-a5b1-c2df01801153 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:19.835697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faaf6c-6c38-45a5-a5b1-c2df01801153 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:19.835986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faaf6c-6c38-45a5-a5b1-c2df01801153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:19.849537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c799f-c0b9-4f0c-a322-9ebe7c4d8a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:19.850456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c799f-c0b9-4f0c-a322-9ebe7c4d8a81 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:19.850934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c799f-c0b9-4f0c-a322-9ebe7c4d8a81 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:19.853237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c799f-c0b9-4f0c-a322-9ebe7c4d8a81 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:19.853237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c799f-c0b9-4f0c-a322-9ebe7c4d8a81 None admin] RBAC: Adding query filter params (name=member) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:19.853237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c799f-c0b9-4f0c-a322-9ebe7c4d8a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:19.854151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c799f-c0b9-4f0c-a322-9ebe7c4d8a81 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:19.860488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c3faaf6c-6c38-45a5-a5b1-c2df01801153 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:19.861996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c3faaf6c-6c38-45a5-a5b1-c2df01801153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:19.865053 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 187/362] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:19.866983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c799f-c0b9-4f0c-a322-9ebe7c4d8a81 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:19.903657 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:19.925571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:19.950645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 176/363] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:19.951866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faaf6c-6c38-45a5-a5b1-c2df01801153 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:19.985776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c799f-c0b9-4f0c-a322-9ebe7c4d8a81 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:20.021416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c319d-5ba2-44fa-8e45-2d2a65a79243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:20.026603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c319d-5ba2-44fa-8e45-2d2a65a79243 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:20.026603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c319d-5ba2-44fa-8e45-2d2a65a79243 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:20.026603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c319d-5ba2-44fa-8e45-2d2a65a79243 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:20.039153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c319d-5ba2-44fa-8e45-2d2a65a79243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-4b1c319d-5ba2-44fa-8e45-2d2a65a79243 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:20.045187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:20.046090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:20.046914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:20.046914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:20.046914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:20.046914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:20.046914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:20.046914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:20.046914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:20.046914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:20.046914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:20.046914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:20.046914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:20.046914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:20.048729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 188/364] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:21:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:20.050673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c319d-5ba2-44fa-8e45-2d2a65a79243 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:20.157242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faaf6c-6c38-45a5-a5b1-c2df01801153 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:20.183069 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:20.193561 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c319d-5ba2-44fa-8e45-2d2a65a79243 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:20.237306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5932f-c8ab-46e8-8ac7-cc129d091e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:20.238163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5932f-c8ab-46e8-8ac7-cc129d091e1f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:20.238613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5932f-c8ab-46e8-8ac7-cc129d091e1f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:20.239013 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5932f-c8ab-46e8-8ac7-cc129d091e1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:20.271255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aa4db-7881-4cf6-a9a6-27a8d27eef61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:20.271877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa4db-7881-4cf6-a9a6-27a8d27eef61 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:20.272155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa4db-7881-4cf6-a9a6-27a8d27eef61 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:20.272428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa4db-7881-4cf6-a9a6-27a8d27eef61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:20.273167 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aa4db-7881-4cf6-a9a6-27a8d27eef61 None admin] RBAC: Adding query filter params (role.id=1032cdf216bb48c38c1c98860da25d9f, user.id=61decdb33fa8495487c6befab3546816, scope.system=all) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:20.273474 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aa4db-7881-4cf6-a9a6-27a8d27eef61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:20.274963 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aa4db-7881-4cf6-a9a6-27a8d27eef61 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:20.302081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 177/365] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 16 05:21:19 2022] GET /identity/v3/role_assignments?user.id=61decdb33fa8495487c6befab3546816&scope.system=all&role.id=1032cdf216bb48c38c1c98860da25d9f => generated 510 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:20.302953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aa4db-7881-4cf6-a9a6-27a8d27eef61 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:20.322657 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5932f-c8ab-46e8-8ac7-cc129d091e1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:20.324488 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5932f-c8ab-46e8-8ac7-cc129d091e1f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:20.364131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:20.435390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aa4db-7881-4cf6-a9a6-27a8d27eef61 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:20.442901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:20.453610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 189/366] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:20.454485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5932f-c8ab-46e8-8ac7-cc129d091e1f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:20.481727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6056a88-e95d-4428-a179-b68a5f68bb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:20.482346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6056a88-e95d-4428-a179-b68a5f68bb48 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:20.482669 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6056a88-e95d-4428-a179-b68a5f68bb48 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:20.482982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6056a88-e95d-4428-a179-b68a5f68bb48 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:20.483662 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6056a88-e95d-4428-a179-b68a5f68bb48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:20.483971 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6056a88-e95d-4428-a179-b68a5f68bb48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:20.485353 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6056a88-e95d-4428-a179-b68a5f68bb48 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:20.495286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 178/367] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:20.496144 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6056a88-e95d-4428-a179-b68a5f68bb48 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:20.578787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5932f-c8ab-46e8-8ac7-cc129d091e1f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:20.618552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6056a88-e95d-4428-a179-b68a5f68bb48 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:20.621335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:20.629023 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713a457-2c4a-4929-b223-d4d9d356fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:20.630436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713a457-2c4a-4929-b223-d4d9d356fbae None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:20.630959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713a457-2c4a-4929-b223-d4d9d356fbae None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:20.631426 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713a457-2c4a-4929-b223-d4d9d356fbae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:20.646668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713a457-2c4a-4929-b223-d4d9d356fbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-a713a457-2c4a-4929-b223-d4d9d356fbae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:20.653604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:20.654566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:20.655369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:20.655369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:20.655369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:20.655369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:20.655369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:20.655369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:20.655369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:20.655369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:20.655369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:20.655369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:20.655369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:21:20.655369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:20.656815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 190/368] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:21:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:20.656928 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713a457-2c4a-4929-b223-d4d9d356fbae None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:20.677844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983b4b4-8b64-4263-a388-d353058fefb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:20.679265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983b4b4-8b64-4263-a388-d353058fefb0 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:20.680005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983b4b4-8b64-4263-a388-d353058fefb0 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:20.680475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983b4b4-8b64-4263-a388-d353058fefb0 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:20.681858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983b4b4-8b64-4263-a388-d353058fefb0 None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:20.683678 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983b4b4-8b64-4263-a388-d353058fefb0 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:20.686305 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 179/369] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:20 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:20.687306 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983b4b4-8b64-4263-a388-d353058fefb0 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:20.730702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:20.800460 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713a457-2c4a-4929-b223-d4d9d356fbae None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:20.814543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983b4b4-8b64-4263-a388-d353058fefb0 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:20.843304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1944277-a101-41f3-a65f-09edf58dc8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:20.844253 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1944277-a101-41f3-a65f-09edf58dc8fe None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:20.844732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1944277-a101-41f3-a65f-09edf58dc8fe None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:20.845198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1944277-a101-41f3-a65f-09edf58dc8fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:20.852120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb1667-d4ba-4080-9b25-faefc49bcb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:20.852746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1667-d4ba-4080-9b25-faefc49bcb3d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:20.853034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1667-d4ba-4080-9b25-faefc49bcb3d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:20.853312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1667-d4ba-4080-9b25-faefc49bcb3d None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:20.854023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb1667-d4ba-4080-9b25-faefc49bcb3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:20.854335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb1667-d4ba-4080-9b25-faefc49bcb3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:20.855822 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb1667-d4ba-4080-9b25-faefc49bcb3d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:20.866479 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 180/370] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:20.867400 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb1667-d4ba-4080-9b25-faefc49bcb3d None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:20.907161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:20.925380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1944277-a101-41f3-a65f-09edf58dc8fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:20.927972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1944277-a101-41f3-a65f-09edf58dc8fe None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:20.979571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:20.983881 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb1667-d4ba-4080-9b25-faefc49bcb3d None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:21.020688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6eb870-69bb-4fef-9428-fccbd1dce214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:21.021321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb870-69bb-4fef-9428-fccbd1dce214 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:21.021602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb870-69bb-4fef-9428-fccbd1dce214 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:21.021935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb870-69bb-4fef-9428-fccbd1dce214 None admin] PATH_INFO: `/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:21.023095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6eb870-69bb-4fef-9428-fccbd1dce214 None admin] RBAC: Authorizing `identity:get_group(group_id=4ff274b280d44c49a8c6d253a8fc20d0)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:21.024535 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6eb870-69bb-4fef-9428-fccbd1dce214 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:21.026418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 181/371] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:20 2022] GET /identity/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:21.027053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6eb870-69bb-4fef-9428-fccbd1dce214 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:21.044177 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 191/372] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:21.045420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1944277-a101-41f3-a65f-09edf58dc8fe None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:21.138603 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6eb870-69bb-4fef-9428-fccbd1dce214 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:21.140164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:21.164027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1944277-a101-41f3-a65f-09edf58dc8fe None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:21.179641 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c7b05-9a5d-46f4-9828-3f8618fa13c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:21.180292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c7b05-9a5d-46f4-9828-3f8618fa13c4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:21.180590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c7b05-9a5d-46f4-9828-3f8618fa13c4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:21.181131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c7b05-9a5d-46f4-9828-3f8618fa13c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:21.205114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77c3a3-0411-479d-b275-4cd9e36f75ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:21.207672 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77c3a3-0411-479d-b275-4cd9e36f75ae None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:21.208160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77c3a3-0411-479d-b275-4cd9e36f75ae None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:21.208680 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77c3a3-0411-479d-b275-4cd9e36f75ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:21.209703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77c3a3-0411-479d-b275-4cd9e36f75ae None admin] RBAC: Adding query filter params (group.id=4ff274b280d44c49a8c6d253a8fc20d0, role.id=d912a7e672bb441099f4ef85d61e7c46, scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:21.210289 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77c3a3-0411-479d-b275-4cd9e36f75ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:21.212183 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77c3a3-0411-479d-b275-4cd9e36f75ae None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:21.219668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 192/373] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 05:21:21 2022] GET /identity/v3/role_assignments?group.id=4ff274b280d44c49a8c6d253a8fc20d0&scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e&role.id=d912a7e672bb441099f4ef85d61e7c46 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:21.220812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77c3a3-0411-479d-b275-4cd9e36f75ae None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:21.243167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:21.277655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c7b05-9a5d-46f4-9828-3f8618fa13c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:21.285429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c7b05-9a5d-46f4-9828-3f8618fa13c4 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:21.344939 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77c3a3-0411-479d-b275-4cd9e36f75ae None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:21.392828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b0f9f-702f-45e7-b28c-97d89ffe8c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:21.393985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b0f9f-702f-45e7-b28c-97d89ffe8c18 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:21.394592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b0f9f-702f-45e7-b28c-97d89ffe8c18 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:21.395073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b0f9f-702f-45e7-b28c-97d89ffe8c18 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:21.396546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b0f9f-702f-45e7-b28c-97d89ffe8c18 None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:21.403795 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b0f9f-702f-45e7-b28c-97d89ffe8c18 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:21.406558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 193/374] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:21 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:21.412344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b0f9f-702f-45e7-b28c-97d89ffe8c18 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:21.427029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 182/375] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:21.432697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c7b05-9a5d-46f4-9828-3f8618fa13c4 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:21.435253 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:21.547561 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c7b05-9a5d-46f4-9828-3f8618fa13c4 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:21.564128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:21.589415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b0f9f-702f-45e7-b28c-97d89ffe8c18 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:21.590335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02657f7-e0dd-40e1-bf1c-3c75c01ffe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:21.591244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02657f7-e0dd-40e1-bf1c-3c75c01ffe1e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:21.591726 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02657f7-e0dd-40e1-bf1c-3c75c01ffe1e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:21.592106 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02657f7-e0dd-40e1-bf1c-3c75c01ffe1e None admin] PATH_INFO: `/v3/projects/7a0a847de7a845db8a359724caa6c1da` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:21.593365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02657f7-e0dd-40e1-bf1c-3c75c01ffe1e None admin] RBAC: Authorizing `identity:get_project(project_id=7a0a847de7a845db8a359724caa6c1da)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:21.594967 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02657f7-e0dd-40e1-bf1c-3c75c01ffe1e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:21.598098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 183/376] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:21 2022] GET /identity/v3/projects/7a0a847de7a845db8a359724caa6c1da => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:21.604263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02657f7-e0dd-40e1-bf1c-3c75c01ffe1e None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:21.635036 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0075fd-2438-4875-bdad-18b8f369203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:21.635675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0075fd-2438-4875-bdad-18b8f369203a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:21.635952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0075fd-2438-4875-bdad-18b8f369203a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:21.636222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0075fd-2438-4875-bdad-18b8f369203a None admin] PATH_INFO: `/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:21.639228 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0075fd-2438-4875-bdad-18b8f369203a None admin] RBAC: Authorizing `identity:get_group(group_id=4ff274b280d44c49a8c6d253a8fc20d0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:21.640874 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0075fd-2438-4875-bdad-18b8f369203a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:21.642708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 194/377] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:21 2022] GET /identity/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:21.648367 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0075fd-2438-4875-bdad-18b8f369203a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:21.702878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:21.722202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02657f7-e0dd-40e1-bf1c-3c75c01ffe1e None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:21.763066 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be709a86-ee15-45ed-8e9e-dce63167c374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:21.763958 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be709a86-ee15-45ed-8e9e-dce63167c374 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:21.764346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be709a86-ee15-45ed-8e9e-dce63167c374 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:21.764783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be709a86-ee15-45ed-8e9e-dce63167c374 None admin] PATH_INFO: `/v3/groups/6a0ece966ee7433588e150373dc00bfe` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:21.772292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be709a86-ee15-45ed-8e9e-dce63167c374 None admin] RBAC: Authorizing `identity:get_group(group_id=6a0ece966ee7433588e150373dc00bfe)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:21.774111 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be709a86-ee15-45ed-8e9e-dce63167c374 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:21.776246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 184/378] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:21 2022] GET /identity/v3/groups/6a0ece966ee7433588e150373dc00bfe => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:21.781566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be709a86-ee15-45ed-8e9e-dce63167c374 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:21.863300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0075fd-2438-4875-bdad-18b8f369203a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:21.937233 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9391f5e-cc3e-4e3c-9e1d-b45b2135b486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:21.937847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9391f5e-cc3e-4e3c-9e1d-b45b2135b486 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:21.938128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9391f5e-cc3e-4e3c-9e1d-b45b2135b486 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:21.938772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9391f5e-cc3e-4e3c-9e1d-b45b2135b486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:21.939459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9391f5e-cc3e-4e3c-9e1d-b45b2135b486 None admin] RBAC: Adding query filter params (group.id=4ff274b280d44c49a8c6d253a8fc20d0, role.id=49763e40fa024aaa9522c00cea577eca, scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:21.939765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9391f5e-cc3e-4e3c-9e1d-b45b2135b486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:21.943243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9391f5e-cc3e-4e3c-9e1d-b45b2135b486 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:21.956954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 195/379] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 05:21:21 2022] GET /identity/v3/role_assignments?group.id=4ff274b280d44c49a8c6d253a8fc20d0&scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e&role.id=49763e40fa024aaa9522c00cea577eca => generated 260 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:21.968616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be709a86-ee15-45ed-8e9e-dce63167c374 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:22.007676 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7537ef8-3d20-43ec-b982-7d86d46f7bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:22.008296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7537ef8-3d20-43ec-b982-7d86d46f7bd3 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:22.008581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7537ef8-3d20-43ec-b982-7d86d46f7bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:22.008855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7537ef8-3d20-43ec-b982-7d86d46f7bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:22.009606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7537ef8-3d20-43ec-b982-7d86d46f7bd3 None admin] RBAC: Adding query filter params (group.id=6a0ece966ee7433588e150373dc00bfe, role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=7a0a847de7a845db8a359724caa6c1da) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:22.009915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7537ef8-3d20-43ec-b982-7d86d46f7bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:22.011438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7537ef8-3d20-43ec-b982-7d86d46f7bd3 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:22.013543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:22.018247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 185/380] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 05:21:21 2022] GET /identity/v3/role_assignments?group.id=6a0ece966ee7433588e150373dc00bfe&scope.project.id=7a0a847de7a845db8a359724caa6c1da&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:22.403095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b4cc8-c035-494f-9eae-1cd3770cae22 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:22.403617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b4cc8-c035-494f-9eae-1cd3770cae22 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:22.403617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b4cc8-c035-494f-9eae-1cd3770cae22 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:22.405404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 196/381] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:22.411991 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662114b1-d680-417f-b388-cbc33938eac8 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:22.412542 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662114b1-d680-417f-b388-cbc33938eac8 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:22.412542 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662114b1-d680-417f-b388-cbc33938eac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:22.432675 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-662114b1-d680-417f-b388-cbc33938eac8 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:22.433874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-662114b1-d680-417f-b388-cbc33938eac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:22.526313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 186/382] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:21:22.527678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62acce-2a3c-4ad3-bfec-56697433a8d3 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:22.527963 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62acce-2a3c-4ad3-bfec-56697433a8d3 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:22.528260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62acce-2a3c-4ad3-bfec-56697433a8d3 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:22.529594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 197/383] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:22.534972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b3c09-046d-48a2-b455-739717a91ad3 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:22.535259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b3c09-046d-48a2-b455-739717a91ad3 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:22.535538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b3c09-046d-48a2-b455-739717a91ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:22.555162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-bd1b3c09-046d-48a2-b455-739717a91ad3 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:22.556373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-bd1b3c09-046d-48a2-b455-739717a91ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:22.634728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 187/384] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:22.825656 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62acce-2a3c-4ad3-bfec-56697433a8d3 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:22.843452 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:22.947773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62acce-2a3c-4ad3-bfec-56697433a8d3 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:22.951343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b3c09-046d-48a2-b455-739717a91ad3 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:23.006328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840a4b0-a4dd-458b-8542-f651688dc223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:23.006991 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840a4b0-a4dd-458b-8542-f651688dc223 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:23.008043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840a4b0-a4dd-458b-8542-f651688dc223 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:23.008043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840a4b0-a4dd-458b-8542-f651688dc223 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:23.034024 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840a4b0-a4dd-458b-8542-f651688dc223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-e840a4b0-a4dd-458b-8542-f651688dc223 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:23.039623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:23.040506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:23.041588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:23.041588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:23.041588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:23.041588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:23.041588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:23.041588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:23.041588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:23.041588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:23.041588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:23.041588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:23.041588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:23.041588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:23.041588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 198/385] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:21:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:23.049601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840a4b0-a4dd-458b-8542-f651688dc223 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:23.072585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:23.157574 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b3c09-046d-48a2-b455-739717a91ad3 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:23.185936 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:23.203439 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c569d15-22e9-4f44-beb4-9bbf48e081f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:23.204212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c569d15-22e9-4f44-beb4-9bbf48e081f9 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:23.204715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c569d15-22e9-4f44-beb4-9bbf48e081f9 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:23.205040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c569d15-22e9-4f44-beb4-9bbf48e081f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:23.216464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c569d15-22e9-4f44-beb4-9bbf48e081f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:23.221362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840a4b0-a4dd-458b-8542-f651688dc223 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-9c569d15-22e9-4f44-beb4-9bbf48e081f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:23.222018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:23.225084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:23.225906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:23.225906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:23.225906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:23.225906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:23.225906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:23.225906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:23.225906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:23.225906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:23.225906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:23.225906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:23.225906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:23.225906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:23.226734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 188/386] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:23.230690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c569d15-22e9-4f44-beb4-9bbf48e081f9 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:23.265437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca04d9a-f85b-44ba-aeff-683a75e7ec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:23.266365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca04d9a-f85b-44ba-aeff-683a75e7ec16 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:23.266890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca04d9a-f85b-44ba-aeff-683a75e7ec16 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:23.267357 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca04d9a-f85b-44ba-aeff-683a75e7ec16 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:23.268260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca04d9a-f85b-44ba-aeff-683a75e7ec16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:23.268839 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca04d9a-f85b-44ba-aeff-683a75e7ec16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:23.270525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca04d9a-f85b-44ba-aeff-683a75e7ec16 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:23.279691 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 199/387] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:23.285454 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca04d9a-f85b-44ba-aeff-683a75e7ec16 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:23.424393 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c569d15-22e9-4f44-beb4-9bbf48e081f9 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:23.452801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:23.473849 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca04d9a-f85b-44ba-aeff-683a75e7ec16 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:23.489147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39737f-b1e3-4d8b-8f4a-e7e87ce8a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:23.490230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39737f-b1e3-4d8b-8f4a-e7e87ce8a254 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:23.490686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39737f-b1e3-4d8b-8f4a-e7e87ce8a254 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:23.491093 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39737f-b1e3-4d8b-8f4a-e7e87ce8a254 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:23.492677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39737f-b1e3-4d8b-8f4a-e7e87ce8a254 None admin] RBAC: Adding query filter params (name=member) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:23.493134 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39737f-b1e3-4d8b-8f4a-e7e87ce8a254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:23.495193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39737f-b1e3-4d8b-8f4a-e7e87ce8a254 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:23.505014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 189/388] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:23.511254 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39737f-b1e3-4d8b-8f4a-e7e87ce8a254 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:23.570798 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecd2f0-0f90-43ed-a0f4-c1b8199c963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:23.572575 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd2f0-0f90-43ed-a0f4-c1b8199c963e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:23.573179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd2f0-0f90-43ed-a0f4-c1b8199c963e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:23.574890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd2f0-0f90-43ed-a0f4-c1b8199c963e None admin] PATH_INFO: `/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:23.576246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecd2f0-0f90-43ed-a0f4-c1b8199c963e None admin] RBAC: Authorizing `identity:get_group(group_id=4ff274b280d44c49a8c6d253a8fc20d0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:23.579038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecd2f0-0f90-43ed-a0f4-c1b8199c963e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:23.583058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 200/389] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:23 2022] GET /identity/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0 => generated 226 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:23.589475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecd2f0-0f90-43ed-a0f4-c1b8199c963e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:23.592639 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:23.667031 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39737f-b1e3-4d8b-8f4a-e7e87ce8a254 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:23.718092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503b10c-ab9b-4dc9-9066-7c2fca3002a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:23.718693 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503b10c-ab9b-4dc9-9066-7c2fca3002a5 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:23.718981 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503b10c-ab9b-4dc9-9066-7c2fca3002a5 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:23.719238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503b10c-ab9b-4dc9-9066-7c2fca3002a5 None admin] PATH_INFO: `/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:23.721104 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503b10c-ab9b-4dc9-9066-7c2fca3002a5 None admin] RBAC: Authorizing `identity:get_group(group_id=4ff274b280d44c49a8c6d253a8fc20d0)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:23.723577 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503b10c-ab9b-4dc9-9066-7c2fca3002a5 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:23.726641 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 190/390] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:23 2022] GET /identity/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:23.732834 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503b10c-ab9b-4dc9-9066-7c2fca3002a5 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:23.790941 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecd2f0-0f90-43ed-a0f4-c1b8199c963e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:23.823105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:23.853335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae72269-d2f9-4569-a103-fd1f357346e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:23.854081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae72269-d2f9-4569-a103-fd1f357346e7 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:23.854367 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae72269-d2f9-4569-a103-fd1f357346e7 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:23.854675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae72269-d2f9-4569-a103-fd1f357346e7 None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:23.856787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae72269-d2f9-4569-a103-fd1f357346e7 None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:23.858256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae72269-d2f9-4569-a103-fd1f357346e7 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:23.859917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 201/391] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:23 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:23.866900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae72269-d2f9-4569-a103-fd1f357346e7 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:23.918666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503b10c-ab9b-4dc9-9066-7c2fca3002a5 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:23.981382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615784b-86db-4a99-9bd6-b8b6d96d67bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:23.983076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615784b-86db-4a99-9bd6-b8b6d96d67bc None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:23.983373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615784b-86db-4a99-9bd6-b8b6d96d67bc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:23.983634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615784b-86db-4a99-9bd6-b8b6d96d67bc None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:23.985846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615784b-86db-4a99-9bd6-b8b6d96d67bc None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:23.988881 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615784b-86db-4a99-9bd6-b8b6d96d67bc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:23.990947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 191/392] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:23 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:23.996442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615784b-86db-4a99-9bd6-b8b6d96d67bc None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:24.006872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:24.051685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae72269-d2f9-4569-a103-fd1f357346e7 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:24.106755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ae2a0-2a9a-4398-83ad-e2a39132d8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:24.107517 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ae2a0-2a9a-4398-83ad-e2a39132d8bc None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:24.108080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ae2a0-2a9a-4398-83ad-e2a39132d8bc None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:24.108362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ae2a0-2a9a-4398-83ad-e2a39132d8bc None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695/groups/4ff274b280d44c49a8c6d253a8fc20d0/roles/49763e40fa024aaa9522c00cea577eca` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:24.110814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ae2a0-2a9a-4398-83ad-e2a39132d8bc None admin] RBAC: Authorizing `identity:create_grant(project_id=2d2682aa15ad4d469e37e5c1e8c4a695, group_id=4ff274b280d44c49a8c6d253a8fc20d0, role_id=49763e40fa024aaa9522c00cea577eca)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:24.112316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ae2a0-2a9a-4398-83ad-e2a39132d8bc None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:24.134973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 202/393] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 16 05:21:23 2022] PUT /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695/groups/4ff274b280d44c49a8c6d253a8fc20d0/roles/49763e40fa024aaa9522c00cea577eca => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:24.179980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7435f-0502-435b-87f9-adc4f81137dd None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:24.179980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7435f-0502-435b-87f9-adc4f81137dd None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:24.180418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7435f-0502-435b-87f9-adc4f81137dd None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:24.180799 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615784b-86db-4a99-9bd6-b8b6d96d67bc None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:24.181954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 203/394] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:21:24.189509 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c68a1d-ed32-4b91-93a6-a8fae8ff5252 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:24.189946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c68a1d-ed32-4b91-93a6-a8fae8ff5252 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:24.190917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c68a1d-ed32-4b91-93a6-a8fae8ff5252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:24.208888 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:24.213072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-74c68a1d-ed32-4b91-93a6-a8fae8ff5252 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:24.214544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-74c68a1d-ed32-4b91-93a6-a8fae8ff5252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:24.236305 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb90b8-4991-4098-8090-f782d6863a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:24.242277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb90b8-4991-4098-8090-f782d6863a1c None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:24.242781 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb90b8-4991-4098-8090-f782d6863a1c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:24.243170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb90b8-4991-4098-8090-f782d6863a1c None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695/groups/4ff274b280d44c49a8c6d253a8fc20d0/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:24.245570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb90b8-4991-4098-8090-f782d6863a1c None admin] RBAC: Authorizing `identity:create_grant(project_id=2d2682aa15ad4d469e37e5c1e8c4a695, group_id=4ff274b280d44c49a8c6d253a8fc20d0, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:24.247530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb90b8-4991-4098-8090-f782d6863a1c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:24.266133 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 192/395] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 16 05:21:23 2022] PUT /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695/groups/4ff274b280d44c49a8c6d253a8fc20d0/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:24.303098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 204/396] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:24.589090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb90b8-4991-4098-8090-f782d6863a1c None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:24.703316 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb90b8-4991-4098-8090-f782d6863a1c None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:24.739165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146683c-7383-452a-b178-abbe276fe14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:24.740179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146683c-7383-452a-b178-abbe276fe14f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:24.740657 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146683c-7383-452a-b178-abbe276fe14f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:24.741187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146683c-7383-452a-b178-abbe276fe14f None admin] PATH_INFO: `/v3/roles/member` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:24.756867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146683c-7383-452a-b178-abbe276fe14f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-c146683c-7383-452a-b178-abbe276fe14f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:24.762849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:24.763819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:24.764622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:24.764622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:24.764622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:24.764622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:24.764622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:24.764622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:24.764622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:24.764622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:24.764622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:24.764622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:24.764622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:24.764622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:24.770946 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 193/397] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:24.776924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c68a1d-ed32-4b91-93a6-a8fae8ff5252 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:24.781899 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30288449-ec10-461f-b772-b84df620a8b9 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:24.782188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30288449-ec10-461f-b772-b84df620a8b9 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:24.782461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30288449-ec10-461f-b772-b84df620a8b9 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:24.784505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 194/398] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:21:24.789728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f20c99-64f3-4de1-b0dc-fff6a3bb876c None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:24.790010 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f20c99-64f3-4de1-b0dc-fff6a3bb876c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:24.790283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f20c99-64f3-4de1-b0dc-fff6a3bb876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:24.809072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f2f20c99-64f3-4de1-b0dc-fff6a3bb876c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:24.810368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f2f20c99-64f3-4de1-b0dc-fff6a3bb876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:24.842059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:24.867056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:24.903123 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 195/399] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:21:24.927608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c68a1d-ed32-4b91-93a6-a8fae8ff5252 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:24.980689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98275445-9f39-4efd-9468-252f7dc0e95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:24.981380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98275445-9f39-4efd-9468-252f7dc0e95a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:24.981707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98275445-9f39-4efd-9468-252f7dc0e95a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:24.981987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98275445-9f39-4efd-9468-252f7dc0e95a None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:24.982679 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98275445-9f39-4efd-9468-252f7dc0e95a None admin] RBAC: Adding query filter params (name=member) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:24.982987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98275445-9f39-4efd-9468-252f7dc0e95a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:24.984374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98275445-9f39-4efd-9468-252f7dc0e95a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:24.996589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 205/400] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:25.002267 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f20c99-64f3-4de1-b0dc-fff6a3bb876c None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:25.142409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f20c99-64f3-4de1-b0dc-fff6a3bb876c None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:25.197117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4b829-7f7d-4d42-bc81-d7f54939fc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:25.197932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b829-7f7d-4d42-bc81-d7f54939fc9c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:25.198210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b829-7f7d-4d42-bc81-d7f54939fc9c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:25.198520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b829-7f7d-4d42-bc81-d7f54939fc9c None admin] PATH_INFO: `/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:25.200261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4b829-7f7d-4d42-bc81-d7f54939fc9c None admin] RBAC: Authorizing `identity:get_group(group_id=4ff274b280d44c49a8c6d253a8fc20d0)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:25.201704 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4b829-7f7d-4d42-bc81-d7f54939fc9c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:25.204598 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 196/401] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:25 2022] GET /identity/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:25.209658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98275445-9f39-4efd-9468-252f7dc0e95a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:25.279523 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413b45-e326-4833-9499-6e54c5bbd415 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:25.279839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413b45-e326-4833-9499-6e54c5bbd415 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:25.280068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413b45-e326-4833-9499-6e54c5bbd415 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:25.282037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 197/402] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:25.287600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e00583-8049-4721-8b38-e6688910ff60 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:25.287869 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e00583-8049-4721-8b38-e6688910ff60 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:25.288144 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e00583-8049-4721-8b38-e6688910ff60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:25.320833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-28e00583-8049-4721-8b38-e6688910ff60 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:25.322358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-28e00583-8049-4721-8b38-e6688910ff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:25.355051 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:25.381812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98275445-9f39-4efd-9468-252f7dc0e95a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:25.414677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 198/403] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:21:25.414931 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:25.417270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e00583-8049-4721-8b38-e6688910ff60 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:25.431184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354b0c3-ba41-4bdb-b958-919c06370c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:25.431818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354b0c3-ba41-4bdb-b958-919c06370c9f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:25.432093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354b0c3-ba41-4bdb-b958-919c06370c9f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:25.432362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354b0c3-ba41-4bdb-b958-919c06370c9f None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:25.435260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354b0c3-ba41-4bdb-b958-919c06370c9f None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:25.436749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354b0c3-ba41-4bdb-b958-919c06370c9f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:25.438712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 206/404] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:25 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:25.444813 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354b0c3-ba41-4bdb-b958-919c06370c9f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:25.607789 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e00583-8049-4721-8b38-e6688910ff60 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:25.642626 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3a3f0-ad81-418e-bf0e-a01d15caba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:25.643783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3a3f0-ad81-418e-bf0e-a01d15caba2f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:25.644082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3a3f0-ad81-418e-bf0e-a01d15caba2f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:25.644372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3a3f0-ad81-418e-bf0e-a01d15caba2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:25.651922 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354b0c3-ba41-4bdb-b958-919c06370c9f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:25.655708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3a3f0-ad81-418e-bf0e-a01d15caba2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-d1f3a3f0-ad81-418e-bf0e-a01d15caba2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:25.661100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:25.662000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:25.664016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:25.664016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:25.664016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:25.664016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:25.664016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:25.664016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:25.664016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:25.664016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:25.664016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:25.664016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:25.664016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:25.664016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:25.664016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 199/405] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:21:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:25.668896 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3a3f0-ad81-418e-bf0e-a01d15caba2f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:25.694567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:25.705229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd14d2-0473-4b09-adab-1e4912095df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:25.706847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd14d2-0473-4b09-adab-1e4912095df4 None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:25.707412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd14d2-0473-4b09-adab-1e4912095df4 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:25.707935 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd14d2-0473-4b09-adab-1e4912095df4 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e/groups/4ff274b280d44c49a8c6d253a8fc20d0/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:25.710064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd14d2-0473-4b09-adab-1e4912095df4 None admin] RBAC: Authorizing `identity:create_grant(project_id=537e7cd0d44a4708ada4ac38cc6ef13e, group_id=4ff274b280d44c49a8c6d253a8fc20d0, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:25.711744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd14d2-0473-4b09-adab-1e4912095df4 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:25.736315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 207/406] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 16 05:21:25 2022] PUT /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e/groups/4ff274b280d44c49a8c6d253a8fc20d0/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:25.778427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3a3f0-ad81-418e-bf0e-a01d15caba2f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:25.787622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd14d2-0473-4b09-adab-1e4912095df4 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:25.818412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9d599-5ef9-4742-9835-cd76cbb675a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:25.819407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9d599-5ef9-4742-9835-cd76cbb675a1 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:25.819822 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9d599-5ef9-4742-9835-cd76cbb675a1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:25.820222 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9d599-5ef9-4742-9835-cd76cbb675a1 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:25.821256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9d599-5ef9-4742-9835-cd76cbb675a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:25.821791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9d599-5ef9-4742-9835-cd76cbb675a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:25.824046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9d599-5ef9-4742-9835-cd76cbb675a1 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:25.835209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 200/407] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:25.841707 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9d599-5ef9-4742-9835-cd76cbb675a1 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:25.889111 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:25.960023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:25.972841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd14d2-0473-4b09-adab-1e4912095df4 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:25.976685 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9d599-5ef9-4742-9835-cd76cbb675a1 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:26.020700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59819f2c-151d-42c5-bafa-b443f63a6c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:26.021330 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59819f2c-151d-42c5-bafa-b443f63a6c84 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:26.021608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59819f2c-151d-42c5-bafa-b443f63a6c84 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:26.021876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59819f2c-151d-42c5-bafa-b443f63a6c84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:26.024248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ecd79-227a-45cb-ba51-f958e907d0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:26.025381 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ecd79-227a-45cb-ba51-f958e907d0f8 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:26.025844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ecd79-227a-45cb-ba51-f958e907d0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:26.026283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ecd79-227a-45cb-ba51-f958e907d0f8 None admin] PATH_INFO: `/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:26.027882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ecd79-227a-45cb-ba51-f958e907d0f8 None admin] RBAC: Authorizing `identity:get_group(group_id=4ff274b280d44c49a8c6d253a8fc20d0)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:26.029677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ecd79-227a-45cb-ba51-f958e907d0f8 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:26.031785 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 201/408] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:25 2022] GET /identity/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:26.032999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59819f2c-151d-42c5-bafa-b443f63a6c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-59819f2c-151d-42c5-bafa-b443f63a6c84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:26.043603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:26.044552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:26.045784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:26.045784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:26.045784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:26.045784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:26.045784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:26.045784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:26.045784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:26.045784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:26.045784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:26.045784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:26.045784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:21:26.045784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:26.045784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 208/409] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:21:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:21:26.047126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ecd79-227a-45cb-ba51-f958e907d0f8 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:26.051408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59819f2c-151d-42c5-bafa-b443f63a6c84 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:26.198558 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ecd79-227a-45cb-ba51-f958e907d0f8 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:26.250336 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93a9eb-476a-424c-8469-b33f8eb3d238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:26.251065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a9eb-476a-424c-8469-b33f8eb3d238 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:26.251346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a9eb-476a-424c-8469-b33f8eb3d238 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:26.251677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a9eb-476a-424c-8469-b33f8eb3d238 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:26.254678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59819f2c-151d-42c5-bafa-b443f63a6c84 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:26.256404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93a9eb-476a-424c-8469-b33f8eb3d238 None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:26.257857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93a9eb-476a-424c-8469-b33f8eb3d238 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:26.261253 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 202/410] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:26 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:26.267582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93a9eb-476a-424c-8469-b33f8eb3d238 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:26.292564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:26.333144 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:26.355220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c62d4a-be00-4bfc-a500-98c512fa7bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:26.355840 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c62d4a-be00-4bfc-a500-98c512fa7bfd None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:26.356120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c62d4a-be00-4bfc-a500-98c512fa7bfd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:26.356391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c62d4a-be00-4bfc-a500-98c512fa7bfd None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:26.357116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c62d4a-be00-4bfc-a500-98c512fa7bfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:26.357353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c62d4a-be00-4bfc-a500-98c512fa7bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:26.358989 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c62d4a-be00-4bfc-a500-98c512fa7bfd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:26.374427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 209/411] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:26.387505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c62d4a-be00-4bfc-a500-98c512fa7bfd None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:26.425929 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93a9eb-476a-424c-8469-b33f8eb3d238 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:26.463185 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2cc02-8fb4-48e5-9549-d5c2da0f2500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:26.464014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2cc02-8fb4-48e5-9549-d5c2da0f2500 None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:26.464396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2cc02-8fb4-48e5-9549-d5c2da0f2500 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:26.464770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2cc02-8fb4-48e5-9549-d5c2da0f2500 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e/groups/4ff274b280d44c49a8c6d253a8fc20d0/roles/49763e40fa024aaa9522c00cea577eca` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:26.467165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2cc02-8fb4-48e5-9549-d5c2da0f2500 None admin] RBAC: Authorizing `identity:create_grant(project_id=537e7cd0d44a4708ada4ac38cc6ef13e, group_id=4ff274b280d44c49a8c6d253a8fc20d0, role_id=49763e40fa024aaa9522c00cea577eca)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:26.468693 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2cc02-8fb4-48e5-9549-d5c2da0f2500 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:26.493414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 203/412] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 16 05:21:26 2022] PUT /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e/groups/4ff274b280d44c49a8c6d253a8fc20d0/roles/49763e40fa024aaa9522c00cea577eca => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:26.562963 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c62d4a-be00-4bfc-a500-98c512fa7bfd None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:26.611659 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20e286-c2c6-42ff-b2fd-1a19e12bf1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:26.613520 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20e286-c2c6-42ff-b2fd-1a19e12bf1fd None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:26.614154 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20e286-c2c6-42ff-b2fd-1a19e12bf1fd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:26.614839 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20e286-c2c6-42ff-b2fd-1a19e12bf1fd None admin] PATH_INFO: `/v3/groups/6a0ece966ee7433588e150373dc00bfe` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:26.619691 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20e286-c2c6-42ff-b2fd-1a19e12bf1fd None admin] RBAC: Authorizing `identity:get_group(group_id=6a0ece966ee7433588e150373dc00bfe)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:26.622225 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20e286-c2c6-42ff-b2fd-1a19e12bf1fd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:26.625170 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 210/413] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:26 2022] GET /identity/v3/groups/6a0ece966ee7433588e150373dc00bfe => generated 229 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:26.631984 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2cc02-8fb4-48e5-9549-d5c2da0f2500 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:26.732827 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:26.753167 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2cc02-8fb4-48e5-9549-d5c2da0f2500 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:26.788865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9737112-4003-43ab-b55b-e535873d48ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:26.789764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9737112-4003-43ab-b55b-e535873d48ce None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:26.790185 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9737112-4003-43ab-b55b-e535873d48ce None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:26.790689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9737112-4003-43ab-b55b-e535873d48ce None admin] PATH_INFO: `/v3/projects/7a0a847de7a845db8a359724caa6c1da` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:26.791988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9737112-4003-43ab-b55b-e535873d48ce None admin] RBAC: Authorizing `identity:get_project(project_id=7a0a847de7a845db8a359724caa6c1da)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:26.793586 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9737112-4003-43ab-b55b-e535873d48ce None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:26.795714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 204/414] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:26 2022] GET /identity/v3/projects/7a0a847de7a845db8a359724caa6c1da => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:26.801787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20e286-c2c6-42ff-b2fd-1a19e12bf1fd None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:26.853013 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:26.932237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20e286-c2c6-42ff-b2fd-1a19e12bf1fd None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:26.985909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea435d7-0899-4282-a215-2e940d8b0d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:26.987791 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea435d7-0899-4282-a215-2e940d8b0d23 None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:26.988408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea435d7-0899-4282-a215-2e940d8b0d23 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:26.989017 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea435d7-0899-4282-a215-2e940d8b0d23 None admin] PATH_INFO: `/v3/projects/7a0a847de7a845db8a359724caa6c1da/groups/6a0ece966ee7433588e150373dc00bfe/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:26.996018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea435d7-0899-4282-a215-2e940d8b0d23 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0a847de7a845db8a359724caa6c1da, group_id=6a0ece966ee7433588e150373dc00bfe, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:26.998932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea435d7-0899-4282-a215-2e940d8b0d23 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:27.025973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 211/415] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 16 05:21:26 2022] PUT /identity/v3/projects/7a0a847de7a845db8a359724caa6c1da/groups/6a0ece966ee7433588e150373dc00bfe/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:27.028437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2f42f-1b0c-42da-97c7-205a0b4ab9e6 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:27.028903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2f42f-1b0c-42da-97c7-205a0b4ab9e6 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:27.029361 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2f42f-1b0c-42da-97c7-205a0b4ab9e6 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:27.031036 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 205/416] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:27.037036 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79ea06-51d7-4b49-8c8e-1ac23ad881b1 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:27.037320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79ea06-51d7-4b49-8c8e-1ac23ad881b1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:27.037597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79ea06-51d7-4b49-8c8e-1ac23ad881b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:27.064510 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-7d79ea06-51d7-4b49-8c8e-1ac23ad881b1 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:27.066332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-7d79ea06-51d7-4b49-8c8e-1ac23ad881b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:27.135885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a8cf8-706d-4dfe-8170-0d837c7b47fc None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:27.136126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a8cf8-706d-4dfe-8170-0d837c7b47fc None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:27.136358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a8cf8-706d-4dfe-8170-0d837c7b47fc None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:27.138440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 206/417] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:27.144620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a714-0c2d-47c3-8c74-e735bd395cf0 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:27.144904 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a714-0c2d-47c3-8c74-e735bd395cf0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:27.145182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a714-0c2d-47c3-8c74-e735bd395cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:27.157274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 212/418] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:27.195780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c641a714-0c2d-47c3-8c74-e735bd395cf0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:27.197011 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c641a714-0c2d-47c3-8c74-e735bd395cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:27.309831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 207/419] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:21:27.446259 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79ea06-51d7-4b49-8c8e-1ac23ad881b1 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:27.477080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:27.584324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79ea06-51d7-4b49-8c8e-1ac23ad881b1 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:27.611099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641a714-0c2d-47c3-8c74-e735bd395cf0 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:27.637700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19ecbe-8d04-4b5f-bd0c-35ddc334f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:27.638345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ecbe-8d04-4b5f-bd0c-35ddc334f4c6 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:27.638650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ecbe-8d04-4b5f-bd0c-35ddc334f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:27.638925 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ecbe-8d04-4b5f-bd0c-35ddc334f4c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:27.656729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19ecbe-8d04-4b5f-bd0c-35ddc334f4c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-ca19ecbe-8d04-4b5f-bd0c-35ddc334f4c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:27.662123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:27.663604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:27.664917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:27.664917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:27.664917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:27.664917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:27.664917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:27.664917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:27.664917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:27.664917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:27.664917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:27.664917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:27.664917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:27.664917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:27.664917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 213/420] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:27.674134 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19ecbe-8d04-4b5f-bd0c-35ddc334f4c6 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:27.755899 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:27.796345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641a714-0c2d-47c3-8c74-e735bd395cf0 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:27.827514 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:27.839613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19ecbe-8d04-4b5f-bd0c-35ddc334f4c6 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:27.876348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b8027-edf3-4f62-9092-e971e36343a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:27.876779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dd87a-31c7-4bb6-a65e-c664fc8082db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:27.876986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b8027-edf3-4f62-9092-e971e36343a4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:27.877260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b8027-edf3-4f62-9092-e971e36343a4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:27.877453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dd87a-31c7-4bb6-a65e-c664fc8082db None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:27.877618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b8027-edf3-4f62-9092-e971e36343a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:27.877763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dd87a-31c7-4bb6-a65e-c664fc8082db None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:27.878107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dd87a-31c7-4bb6-a65e-c664fc8082db None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:27.878806 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dd87a-31c7-4bb6-a65e-c664fc8082db None admin] RBAC: Adding query filter params (name=member) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:27.879109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dd87a-31c7-4bb6-a65e-c664fc8082db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:27.880512 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dd87a-31c7-4bb6-a65e-c664fc8082db None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:27.894694 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 214/421] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:27.896359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dd87a-31c7-4bb6-a65e-c664fc8082db None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:27.899844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b8027-edf3-4f62-9092-e971e36343a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-173b8027-edf3-4f62-9092-e971e36343a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:27.904844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:27.906943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:27.909453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:27.909453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:27.909453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:27.909453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:27.909453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:27.909453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:27.909453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:27.909453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:27.909453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:27.909453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:27.909453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:27.909453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:27.909453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 208/422] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:21:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:27.914496 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b8027-edf3-4f62-9092-e971e36343a4 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:28.089749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dd87a-31c7-4bb6-a65e-c664fc8082db None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:28.110337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b8027-edf3-4f62-9092-e971e36343a4 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:28.130352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bf595-3820-4c52-85b3-66337e09b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:28.130988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bf595-3820-4c52-85b3-66337e09b267 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:28.131267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bf595-3820-4c52-85b3-66337e09b267 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:28.131536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bf595-3820-4c52-85b3-66337e09b267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:28.178059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:28.179218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796029b3-7525-42e6-8767-dc1f105d35a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:28.179845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796029b3-7525-42e6-8767-dc1f105d35a4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:28.180194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796029b3-7525-42e6-8767-dc1f105d35a4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:28.180467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796029b3-7525-42e6-8767-dc1f105d35a4 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:28.181149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796029b3-7525-42e6-8767-dc1f105d35a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:28.181449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796029b3-7525-42e6-8767-dc1f105d35a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:28.182910 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796029b3-7525-42e6-8767-dc1f105d35a4 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:28.202812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 209/423] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:28.209317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796029b3-7525-42e6-8767-dc1f105d35a4 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:28.213385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:28.284452 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bf595-3820-4c52-85b3-66337e09b267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:28.285997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bf595-3820-4c52-85b3-66337e09b267 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:28.374287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796029b3-7525-42e6-8767-dc1f105d35a4 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:28.417397 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018652c3-75e4-4500-98b3-71e9cd397ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:28.418429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018652c3-75e4-4500-98b3-71e9cd397ffe None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:28.418990 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018652c3-75e4-4500-98b3-71e9cd397ffe None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:28.419266 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018652c3-75e4-4500-98b3-71e9cd397ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:28.429965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 215/424] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 05:21:28.431466 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd40ba-6f93-4bd4-8348-4564ed7d8dd4 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:28.431857 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd40ba-6f93-4bd4-8348-4564ed7d8dd4 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:28.432230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd40ba-6f93-4bd4-8348-4564ed7d8dd4 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:28.434045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 216/425] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:28.437452 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd40ba-6f93-4bd4-8348-4564ed7d8dd4 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:28.500092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:28.502006 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018652c3-75e4-4500-98b3-71e9cd397ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:28.504322 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018652c3-75e4-4500-98b3-71e9cd397ffe None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:28.506710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:28.554914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd40ba-6f93-4bd4-8348-4564ed7d8dd4 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:28.593411 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4746c4-4787-4c6f-b40b-a7bcf5004730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:28.594032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4746c4-4787-4c6f-b40b-a7bcf5004730 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:28.594308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4746c4-4787-4c6f-b40b-a7bcf5004730 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:28.594598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4746c4-4787-4c6f-b40b-a7bcf5004730 None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:28.595711 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4746c4-4787-4c6f-b40b-a7bcf5004730 None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:28.597399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4746c4-4787-4c6f-b40b-a7bcf5004730 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:28.603850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 217/426] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:28 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:28.605104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83502715-11a4-4053-a2ed-051f731bcd64 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:28.605378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83502715-11a4-4053-a2ed-051f731bcd64 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:28.605641 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83502715-11a4-4053-a2ed-051f731bcd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:28.611049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 210/427] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 05:21:28.615559 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018652c3-75e4-4500-98b3-71e9cd397ffe None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:28.625783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-83502715-11a4-4053-a2ed-051f731bcd64 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:28.627038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-83502715-11a4-4053-a2ed-051f731bcd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:28.702689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 218/428] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:28.706627 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83502715-11a4-4053-a2ed-051f731bcd64 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:28.742956 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018652c3-75e4-4500-98b3-71e9cd397ffe None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:28.744504 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:28.759660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:28.815943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83502715-11a4-4053-a2ed-051f731bcd64 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:28.819203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd492e9b-df95-4b73-b450-0e773433a588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:28.819849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd492e9b-df95-4b73-b450-0e773433a588 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:28.820134 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd492e9b-df95-4b73-b450-0e773433a588 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:28.820413 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd492e9b-df95-4b73-b450-0e773433a588 None admin] PATH_INFO: `/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:28.821607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd492e9b-df95-4b73-b450-0e773433a588 None admin] RBAC: Authorizing `identity:get_group(group_id=4ff274b280d44c49a8c6d253a8fc20d0)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:28.823110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd492e9b-df95-4b73-b450-0e773433a588 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:28.825015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 211/429] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:28 2022] GET /identity/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:28.835790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd492e9b-df95-4b73-b450-0e773433a588 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:28.856913 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e184b9-8872-41e3-b7c2-1536dfe7115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:28.857540 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e184b9-8872-41e3-b7c2-1536dfe7115d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:28.857814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e184b9-8872-41e3-b7c2-1536dfe7115d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:28.858087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e184b9-8872-41e3-b7c2-1536dfe7115d None admin] PATH_INFO: `/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:28.859307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e184b9-8872-41e3-b7c2-1536dfe7115d None admin] RBAC: Authorizing `identity:get_project(project_id=2d2682aa15ad4d469e37e5c1e8c4a695)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:28.860865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e184b9-8872-41e3-b7c2-1536dfe7115d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:28.862936 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 219/430] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:28 2022] GET /identity/v3/projects/2d2682aa15ad4d469e37e5c1e8c4a695 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:28.870230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e184b9-8872-41e3-b7c2-1536dfe7115d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:28.984553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e184b9-8872-41e3-b7c2-1536dfe7115d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:29.003947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:29.028287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd492e9b-df95-4b73-b450-0e773433a588 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:29.040719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80170873-f51e-47a9-9107-c8988107a548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:29.041356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80170873-f51e-47a9-9107-c8988107a548 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:29.041630 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80170873-f51e-47a9-9107-c8988107a548 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:29.041896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80170873-f51e-47a9-9107-c8988107a548 None admin] PATH_INFO: `/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:29.043221 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80170873-f51e-47a9-9107-c8988107a548 None admin] RBAC: Authorizing `identity:get_group(group_id=4ff274b280d44c49a8c6d253a8fc20d0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:29.044780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80170873-f51e-47a9-9107-c8988107a548 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:29.050899 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 220/431] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:28 2022] GET /identity/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:29.055173 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80170873-f51e-47a9-9107-c8988107a548 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:29.069368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adb0ca-a145-468f-8e44-58ea6b58ef97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:29.069975 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adb0ca-a145-468f-8e44-58ea6b58ef97 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:29.070256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adb0ca-a145-468f-8e44-58ea6b58ef97 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:29.070541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adb0ca-a145-468f-8e44-58ea6b58ef97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:29.071271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adb0ca-a145-468f-8e44-58ea6b58ef97 None admin] RBAC: Adding query filter params (group.id=4ff274b280d44c49a8c6d253a8fc20d0, role.id=d912a7e672bb441099f4ef85d61e7c46, scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:29.071582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adb0ca-a145-468f-8e44-58ea6b58ef97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:29.073005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adb0ca-a145-468f-8e44-58ea6b58ef97 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:29.079266 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 212/432] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 05:21:28 2022] GET /identity/v3/role_assignments?group.id=4ff274b280d44c49a8c6d253a8fc20d0&scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695&role.id=d912a7e672bb441099f4ef85d61e7c46 => generated 611 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:29.136069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380b77f-fd49-421e-8840-c2312161a256 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:29.136418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380b77f-fd49-421e-8840-c2312161a256 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:29.136630 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380b77f-fd49-421e-8840-c2312161a256 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:29.138263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 213/433] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:29.145506 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4e21-a23d-4b88-8927-bd9f5b2796e0 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:29.145807 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4e21-a23d-4b88-8927-bd9f5b2796e0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:29.146048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4e21-a23d-4b88-8927-bd9f5b2796e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:29.186529 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-0f0a4e21-a23d-4b88-8927-bd9f5b2796e0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:29.187751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0f0a4e21-a23d-4b88-8927-bd9f5b2796e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:29.207393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80170873-f51e-47a9-9107-c8988107a548 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:29.232942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:29.255704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895ebdf-9c97-4b43-a0a9-b10e98cfceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:29.256723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895ebdf-9c97-4b43-a0a9-b10e98cfceb6 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:29.258001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895ebdf-9c97-4b43-a0a9-b10e98cfceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:29.258528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895ebdf-9c97-4b43-a0a9-b10e98cfceb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:29.259752 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895ebdf-9c97-4b43-a0a9-b10e98cfceb6 None admin] RBAC: Adding query filter params (group.id=4ff274b280d44c49a8c6d253a8fc20d0, role.id=49763e40fa024aaa9522c00cea577eca, scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:29.260837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895ebdf-9c97-4b43-a0a9-b10e98cfceb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:29.263252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895ebdf-9c97-4b43-a0a9-b10e98cfceb6 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:29.273866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 221/434] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 05:21:29 2022] GET /identity/v3/role_assignments?group.id=4ff274b280d44c49a8c6d253a8fc20d0&scope.project.id=2d2682aa15ad4d469e37e5c1e8c4a695&role.id=49763e40fa024aaa9522c00cea577eca => generated 611 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:29.275516 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895ebdf-9c97-4b43-a0a9-b10e98cfceb6 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:29.295082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 214/435] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:21:29.351143 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:29.412900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895ebdf-9c97-4b43-a0a9-b10e98cfceb6 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:29.456498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93124c0f-3c8e-48ad-9345-eadb740bf293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:29.457145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124c0f-3c8e-48ad-9345-eadb740bf293 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:29.457427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124c0f-3c8e-48ad-9345-eadb740bf293 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:29.457701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124c0f-3c8e-48ad-9345-eadb740bf293 None admin] PATH_INFO: `/v3/roles/member` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:29.473306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93124c0f-3c8e-48ad-9345-eadb740bf293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-93124c0f-3c8e-48ad-9345-eadb740bf293 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:29.478805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:29.479811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:29.480636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:29.480636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:29.480636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:29.480636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:29.480636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:29.480636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:29.480636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:29.480636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:29.480636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:29.480636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:29.480636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 05:21:29.480636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:29.480636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 222/436] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:29.486531 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a4e21-a23d-4b88-8927-bd9f5b2796e0 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:29.597614 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a4e21-a23d-4b88-8927-bd9f5b2796e0 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:29.608078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93124c0f-3c8e-48ad-9345-eadb740bf293 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:29.638103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903007-128f-4608-8e29-14a322197d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:29.639415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903007-128f-4608-8e29-14a322197d6a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:29.640041 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903007-128f-4608-8e29-14a322197d6a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:29.640530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903007-128f-4608-8e29-14a322197d6a None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:29.641426 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d903007-128f-4608-8e29-14a322197d6a None admin] RBAC: Adding query filter params (name=member) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:29.641910 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d903007-128f-4608-8e29-14a322197d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:29.644235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d903007-128f-4608-8e29-14a322197d6a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:29.656075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 215/437] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:21:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:29.663383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903007-128f-4608-8e29-14a322197d6a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:29.698548 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:29.736107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93124c0f-3c8e-48ad-9345-eadb740bf293 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:29.749419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:29.776436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83bde7-6e61-467c-a0a0-7a6525cc46b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:29.777065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83bde7-6e61-467c-a0a0-7a6525cc46b4 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:29.777679 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83bde7-6e61-467c-a0a0-7a6525cc46b4 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:29.777783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83bde7-6e61-467c-a0a0-7a6525cc46b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:29.789546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83bde7-6e61-467c-a0a0-7a6525cc46b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:29.791921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903007-128f-4608-8e29-14a322197d6a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-0a83bde7-6e61-467c-a0a0-7a6525cc46b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:29.795528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:29.796395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:29.797201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:29.797201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:29.797201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:29.797201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:29.797201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:29.797201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:29.797201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:29.797201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:29.797201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:29.797201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:29.797201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:29.797201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:29.799737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 223/438] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:21:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:29.801114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d0c1e-8969-46f4-9352-30227258c042 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:29.801561 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d0c1e-8969-46f4-9352-30227258c042 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:29.801997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d0c1e-8969-46f4-9352-30227258c042 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:29.803514 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 224/439] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:29.805727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d0c1e-8969-46f4-9352-30227258c042 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:29.830240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf44cda-75d6-47ab-b7ba-56cb2be10f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:29.831491 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf44cda-75d6-47ab-b7ba-56cb2be10f0a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:29.831774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf44cda-75d6-47ab-b7ba-56cb2be10f0a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:29.832045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf44cda-75d6-47ab-b7ba-56cb2be10f0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:29.915363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf44cda-75d6-47ab-b7ba-56cb2be10f0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:29.916554 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf44cda-75d6-47ab-b7ba-56cb2be10f0a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:29.929111 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d0c1e-8969-46f4-9352-30227258c042 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:29.948619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:29.968892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dd8ff-2d7c-4641-9599-b78469811b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:29.971598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd8ff-2d7c-4641-9599-b78469811b4a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:29.971598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd8ff-2d7c-4641-9599-b78469811b4a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:29.971598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd8ff-2d7c-4641-9599-b78469811b4a None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:29.971848 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dd8ff-2d7c-4641-9599-b78469811b4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:29.972125 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dd8ff-2d7c-4641-9599-b78469811b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:29.973528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dd8ff-2d7c-4641-9599-b78469811b4a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:29.988835 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 225/440] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:29.990128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5419df-aa64-48ff-a287-71729f97180e None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:29.990408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5419df-aa64-48ff-a287-71729f97180e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:29.990698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5419df-aa64-48ff-a287-71729f97180e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:30.009365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-8c5419df-aa64-48ff-a287-71729f97180e None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:30.010620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8c5419df-aa64-48ff-a287-71729f97180e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:30.030348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 216/441] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:30.031196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf44cda-75d6-47ab-b7ba-56cb2be10f0a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:30.041458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:30.082766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 226/442] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:30.083601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5419df-aa64-48ff-a287-71729f97180e None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:30.131773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf44cda-75d6-47ab-b7ba-56cb2be10f0a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:30.156148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:30.165562 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc2523-68e0-4324-baf9-eb383659d839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:30.166094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc2523-68e0-4324-baf9-eb383659d839 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:30.166368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc2523-68e0-4324-baf9-eb383659d839 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:30.166772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc2523-68e0-4324-baf9-eb383659d839 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:30.187439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5419df-aa64-48ff-a287-71729f97180e None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:30.229229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d84eb-f420-47d5-9ba7-39043d13d13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:30.229861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d84eb-f420-47d5-9ba7-39043d13d13e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:30.230256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d84eb-f420-47d5-9ba7-39043d13d13e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:30.230542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d84eb-f420-47d5-9ba7-39043d13d13e None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:30.231778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d84eb-f420-47d5-9ba7-39043d13d13e None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:30.233222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d84eb-f420-47d5-9ba7-39043d13d13e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:30.239950 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 227/443] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:30 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:30.241021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d84eb-f420-47d5-9ba7-39043d13d13e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:30.244058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc2523-68e0-4324-baf9-eb383659d839 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:30.245523 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc2523-68e0-4324-baf9-eb383659d839 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:30.271882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:30.347154 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d84eb-f420-47d5-9ba7-39043d13d13e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:30.353420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 217/444] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:30.354574 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc2523-68e0-4324-baf9-eb383659d839 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:30.380538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:30.385807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08477083-e0a6-4a51-a31e-712aa03bef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:30.386433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08477083-e0a6-4a51-a31e-712aa03bef5d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:30.386739 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08477083-e0a6-4a51-a31e-712aa03bef5d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:30.387006 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08477083-e0a6-4a51-a31e-712aa03bef5d None admin] PATH_INFO: `/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:30.388110 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08477083-e0a6-4a51-a31e-712aa03bef5d None admin] RBAC: Authorizing `identity:get_group(group_id=4ff274b280d44c49a8c6d253a8fc20d0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:30.389547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08477083-e0a6-4a51-a31e-712aa03bef5d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:30.391122 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 228/445] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:30 2022] GET /identity/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:30.391868 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08477083-e0a6-4a51-a31e-712aa03bef5d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:30.455395 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc2523-68e0-4324-baf9-eb383659d839 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:30.484835 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:30.489108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37a8f9-5116-44ec-a2e0-2176dd2c12a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:30.489276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08477083-e0a6-4a51-a31e-712aa03bef5d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:30.489728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37a8f9-5116-44ec-a2e0-2176dd2c12a5 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:30.490008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37a8f9-5116-44ec-a2e0-2176dd2c12a5 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:30.490277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37a8f9-5116-44ec-a2e0-2176dd2c12a5 None admin] PATH_INFO: `/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:30.491414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37a8f9-5116-44ec-a2e0-2176dd2c12a5 None admin] RBAC: Authorizing `identity:get_project(project_id=537e7cd0d44a4708ada4ac38cc6ef13e)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:30.492841 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37a8f9-5116-44ec-a2e0-2176dd2c12a5 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:30.494430 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 218/446] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:30 2022] GET /identity/v3/projects/537e7cd0d44a4708ada4ac38cc6ef13e => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:30.495207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37a8f9-5116-44ec-a2e0-2176dd2c12a5 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:30.522063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9b72-0811-4f51-b32e-b62ab6815950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:30.522710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9b72-0811-4f51-b32e-b62ab6815950 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:30.522987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9b72-0811-4f51-b32e-b62ab6815950 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:30.523256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9b72-0811-4f51-b32e-b62ab6815950 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:30.534333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb9b72-0811-4f51-b32e-b62ab6815950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-b7eb9b72-0811-4f51-b32e-b62ab6815950 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:30.539698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:30.540800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:30.541685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:30.541685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:30.541685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:30.541685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:30.541685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:30.541685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:30.541685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:30.541685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:30.541685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:30.541685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:30.541685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:21:30.541685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:30.542410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 229/447] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:21:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:30.542838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9b72-0811-4f51-b32e-b62ab6815950 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:30.590756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:30.598274 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37a8f9-5116-44ec-a2e0-2176dd2c12a5 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:30.631028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393f6f5-7f96-40b7-bdbe-34451dd7285e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:30.631843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393f6f5-7f96-40b7-bdbe-34451dd7285e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:30.632118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393f6f5-7f96-40b7-bdbe-34451dd7285e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:30.632391 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393f6f5-7f96-40b7-bdbe-34451dd7285e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:30.633108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393f6f5-7f96-40b7-bdbe-34451dd7285e None admin] RBAC: Adding query filter params (group.id=4ff274b280d44c49a8c6d253a8fc20d0, role.id=d912a7e672bb441099f4ef85d61e7c46, scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:30.633418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393f6f5-7f96-40b7-bdbe-34451dd7285e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:30.634870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393f6f5-7f96-40b7-bdbe-34451dd7285e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:30.640391 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 219/448] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 05:21:30 2022] GET /identity/v3/role_assignments?group.id=4ff274b280d44c49a8c6d253a8fc20d0&scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e&role.id=d912a7e672bb441099f4ef85d61e7c46 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:30.641064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9b72-0811-4f51-b32e-b62ab6815950 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:30.641167 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393f6f5-7f96-40b7-bdbe-34451dd7285e None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:30.688008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5607a-f73d-47d4-a78b-510b3417a919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:30.688887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5607a-f73d-47d4-a78b-510b3417a919 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:30.689163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5607a-f73d-47d4-a78b-510b3417a919 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:30.689431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5607a-f73d-47d4-a78b-510b3417a919 None admin] PATH_INFO: `/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:30.690670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5607a-f73d-47d4-a78b-510b3417a919 None admin] RBAC: Authorizing `identity:get_group(group_id=4ff274b280d44c49a8c6d253a8fc20d0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:30.692164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5607a-f73d-47d4-a78b-510b3417a919 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:30.693823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 230/449] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:30 2022] GET /identity/v3/groups/4ff274b280d44c49a8c6d253a8fc20d0 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:30.699995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5607a-f73d-47d4-a78b-510b3417a919 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:30.730892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:30.753636 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393f6f5-7f96-40b7-bdbe-34451dd7285e None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:30.790436 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d7e41-cf95-45bb-b780-dd468a30aba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:30.791087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d7e41-cf95-45bb-b780-dd468a30aba8 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:30.791358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d7e41-cf95-45bb-b780-dd468a30aba8 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:30.791630 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d7e41-cf95-45bb-b780-dd468a30aba8 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:30.792300 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d7e41-cf95-45bb-b780-dd468a30aba8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:30.792700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d7e41-cf95-45bb-b780-dd468a30aba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:30.794090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d7e41-cf95-45bb-b780-dd468a30aba8 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:30.803103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 220/450] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:30.808776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d7e41-cf95-45bb-b780-dd468a30aba8 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:30.811157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5607a-f73d-47d4-a78b-510b3417a919 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:30.835803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:30.855313 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9c5fa-9463-4fb2-bfcb-63ba0d41720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:30.855544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9c5fa-9463-4fb2-bfcb-63ba0d41720a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:30.855697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9c5fa-9463-4fb2-bfcb-63ba0d41720a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:30.856016 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9c5fa-9463-4fb2-bfcb-63ba0d41720a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:30.856629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9c5fa-9463-4fb2-bfcb-63ba0d41720a None admin] RBAC: Adding query filter params (group.id=4ff274b280d44c49a8c6d253a8fc20d0, role.id=49763e40fa024aaa9522c00cea577eca, scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:30.856935 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9c5fa-9463-4fb2-bfcb-63ba0d41720a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:30.858383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9c5fa-9463-4fb2-bfcb-63ba0d41720a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:30.864565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 231/451] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 05:21:30 2022] GET /identity/v3/role_assignments?group.id=4ff274b280d44c49a8c6d253a8fc20d0&scope.project.id=537e7cd0d44a4708ada4ac38cc6ef13e&role.id=49763e40fa024aaa9522c00cea577eca => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:30.940187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d7e41-cf95-45bb-b780-dd468a30aba8 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:30.982629 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03468060-aad0-4bd3-ba14-2d43e2d0aa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:30.983186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03468060-aad0-4bd3-ba14-2d43e2d0aa7a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:30.983471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03468060-aad0-4bd3-ba14-2d43e2d0aa7a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:30.983745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03468060-aad0-4bd3-ba14-2d43e2d0aa7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:31.060568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03468060-aad0-4bd3-ba14-2d43e2d0aa7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:31.062031 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03468060-aad0-4bd3-ba14-2d43e2d0aa7a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:31.084401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:31.163572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 221/452] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 05:21:31.169584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9c5fa-9463-4fb2-bfcb-63ba0d41720a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:31.266252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:31.276352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9c5fa-9463-4fb2-bfcb-63ba0d41720a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:31.307631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0dd5-534c-4e66-837e-c8abc3018f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:31.308239 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0dd5-534c-4e66-837e-c8abc3018f9e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:31.308512 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0dd5-534c-4e66-837e-c8abc3018f9e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:31.308777 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0dd5-534c-4e66-837e-c8abc3018f9e None admin] PATH_INFO: `/v3/projects/7a0a847de7a845db8a359724caa6c1da` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:31.309862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf0dd5-534c-4e66-837e-c8abc3018f9e None admin] RBAC: Authorizing `identity:get_project(project_id=7a0a847de7a845db8a359724caa6c1da)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:31.311310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf0dd5-534c-4e66-837e-c8abc3018f9e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:31.312894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 232/453] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:21:31 2022] GET /identity/v3/projects/7a0a847de7a845db8a359724caa6c1da => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:31.319240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03468060-aad0-4bd3-ba14-2d43e2d0aa7a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:31.413966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03468060-aad0-4bd3-ba14-2d43e2d0aa7a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:31.433330 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:31.447786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b87ee-f1f2-4038-8cb7-ea4ab2dc3669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:31.448404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b87ee-f1f2-4038-8cb7-ea4ab2dc3669 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:31.448686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b87ee-f1f2-4038-8cb7-ea4ab2dc3669 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:31.448960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b87ee-f1f2-4038-8cb7-ea4ab2dc3669 None admin] PATH_INFO: `/v3/groups/6a0ece966ee7433588e150373dc00bfe` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:31.450063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b87ee-f1f2-4038-8cb7-ea4ab2dc3669 None admin] RBAC: Authorizing `identity:get_group(group_id=6a0ece966ee7433588e150373dc00bfe)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:31.451522 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b87ee-f1f2-4038-8cb7-ea4ab2dc3669 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:31.453046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 222/454] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 05:21:31 2022] GET /identity/v3/groups/6a0ece966ee7433588e150373dc00bfe => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:31.458679 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0dd5-534c-4e66-837e-c8abc3018f9e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:31.553307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0dd5-534c-4e66-837e-c8abc3018f9e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:31.585529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1a8f3-edae-4aca-9433-bc1c0c118db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:31.586109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1a8f3-edae-4aca-9433-bc1c0c118db2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:31.586386 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1a8f3-edae-4aca-9433-bc1c0c118db2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:31.586683 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1a8f3-edae-4aca-9433-bc1c0c118db2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:31.587395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1a8f3-edae-4aca-9433-bc1c0c118db2 None admin] RBAC: Adding query filter params (group.id=6a0ece966ee7433588e150373dc00bfe, role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=7a0a847de7a845db8a359724caa6c1da) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:31.587699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1a8f3-edae-4aca-9433-bc1c0c118db2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:31.589145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1a8f3-edae-4aca-9433-bc1c0c118db2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:31.594692 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 233/455] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 05:21:31 2022] GET /identity/v3/role_assignments?group.id=6a0ece966ee7433588e150373dc00bfe&scope.project.id=7a0a847de7a845db8a359724caa6c1da&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:34.418412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d9287-e4fd-4135-9a46-956b23894970 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:34.419442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d9287-e4fd-4135-9a46-956b23894970 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:34.419943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d9287-e4fd-4135-9a46-956b23894970 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:34.421773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 223/456] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:34.431882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb73e5-7dd2-4f87-9167-e0585e639227 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:34.432306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb73e5-7dd2-4f87-9167-e0585e639227 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:34.432433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb73e5-7dd2-4f87-9167-e0585e639227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:34.459519 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-bfbb73e5-7dd2-4f87-9167-e0585e639227 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:34.461025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-bfbb73e5-7dd2-4f87-9167-e0585e639227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:34.482272 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:34.519396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7fa06-f751-4fd8-8a3f-792b845503fb None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:34.519915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7fa06-f751-4fd8-8a3f-792b845503fb None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:34.520349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7fa06-f751-4fd8-8a3f-792b845503fb None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:34.522096 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 224/457] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:34.527754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5857b9-df9c-4e12-b7e0-720e8a6dbcb8 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:34.528218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5857b9-df9c-4e12-b7e0-720e8a6dbcb8 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:34.528663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5857b9-df9c-4e12-b7e0-720e8a6dbcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:34.546747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 234/458] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:34.557753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-ad5857b9-df9c-4e12-b7e0-720e8a6dbcb8 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:34.559269 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ad5857b9-df9c-4e12-b7e0-720e8a6dbcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:34.653048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 225/459] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:34.711553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110718e-00ad-4db3-9c74-4337e5083b1d None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:34.711952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110718e-00ad-4db3-9c74-4337e5083b1d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:34.712232 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110718e-00ad-4db3-9c74-4337e5083b1d None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:34.713567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 235/460] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:34.718961 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf5ac-cd9a-4b3a-b662-91a4a50add3b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:34.719467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf5ac-cd9a-4b3a-b662-91a4a50add3b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:34.719974 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf5ac-cd9a-4b3a-b662-91a4a50add3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:34.747477 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-de9bf5ac-cd9a-4b3a-b662-91a4a50add3b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:34.748980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-de9bf5ac-cd9a-4b3a-b662-91a4a50add3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:34.832796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 226/461] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:34.981005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110718e-00ad-4db3-9c74-4337e5083b1d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:34.986987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bf5ac-cd9a-4b3a-b662-91a4a50add3b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:35.065098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:35.110221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bf5ac-cd9a-4b3a-b662-91a4a50add3b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:35.118389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110718e-00ad-4db3-9c74-4337e5083b1d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:35.146759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22858cdf-6124-4248-819d-7e364ee41a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:35.147712 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22858cdf-6124-4248-819d-7e364ee41a94 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:35.148332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22858cdf-6124-4248-819d-7e364ee41a94 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:35.149125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22858cdf-6124-4248-819d-7e364ee41a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:35.160461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22858cdf-6124-4248-819d-7e364ee41a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:35.161044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46bd2-2cb1-4ebd-b705-891c9a81a3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:35.161746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46bd2-2cb1-4ebd-b705-891c9a81a3b4 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:35.162096 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46bd2-2cb1-4ebd-b705-891c9a81a3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:35.162437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46bd2-2cb1-4ebd-b705-891c9a81a3b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:35.162989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22858cdf-6124-4248-819d-7e364ee41a94 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:35.173150 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be46bd2-2cb1-4ebd-b705-891c9a81a3b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:35.175163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be46bd2-2cb1-4ebd-b705-891c9a81a3b4 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-22858cdf-6124-4248-819d-7e364ee41a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:35.180368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:35.181248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:35.182696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:35.182696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:35.182696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:35.182696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 227/462] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:35.183013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3a37-3096-4cd9-b7af-0aa3c3628396 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:35.183230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3a37-3096-4cd9-b7af-0aa3c3628396 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:35.183552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3a37-3096-4cd9-b7af-0aa3c3628396 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:35.186339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 228/463] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:35.187811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f3a37-3096-4cd9-b7af-0aa3c3628396 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-3be46bd2-2cb1-4ebd-b705-891c9a81a3b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:35.195888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:35.196878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:35.197730 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:35.197730 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:35.197730 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:35.197730 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 236/464] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:35.198099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46bd2-2cb1-4ebd-b705-891c9a81a3b4 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:35.203486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:35.303779 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:35.307874 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46bd2-2cb1-4ebd-b705-891c9a81a3b4 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:35.308561 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f3a37-3096-4cd9-b7af-0aa3c3628396 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:35.341582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca3d8d-3271-4938-b04e-55ae58a1438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:35.342181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca3d8d-3271-4938-b04e-55ae58a1438c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:35.342455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca3d8d-3271-4938-b04e-55ae58a1438c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:35.342752 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca3d8d-3271-4938-b04e-55ae58a1438c None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:35.343382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca3d8d-3271-4938-b04e-55ae58a1438c None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:35.343677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca3d8d-3271-4938-b04e-55ae58a1438c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:35.344749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df5136-1173-4ce1-8b2a-9345d581d293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:35.345051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca3d8d-3271-4938-b04e-55ae58a1438c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:35.345377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df5136-1173-4ce1-8b2a-9345d581d293 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:35.345692 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df5136-1173-4ce1-8b2a-9345d581d293 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:35.345967 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df5136-1173-4ce1-8b2a-9345d581d293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:35.356764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 237/465] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:35.358056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6f761-0f7c-4727-b6d7-ace83f0fd1f1 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:35.358340 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6f761-0f7c-4727-b6d7-ace83f0fd1f1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:35.358637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6f761-0f7c-4727-b6d7-ace83f0fd1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:35.363076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df5136-1173-4ce1-8b2a-9345d581d293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:35.364797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df5136-1173-4ce1-8b2a-9345d581d293 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:35.376559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b3a6f761-0f7c-4727-b6d7-ace83f0fd1f1 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:35.378372 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b3a6f761-0f7c-4727-b6d7-ace83f0fd1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-c2df5136-1173-4ce1-8b2a-9345d581d293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:35.381055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:35.381935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:35.382796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:35.382796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:35.382796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:35.382796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 229/466] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:35.383283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df5136-1173-4ce1-8b2a-9345d581d293 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:35.444368 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:35.454672 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 238/467] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:35.455488 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6f761-0f7c-4727-b6d7-ace83f0fd1f1 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:35.516704 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df5136-1173-4ce1-8b2a-9345d581d293 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:35.556248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aecc77-1274-4c1b-9d91-c5dac16f58a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:35.556854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aecc77-1274-4c1b-9d91-c5dac16f58a0 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:35.557137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aecc77-1274-4c1b-9d91-c5dac16f58a0 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:35.557410 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aecc77-1274-4c1b-9d91-c5dac16f58a0 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:35.558044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aecc77-1274-4c1b-9d91-c5dac16f58a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:35.558348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aecc77-1274-4c1b-9d91-c5dac16f58a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:35.559758 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aecc77-1274-4c1b-9d91-c5dac16f58a0 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:35.576318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 230/468] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:35.576318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aecc77-1274-4c1b-9d91-c5dac16f58a0 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:35.579201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6f761-0f7c-4727-b6d7-ace83f0fd1f1 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:35.592493 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:35.616152 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c445e50-1632-4e7e-b416-a15d80b183bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:35.616681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c445e50-1632-4e7e-b416-a15d80b183bd None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:35.616956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c445e50-1632-4e7e-b416-a15d80b183bd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:35.617225 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c445e50-1632-4e7e-b416-a15d80b183bd None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:35.617862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c445e50-1632-4e7e-b416-a15d80b183bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:35.619339 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c445e50-1632-4e7e-b416-a15d80b183bd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:35.641595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 239/469] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:21:35 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:21:35.643054 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a06e-047e-42cc-866a-c318b4e14379 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:35.643338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a06e-047e-42cc-866a-c318b4e14379 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:35.643608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a06e-047e-42cc-866a-c318b4e14379 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:35.645034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 240/470] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:35.645548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a06e-047e-42cc-866a-c318b4e14379 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:35.710009 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:35.726178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aecc77-1274-4c1b-9d91-c5dac16f58a0 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:35.766734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb974c-c1a0-48a7-8442-e3a552addb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:35.767472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb974c-c1a0-48a7-8442-e3a552addb6c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:35.767752 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb974c-c1a0-48a7-8442-e3a552addb6c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:35.768005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb974c-c1a0-48a7-8442-e3a552addb6c None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:35.768403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a06e-047e-42cc-866a-c318b4e14379 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:35.768657 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb974c-c1a0-48a7-8442-e3a552addb6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:35.768955 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb974c-c1a0-48a7-8442-e3a552addb6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:35.770351 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb974c-c1a0-48a7-8442-e3a552addb6c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:35.782716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 231/471] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:35.788488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784ad08-f522-4656-bb29-dccfe4581dc7 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:35.789122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784ad08-f522-4656-bb29-dccfe4581dc7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:35.789396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784ad08-f522-4656-bb29-dccfe4581dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:35.808951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770be50e-7e4a-4d0a-b078-4bbb4fb38f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:35.809421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-7784ad08-f522-4656-bb29-dccfe4581dc7 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:35.809616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770be50e-7e4a-4d0a-b078-4bbb4fb38f67 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:35.809893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770be50e-7e4a-4d0a-b078-4bbb4fb38f67 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:35.810162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770be50e-7e4a-4d0a-b078-4bbb4fb38f67 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:35.810654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7784ad08-f522-4656-bb29-dccfe4581dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:35.810904 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770be50e-7e4a-4d0a-b078-4bbb4fb38f67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:35.812478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770be50e-7e4a-4d0a-b078-4bbb4fb38f67 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:35.835312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 241/472] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:21:35 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:21:35.836410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770be50e-7e4a-4d0a-b078-4bbb4fb38f67 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:35.893297 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 232/473] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:35.894065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784ad08-f522-4656-bb29-dccfe4581dc7 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:35.897671 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:35.983919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770be50e-7e4a-4d0a-b078-4bbb4fb38f67 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:35.994884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:36.034431 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784ad08-f522-4656-bb29-dccfe4581dc7 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:36.037068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8e240-92fd-4706-bb7b-0f99dc339c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:36.037866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8e240-92fd-4706-bb7b-0f99dc339c11 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:36.038147 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8e240-92fd-4706-bb7b-0f99dc339c11 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:36.038412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8e240-92fd-4706-bb7b-0f99dc339c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:36.050899 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8e240-92fd-4706-bb7b-0f99dc339c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:36.053286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8e240-92fd-4706-bb7b-0f99dc339c11 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-07a8e240-92fd-4706-bb7b-0f99dc339c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:36.074438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:36.075438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:36.076539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:36.076539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:36.076539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:36.076539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 242/474] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:36.080929 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82e353-5a34-40e0-aa52-4474816be4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:36.081573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8e240-92fd-4706-bb7b-0f99dc339c11 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:36.081889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82e353-5a34-40e0-aa52-4474816be4ca None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:36.082294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82e353-5a34-40e0-aa52-4474816be4ca None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:36.082748 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82e353-5a34-40e0-aa52-4474816be4ca None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:36.083556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82e353-5a34-40e0-aa52-4474816be4ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:36.085131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82e353-5a34-40e0-aa52-4474816be4ca None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:36.112588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 233/475] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:21:35 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:21:36.197256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82e353-5a34-40e0-aa52-4474816be4ca None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:36.205854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8e240-92fd-4706-bb7b-0f99dc339c11 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:36.256573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95744e94-3798-4167-8bfc-e0bda41132d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:36.257378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95744e94-3798-4167-8bfc-e0bda41132d5 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:36.258564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95744e94-3798-4167-8bfc-e0bda41132d5 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:36.258564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95744e94-3798-4167-8bfc-e0bda41132d5 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:36.260822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95744e94-3798-4167-8bfc-e0bda41132d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:36.261255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95744e94-3798-4167-8bfc-e0bda41132d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:36.262710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95744e94-3798-4167-8bfc-e0bda41132d5 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:36.276846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 243/476] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:36.282283 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95744e94-3798-4167-8bfc-e0bda41132d5 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:36.311549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:36.312300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:36.383308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82e353-5a34-40e0-aa52-4474816be4ca None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:36.433760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c667-d299-4371-ba40-107eaefe0178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:36.434385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c667-d299-4371-ba40-107eaefe0178 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:36.434681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95744e94-3798-4167-8bfc-e0bda41132d5 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:36.434814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c667-d299-4371-ba40-107eaefe0178 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:36.434972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c667-d299-4371-ba40-107eaefe0178 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:36.435651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562c667-d299-4371-ba40-107eaefe0178 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:36.438353 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562c667-d299-4371-ba40-107eaefe0178 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:36.450587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.sql.core [None req-8562c667-d299-4371-ba40-107eaefe0178 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 05:21:36.450587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 16 05:21:36.450587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [parameters: {'id': 'ec281c2a03e8439399f100735b1c8363', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 16 05:21:36.450587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104774) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-8562c667-d299-4371-ba40-107eaefe0178 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application conn.query(q) Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application result.read() Sep 16 05:21:36.475805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return ref.to_dict() Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 05:21:36.476884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application next(self.gen) Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application yield resource Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application next(self.gen) Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise self.value Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application session.commit() Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 05:21:36.477776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self.session.flush() Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application compat.raise_( Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 05:21:36.479416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 05:21:36.480905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application conn.query(q) Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application result.read() Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 05:21:36.482588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [parameters: {'id': 'ec281c2a03e8439399f100735b1c8363', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:36.484498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 16 05:21:36.490843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:36.492826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 234/477] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 16 05:21:36 2022] POST /identity/v3/roles => generated 144 bytes in 281 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:21:36.492969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80d545-ea04-40e4-9fb8-4d8b9635c999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:36.492969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80d545-ea04-40e4-9fb8-4d8b9635c999 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:36.492969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80d545-ea04-40e4-9fb8-4d8b9635c999 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:36.493699 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c667-d299-4371-ba40-107eaefe0178 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:36.493861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80d545-ea04-40e4-9fb8-4d8b9635c999 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:36.493861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80d545-ea04-40e4-9fb8-4d8b9635c999 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:36.493861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80d545-ea04-40e4-9fb8-4d8b9635c999 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:36.514776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 244/478] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:21:36 2022] POST /identity/v3/users => generated 249 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:21:36.601703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c667-d299-4371-ba40-107eaefe0178 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:36.627739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:36.641113 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7217a5-afce-4e2b-94ad-47118e5c284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:36.641766 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7217a5-afce-4e2b-94ad-47118e5c284a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:36.642053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7217a5-afce-4e2b-94ad-47118e5c284a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:36.642910 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7217a5-afce-4e2b-94ad-47118e5c284a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:36.655811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7217a5-afce-4e2b-94ad-47118e5c284a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-4b7217a5-afce-4e2b-94ad-47118e5c284a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:36.661520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:36.663667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:36.665611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:36.665611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:36.665611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:36.665611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:36.665611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:36.665611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:36.665611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:36.665611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:36.665611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:36.665611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:36.665611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 05:21:36.665611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:36.665611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 235/479] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:21:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:21:36.669655 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80d545-ea04-40e4-9fb8-4d8b9635c999 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:36.767255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:36.794937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80d545-ea04-40e4-9fb8-4d8b9635c999 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:36.830725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b2975-a250-4145-afbc-ba64227d8d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:36.831343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2975-a250-4145-afbc-ba64227d8d36 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:36.831622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2975-a250-4145-afbc-ba64227d8d36 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:36.831896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2975-a250-4145-afbc-ba64227d8d36 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:36.832561 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b2975-a250-4145-afbc-ba64227d8d36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:36.832864 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b2975-a250-4145-afbc-ba64227d8d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:36.834307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b2975-a250-4145-afbc-ba64227d8d36 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:36.843305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 245/480] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:38.386347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727884c-feef-4011-81b3-d7c7088bd329 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:38.387387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727884c-feef-4011-81b3-d7c7088bd329 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:38.387875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727884c-feef-4011-81b3-d7c7088bd329 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:38.389673 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 236/481] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:38.395606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa542-0a0c-4a4a-9aab-70f6034a00f5 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:38.396117 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa542-0a0c-4a4a-9aab-70f6034a00f5 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:38.396202 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa542-0a0c-4a4a-9aab-70f6034a00f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:38.425369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-aaefa542-0a0c-4a4a-9aab-70f6034a00f5 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:38.426620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-aaefa542-0a0c-4a4a-9aab-70f6034a00f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:38.534590 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 246/482] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:38.684431 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dee9b-0b5f-4df4-b7d3-559b3e479841 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:38.684762 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dee9b-0b5f-4df4-b7d3-559b3e479841 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:38.684993 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dee9b-0b5f-4df4-b7d3-559b3e479841 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:38.686458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 237/483] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:38.691937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652adbd-20d5-4fb8-bf7c-1b7fc44ab74a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:38.692230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652adbd-20d5-4fb8-bf7c-1b7fc44ab74a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:38.692502 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652adbd-20d5-4fb8-bf7c-1b7fc44ab74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:38.719461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-c652adbd-20d5-4fb8-bf7c-1b7fc44ab74a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:38.721176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c652adbd-20d5-4fb8-bf7c-1b7fc44ab74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:38.810388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:38.826626 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 247/484] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:38.940648 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dee9b-0b5f-4df4-b7d3-559b3e479841 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:39.074170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dee9b-0b5f-4df4-b7d3-559b3e479841 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:39.110192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29fad7-0ff5-4a49-b9fd-abcbc391897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:39.110855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29fad7-0ff5-4a49-b9fd-abcbc391897f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:39.111165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29fad7-0ff5-4a49-b9fd-abcbc391897f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:39.111438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29fad7-0ff5-4a49-b9fd-abcbc391897f None admin] PATH_INFO: `/v3/roles/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:39.122811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29fad7-0ff5-4a49-b9fd-abcbc391897f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-6d29fad7-0ff5-4a49-b9fd-abcbc391897f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:39.127749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:39.128691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:39.129651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:39.129651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:39.129651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:39.129651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:39.129651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:39.129651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:39.129651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:39.129651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:39.129651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:39.129651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:39.129651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:39.129651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:39.129651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 238/485] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:39.139998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652adbd-20d5-4fb8-bf7c-1b7fc44ab74a None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:39.191743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b08b4c-942c-41f6-96cc-4331c2859fac None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:39.192187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b08b4c-942c-41f6-96cc-4331c2859fac None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:39.192671 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b08b4c-942c-41f6-96cc-4331c2859fac None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:39.194581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 239/486] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:39.198747 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b08b4c-942c-41f6-96cc-4331c2859fac None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:39.270794 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:39.281639 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652adbd-20d5-4fb8-bf7c-1b7fc44ab74a None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:39.317762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e134-a150-497b-b486-9cc43fcbc069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:39.318959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e134-a150-497b-b486-9cc43fcbc069 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:39.319448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e134-a150-497b-b486-9cc43fcbc069 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:39.320373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e134-a150-497b-b486-9cc43fcbc069 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:39.321524 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561e134-a150-497b-b486-9cc43fcbc069 None admin] RBAC: Adding query filter params (name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:39.322007 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561e134-a150-497b-b486-9cc43fcbc069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:39.324275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561e134-a150-497b-b486-9cc43fcbc069 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:39.335777 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 248/487] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:39.337577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145e9d3-c121-4188-a72a-5549b4bd5084 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:39.338304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145e9d3-c121-4188-a72a-5549b4bd5084 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:39.339231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145e9d3-c121-4188-a72a-5549b4bd5084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:39.342687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b08b4c-942c-41f6-96cc-4331c2859fac None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:39.363090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-3145e9d3-c121-4188-a72a-5549b4bd5084 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:39.364970 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3145e9d3-c121-4188-a72a-5549b4bd5084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:39.386880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f9f6a-ef38-4bb5-89fe-0d6c3f654aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:39.387634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f9f6a-ef38-4bb5-89fe-0d6c3f654aa1 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:39.388273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f9f6a-ef38-4bb5-89fe-0d6c3f654aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:39.388627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f9f6a-ef38-4bb5-89fe-0d6c3f654aa1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:39.403627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f9f6a-ef38-4bb5-89fe-0d6c3f654aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-c58f9f6a-ef38-4bb5-89fe-0d6c3f654aa1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:39.410686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:39.411656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:39.412469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:39.412469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:39.412469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:39.412469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:39.412469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:39.412469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:39.412469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:39.412469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:39.412469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:39.412469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:39.412469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:39.412469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:39.412469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 240/488] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:39.413257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f9f6a-ef38-4bb5-89fe-0d6c3f654aa1 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:39.458317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:39.487089 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 249/489] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:39.488667 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145e9d3-c121-4188-a72a-5549b4bd5084 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:39.549959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f9f6a-ef38-4bb5-89fe-0d6c3f654aa1 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:39.551566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:39.589283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561965b-84d5-4a4c-a558-264ff6badd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:39.589829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561965b-84d5-4a4c-a558-264ff6badd3a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:39.590106 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561965b-84d5-4a4c-a558-264ff6badd3a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:39.590374 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561965b-84d5-4a4c-a558-264ff6badd3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:39.600186 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145e9d3-c121-4188-a72a-5549b4bd5084 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:39.603997 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561965b-84d5-4a4c-a558-264ff6badd3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:39.605457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561965b-84d5-4a4c-a558-264ff6badd3a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-6561965b-84d5-4a4c-a558-264ff6badd3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:39.619666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:39.620563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:39.621416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:39.621416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:39.621416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:39.621416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 241/490] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:39.622447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4c3a5-5815-4036-997b-7aa1557ded9a None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:39.622447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4c3a5-5815-4036-997b-7aa1557ded9a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:39.622447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4c3a5-5815-4036-997b-7aa1557ded9a None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:39.623811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 242/491] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:39.624708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c1604-51ab-4556-9523-a05333249ab2 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:39.625247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c1604-51ab-4556-9523-a05333249ab2 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:39.625408 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c1604-51ab-4556-9523-a05333249ab2 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:39.629109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 243/492] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:39.630365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c1604-51ab-4556-9523-a05333249ab2 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:39.643493 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034364c-d50f-430b-a882-bf226ad86d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:39.644096 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034364c-d50f-430b-a882-bf226ad86d04 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:39.644367 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034364c-d50f-430b-a882-bf226ad86d04 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:39.644750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034364c-d50f-430b-a882-bf226ad86d04 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:39.645429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034364c-d50f-430b-a882-bf226ad86d04 None admin] RBAC: Adding query filter params (name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:39.645702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034364c-d50f-430b-a882-bf226ad86d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:39.647100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034364c-d50f-430b-a882-bf226ad86d04 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:39.657145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 250/493] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:39.657145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0fb6a-af4e-437d-8832-8fa1ff3d467a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:39.657145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0fb6a-af4e-437d-8832-8fa1ff3d467a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:39.657145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0fb6a-af4e-437d-8832-8fa1ff3d467a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:39.679247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-04f0fb6a-af4e-437d-8832-8fa1ff3d467a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:39.680873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-04f0fb6a-af4e-437d-8832-8fa1ff3d467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:39.733385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:39.741735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c1604-51ab-4556-9523-a05333249ab2 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:39.759231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 251/494] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:39.761188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8d4f2-9d48-4208-821d-fb0fff9c84eb None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:39.761718 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8d4f2-9d48-4208-821d-fb0fff9c84eb None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:39.762426 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8d4f2-9d48-4208-821d-fb0fff9c84eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:39.775090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cca23-f6c9-4d02-a26a-c781fab5125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:39.775785 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cca23-f6c9-4d02-a26a-c781fab5125f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:39.776065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cca23-f6c9-4d02-a26a-c781fab5125f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:39.776329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cca23-f6c9-4d02-a26a-c781fab5125f None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:39.776959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cca23-f6c9-4d02-a26a-c781fab5125f None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:39.777256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cca23-f6c9-4d02-a26a-c781fab5125f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:39.778645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cca23-f6c9-4d02-a26a-c781fab5125f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:39.782916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-30f8d4f2-9d48-4208-821d-fb0fff9c84eb None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:39.784595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-30f8d4f2-9d48-4208-821d-fb0fff9c84eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:39.790980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 244/495] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:39.792006 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cca23-f6c9-4d02-a26a-c781fab5125f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:39.809830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:39.854144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 252/496] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:39.855230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8d4f2-9d48-4208-821d-fb0fff9c84eb None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:39.918391 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cca23-f6c9-4d02-a26a-c781fab5125f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:39.961013 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8d4f2-9d48-4208-821d-fb0fff9c84eb None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:39.964503 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea5b04-8bd3-436c-80e8-4cadce8d04bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:39.965197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea5b04-8bd3-436c-80e8-4cadce8d04bd None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:39.965539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea5b04-8bd3-436c-80e8-4cadce8d04bd None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:39.965876 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea5b04-8bd3-436c-80e8-4cadce8d04bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:39.974861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:39.977724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea5b04-8bd3-436c-80e8-4cadce8d04bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:39.979607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea5b04-8bd3-436c-80e8-4cadce8d04bd None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-8aea5b04-8bd3-436c-80e8-4cadce8d04bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:39.995337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:39.996275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:39.997123 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:39.997123 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:39.997123 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:39.999210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 245/497] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:40.000257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea5b04-8bd3-436c-80e8-4cadce8d04bd None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:40.003121 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235449fe-db4a-4ac2-bc8b-7180c9d632cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:40.004116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235449fe-db4a-4ac2-bc8b-7180c9d632cb None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:40.004393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235449fe-db4a-4ac2-bc8b-7180c9d632cb None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:40.004660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235449fe-db4a-4ac2-bc8b-7180c9d632cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:40.018940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235449fe-db4a-4ac2-bc8b-7180c9d632cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-235449fe-db4a-4ac2-bc8b-7180c9d632cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:40.024693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:40.025579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:40.026424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:40.026424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:40.026424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:40.026424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:40.026424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:40.026424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:40.026424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:40.026424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:40.026424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:40.026424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:40.026424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:40.026424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:40.026424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 253/498] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:40.027134 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235449fe-db4a-4ac2-bc8b-7180c9d632cb None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:40.077616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:40.118073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea5b04-8bd3-436c-80e8-4cadce8d04bd None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:40.134794 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235449fe-db4a-4ac2-bc8b-7180c9d632cb None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:40.152450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f59188-ce87-4976-a16c-914eedd13707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:40.153072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f59188-ce87-4976-a16c-914eedd13707 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:40.153350 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f59188-ce87-4976-a16c-914eedd13707 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:40.153624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f59188-ce87-4976-a16c-914eedd13707 None admin] PATH_INFO: `/v3/users/nova` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:40.160955 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f59188-ce87-4976-a16c-914eedd13707 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:40.162392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f59188-ce87-4976-a16c-914eedd13707 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:40.168546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f64f10-575a-46df-961e-b79dc1b24564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:40.169131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f64f10-575a-46df-961e-b79dc1b24564 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:40.169404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f64f10-575a-46df-961e-b79dc1b24564 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:40.169726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f64f10-575a-46df-961e-b79dc1b24564 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:40.170354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f64f10-575a-46df-961e-b79dc1b24564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:40.170681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f64f10-575a-46df-961e-b79dc1b24564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:40.172026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f64f10-575a-46df-961e-b79dc1b24564 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-a2f59188-ce87-4976-a16c-914eedd13707 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:40.174686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:40.175549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:40.176433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:40.176433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:40.176433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:40.176433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:40.176433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:40.176433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:40.176433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:40.176433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:40.176433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:21:40.176433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:40.176433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 246/499] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 05:21:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:40.176986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f59188-ce87-4976-a16c-914eedd13707 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:40.185870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 254/500] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:40.186702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f64f10-575a-46df-961e-b79dc1b24564 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:40.219764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:40.280858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f59188-ce87-4976-a16c-914eedd13707 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:40.290435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f64f10-575a-46df-961e-b79dc1b24564 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:40.304718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:40.314703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f87bd-0cdd-47c7-a4a7-67852c9b66d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:40.315319 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f87bd-0cdd-47c7-a4a7-67852c9b66d4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:40.315592 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f87bd-0cdd-47c7-a4a7-67852c9b66d4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:40.315860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f87bd-0cdd-47c7-a4a7-67852c9b66d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:40.323901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78576f-821c-43e4-bbbc-0a2291f408de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:40.324497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78576f-821c-43e4-bbbc-0a2291f408de None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:40.324777 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78576f-821c-43e4-bbbc-0a2291f408de None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:40.325049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78576f-821c-43e4-bbbc-0a2291f408de None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:40.325703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78576f-821c-43e4-bbbc-0a2291f408de None admin] RBAC: Adding query filter params (name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:40.325906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f87bd-0cdd-47c7-a4a7-67852c9b66d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:40.326005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78576f-821c-43e4-bbbc-0a2291f408de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:40.327410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78576f-821c-43e4-bbbc-0a2291f408de None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-701f87bd-0cdd-47c7-a4a7-67852c9b66d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:40.332495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:40.333563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:40.334366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:40.334366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:40.334366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:40.334366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:40.334366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:40.334366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:40.334366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:40.334366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:40.334366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:40.334366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:40.334366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:40.334366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:40.334366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 247/501] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:40.335163 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f87bd-0cdd-47c7-a4a7-67852c9b66d4 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:40.341299 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 255/502] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:40.341299 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78576f-821c-43e4-bbbc-0a2291f408de None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:40.426686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:40.435105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f87bd-0cdd-47c7-a4a7-67852c9b66d4 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:40.435585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78576f-821c-43e4-bbbc-0a2291f408de None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:40.468756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa4bcf-5286-4199-ae5c-fdd0b913dfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:40.469310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8138bfa-809a-4d9e-965d-a9fc5f3a4183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:40.469410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa4bcf-5286-4199-ae5c-fdd0b913dfda None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:40.469515 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8138bfa-809a-4d9e-965d-a9fc5f3a4183 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:40.469599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa4bcf-5286-4199-ae5c-fdd0b913dfda None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:40.469676 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8138bfa-809a-4d9e-965d-a9fc5f3a4183 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:40.469904 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa4bcf-5286-4199-ae5c-fdd0b913dfda None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:40.470002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8138bfa-809a-4d9e-965d-a9fc5f3a4183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:40.470656 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa4bcf-5286-4199-ae5c-fdd0b913dfda None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:40.470960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa4bcf-5286-4199-ae5c-fdd0b913dfda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:40.472397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa4bcf-5286-4199-ae5c-fdd0b913dfda None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:40.481594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8138bfa-809a-4d9e-965d-a9fc5f3a4183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:40.483073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8138bfa-809a-4d9e-965d-a9fc5f3a4183 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-b8138bfa-809a-4d9e-965d-a9fc5f3a4183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:40.498380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:40.499571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:40.500420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:40.500420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:40.500420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:40.500420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 248/503] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:40.500630 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8138bfa-809a-4d9e-965d-a9fc5f3a4183 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:40.512729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 256/504] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 05:21:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:40.512729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa4bcf-5286-4199-ae5c-fdd0b913dfda None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:40.542079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:40.602191 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8138bfa-809a-4d9e-965d-a9fc5f3a4183 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:40.607065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa4bcf-5286-4199-ae5c-fdd0b913dfda None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:40.635003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbcbde-0722-45bf-b494-5948616d3f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:40.635613 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbcbde-0722-45bf-b494-5948616d3f6a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:40.635888 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbcbde-0722-45bf-b494-5948616d3f6a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:40.636152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbcbde-0722-45bf-b494-5948616d3f6a None admin] PATH_INFO: `/v3/users/glance` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:40.640429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e16bae-eb15-4b52-b2c7-05751a7c4fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:40.641028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e16bae-eb15-4b52-b2c7-05751a7c4fcf None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:40.641308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e16bae-eb15-4b52-b2c7-05751a7c4fcf None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:40.641583 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e16bae-eb15-4b52-b2c7-05751a7c4fcf None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:40.642306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e16bae-eb15-4b52-b2c7-05751a7c4fcf None admin] RBAC: Adding query filter params (name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:40.642784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e16bae-eb15-4b52-b2c7-05751a7c4fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:40.643533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbcbde-0722-45bf-b494-5948616d3f6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:40.644176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e16bae-eb15-4b52-b2c7-05751a7c4fcf None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:40.644937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbcbde-0722-45bf-b494-5948616d3f6a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:40.651883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 257/505] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:40.652654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e16bae-eb15-4b52-b2c7-05751a7c4fcf None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-2abbcbde-0722-45bf-b494-5948616d3f6a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:40.656945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:40.657966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:40.659146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:40.659146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:40.659146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:40.659146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:40.659146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:40.659146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:40.659146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:40.659146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:40.659146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 05:21:40.659146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:40.659146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 249/506] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:40.659146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbcbde-0722-45bf-b494-5948616d3f6a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:40.668143 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:40.751977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e16bae-eb15-4b52-b2c7-05751a7c4fcf None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:40.755762 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:40.760055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbcbde-0722-45bf-b494-5948616d3f6a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:40.784712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9809dd-31fb-4d0e-8641-6272c927e8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:40.785332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9809dd-31fb-4d0e-8641-6272c927e8fb None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:40.785611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9809dd-31fb-4d0e-8641-6272c927e8fb None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:40.785884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9809dd-31fb-4d0e-8641-6272c927e8fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:40.792996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688245c-c84e-4ef5-8235-5a323b41b6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:40.793585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688245c-c84e-4ef5-8235-5a323b41b6fc None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:40.793862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688245c-c84e-4ef5-8235-5a323b41b6fc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:40.794128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688245c-c84e-4ef5-8235-5a323b41b6fc None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:40.794783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688245c-c84e-4ef5-8235-5a323b41b6fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:40.795081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688245c-c84e-4ef5-8235-5a323b41b6fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:40.796298 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9809dd-31fb-4d0e-8641-6272c927e8fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:40.796430 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688245c-c84e-4ef5-8235-5a323b41b6fc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:40.797746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9809dd-31fb-4d0e-8641-6272c927e8fb None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:40.807605 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 250/507] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:40.808377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688245c-c84e-4ef5-8235-5a323b41b6fc None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-ad9809dd-31fb-4d0e-8641-6272c927e8fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:40.811422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:40.812638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:40.815350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:40.815350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:40.815350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:40.815350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 258/508] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:40.815350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9809dd-31fb-4d0e-8641-6272c927e8fb None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:40.876240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:40.911378 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688245c-c84e-4ef5-8235-5a323b41b6fc None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:40.913848 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9809dd-31fb-4d0e-8641-6272c927e8fb None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:40.944334 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979efc6-fa37-41b7-9f6f-7af380622786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:40.944925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979efc6-fa37-41b7-9f6f-7af380622786 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:40.945206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979efc6-fa37-41b7-9f6f-7af380622786 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:40.945476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979efc6-fa37-41b7-9f6f-7af380622786 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:40.946633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08073dc-754a-481e-b57a-71fa097c249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:40.947274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08073dc-754a-481e-b57a-71fa097c249e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:40.947552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08073dc-754a-481e-b57a-71fa097c249e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:40.947819 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08073dc-754a-481e-b57a-71fa097c249e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:40.958412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08073dc-754a-481e-b57a-71fa097c249e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:40.959890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08073dc-754a-481e-b57a-71fa097c249e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:40.972896 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-f08073dc-754a-481e-b57a-71fa097c249e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:40.973459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:40.974962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:40.976058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:40.976058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:40.976058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:40.976058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 259/509] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:40.976058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08073dc-754a-481e-b57a-71fa097c249e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:41.018930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979efc6-fa37-41b7-9f6f-7af380622786 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:41.020310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979efc6-fa37-41b7-9f6f-7af380622786 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:41.073947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08073dc-754a-481e-b57a-71fa097c249e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:41.089907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:41.107598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4105d-11af-4bb2-8d58-ba4d0157fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:41.108206 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4105d-11af-4bb2-8d58-ba4d0157fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:41.108488 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4105d-11af-4bb2-8d58-ba4d0157fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:41.108765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4105d-11af-4bb2-8d58-ba4d0157fbf2 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:41.109484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4105d-11af-4bb2-8d58-ba4d0157fbf2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:41.109794 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4105d-11af-4bb2-8d58-ba4d0157fbf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:41.111803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4105d-11af-4bb2-8d58-ba4d0157fbf2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:41.118147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 251/510] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:41.118985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979efc6-fa37-41b7-9f6f-7af380622786 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:41.129437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 260/511] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 16 05:21:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:41.130113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4105d-11af-4bb2-8d58-ba4d0157fbf2 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:41.176375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:41.217555 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979efc6-fa37-41b7-9f6f-7af380622786 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:41.231880 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4105d-11af-4bb2-8d58-ba4d0157fbf2 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:41.252809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58706b66-8663-4b99-85af-26e0f202180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:41.253432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58706b66-8663-4b99-85af-26e0f202180b None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:41.253710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58706b66-8663-4b99-85af-26e0f202180b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:41.253977 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58706b66-8663-4b99-85af-26e0f202180b None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:41.254705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58706b66-8663-4b99-85af-26e0f202180b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:41.256137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58706b66-8663-4b99-85af-26e0f202180b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:41.267860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f59bb2-8601-4b6b-b3f9-72cbcef7d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:41.268840 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f59bb2-8601-4b6b-b3f9-72cbcef7d848 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:41.269382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f59bb2-8601-4b6b-b3f9-72cbcef7d848 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:41.269793 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f59bb2-8601-4b6b-b3f9-72cbcef7d848 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:41.270617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f59bb2-8601-4b6b-b3f9-72cbcef7d848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:41.270985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f59bb2-8601-4b6b-b3f9-72cbcef7d848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:41.272588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f59bb2-8601-4b6b-b3f9-72cbcef7d848 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:41.279878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 252/512] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:21:41 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:21:41.280688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58706b66-8663-4b99-85af-26e0f202180b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:41.299289 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 261/513] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:41.299289 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f59bb2-8601-4b6b-b3f9-72cbcef7d848 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:41.334910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:41.399032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58706b66-8663-4b99-85af-26e0f202180b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:41.411746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f59bb2-8601-4b6b-b3f9-72cbcef7d848 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:41.414730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:41.439040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85791460-3e23-4c67-ab9e-1c441fcf7a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:41.439689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85791460-3e23-4c67-ab9e-1c441fcf7a1c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:41.439919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85791460-3e23-4c67-ab9e-1c441fcf7a1c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:41.440188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85791460-3e23-4c67-ab9e-1c441fcf7a1c None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:41.440862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85791460-3e23-4c67-ab9e-1c441fcf7a1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:41.441135 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85791460-3e23-4c67-ab9e-1c441fcf7a1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:41.442533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85791460-3e23-4c67-ab9e-1c441fcf7a1c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:41.454378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a2106-4904-43cc-9f5e-e49c49b98d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:41.455759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a2106-4904-43cc-9f5e-e49c49b98d15 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:41.456036 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a2106-4904-43cc-9f5e-e49c49b98d15 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:41.456307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a2106-4904-43cc-9f5e-e49c49b98d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:41.459655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 253/514] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:41.460661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85791460-3e23-4c67-ab9e-1c441fcf7a1c None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:41.467570 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a2106-4904-43cc-9f5e-e49c49b98d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:41.469078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a2106-4904-43cc-9f5e-e49c49b98d15 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-751a2106-4904-43cc-9f5e-e49c49b98d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:41.487685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:41.489425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:41.490999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:41.490999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:41.490999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:41.493458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 262/515] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:41.494362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a2106-4904-43cc-9f5e-e49c49b98d15 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:41.581706 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85791460-3e23-4c67-ab9e-1c441fcf7a1c None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:41.588011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:41.606293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a2106-4904-43cc-9f5e-e49c49b98d15 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:41.619080 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411840d-2817-46b0-8d60-4ba19dc8f515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:41.619813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411840d-2817-46b0-8d60-4ba19dc8f515 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:41.620189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411840d-2817-46b0-8d60-4ba19dc8f515 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:41.620466 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411840d-2817-46b0-8d60-4ba19dc8f515 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:41.640343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efa5b5-6976-47ae-b07f-6733b14da3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:41.640959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efa5b5-6976-47ae-b07f-6733b14da3a6 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:41.641235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efa5b5-6976-47ae-b07f-6733b14da3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:41.641597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efa5b5-6976-47ae-b07f-6733b14da3a6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:41.649965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efa5b5-6976-47ae-b07f-6733b14da3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:41.651456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efa5b5-6976-47ae-b07f-6733b14da3a6 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-b6efa5b5-6976-47ae-b07f-6733b14da3a6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:41.664281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:41.665382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:41.666279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:41.666279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:41.666279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:41.666279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:41.666279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:41.666279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:41.666279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:41.666279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:41.666279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 05:21:41.666279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:41.666279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 263/516] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:41.666903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efa5b5-6976-47ae-b07f-6733b14da3a6 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:41.673689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:41.702028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411840d-2817-46b0-8d60-4ba19dc8f515 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:41.703518 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411840d-2817-46b0-8d60-4ba19dc8f515 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:41.770871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efa5b5-6976-47ae-b07f-6733b14da3a6 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:41.805879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e8ec8-7905-49b3-bad1-566df2474b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:41.806099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 254/517] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:41.806794 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411840d-2817-46b0-8d60-4ba19dc8f515 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:41.807040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8ec8-7905-49b3-bad1-566df2474b6f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:41.807501 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8ec8-7905-49b3-bad1-566df2474b6f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:41.807915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8ec8-7905-49b3-bad1-566df2474b6f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:41.818980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e8ec8-7905-49b3-bad1-566df2474b6f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:41.821264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e8ec8-7905-49b3-bad1-566df2474b6f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-629e8ec8-7905-49b3-bad1-566df2474b6f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:41.834983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:41.835892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:41.836768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:41.836768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:41.836768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:41.836768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:41.836768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:41.836768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:41.836768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:41.836768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:41.836768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 05:21:41.836768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:41.836768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 264/518] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:41.836768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e8ec8-7905-49b3-bad1-566df2474b6f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:41.848108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:41.917674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:41.946277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e8ec8-7905-49b3-bad1-566df2474b6f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:41.953119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411840d-2817-46b0-8d60-4ba19dc8f515 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:41.980452 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f00749-518c-4dea-9421-e57cad320d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:41.981057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f00749-518c-4dea-9421-e57cad320d2a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:41.981342 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f00749-518c-4dea-9421-e57cad320d2a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:41.981610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f00749-518c-4dea-9421-e57cad320d2a None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:41.982337 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f00749-518c-4dea-9421-e57cad320d2a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:41.982725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f00749-518c-4dea-9421-e57cad320d2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:41.984188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f00749-518c-4dea-9421-e57cad320d2a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:41.989749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac84beb-7d38-461e-9994-e9d083c07373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:41.990419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac84beb-7d38-461e-9994-e9d083c07373 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:41.990787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac84beb-7d38-461e-9994-e9d083c07373 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:41.991125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac84beb-7d38-461e-9994-e9d083c07373 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:41.991831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac84beb-7d38-461e-9994-e9d083c07373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:41.992212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac84beb-7d38-461e-9994-e9d083c07373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:41.993716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac84beb-7d38-461e-9994-e9d083c07373 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:42.007782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 265/519] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 16 05:21:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:42.007782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f00749-518c-4dea-9421-e57cad320d2a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:42.010722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 255/520] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:42.011623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac84beb-7d38-461e-9994-e9d083c07373 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:42.077108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:42.117800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f00749-518c-4dea-9421-e57cad320d2a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:42.119261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac84beb-7d38-461e-9994-e9d083c07373 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:42.153756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e18b4d-40bc-4e95-b531-5cb413c55180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:42.154222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53914d-748a-48e5-8e34-73c1590edf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:42.154617 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e18b4d-40bc-4e95-b531-5cb413c55180 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:42.154884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53914d-748a-48e5-8e34-73c1590edf60 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:42.155084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e18b4d-40bc-4e95-b531-5cb413c55180 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:42.155196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53914d-748a-48e5-8e34-73c1590edf60 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:42.155418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53914d-748a-48e5-8e34-73c1590edf60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:42.155630 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e18b4d-40bc-4e95-b531-5cb413c55180 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:42.156450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e18b4d-40bc-4e95-b531-5cb413c55180 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:42.156855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e18b4d-40bc-4e95-b531-5cb413c55180 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:42.158439 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e18b4d-40bc-4e95-b531-5cb413c55180 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:42.160605 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:42.166077 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53914d-748a-48e5-8e34-73c1590edf60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:42.167598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53914d-748a-48e5-8e34-73c1590edf60 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-8d53914d-748a-48e5-8e34-73c1590edf60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:42.183030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:42.184141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:42.185165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:42.185165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:42.185165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:42.186812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 266/521] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:42.189736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53914d-748a-48e5-8e34-73c1590edf60 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:42.206685 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 256/522] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Sep 16 05:21:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:42.206685 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e18b4d-40bc-4e95-b531-5cb413c55180 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:42.309389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53914d-748a-48e5-8e34-73c1590edf60 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:42.315657 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e18b4d-40bc-4e95-b531-5cb413c55180 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:42.326238 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:42.345397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c79c1b-bcaa-486c-8002-cb46e717064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:42.346098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c79c1b-bcaa-486c-8002-cb46e717064c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:42.346487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c79c1b-bcaa-486c-8002-cb46e717064c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:42.346783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c79c1b-bcaa-486c-8002-cb46e717064c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:42.351196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82ad87-babc-4443-acfb-c7156248965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:42.351814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82ad87-babc-4443-acfb-c7156248965b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:42.352087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82ad87-babc-4443-acfb-c7156248965b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:42.352353 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82ad87-babc-4443-acfb-c7156248965b None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:42.358806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82ad87-babc-4443-acfb-c7156248965b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:42.360263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82ad87-babc-4443-acfb-c7156248965b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-7e82ad87-babc-4443-acfb-c7156248965b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:42.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:42.373172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:42.374028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:42.374028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:42.374028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:42.374028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:42.374028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:42.374028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:42.374028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:42.374028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:42.374028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 257/523] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:42.374974 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82ad87-babc-4443-acfb-c7156248965b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:42.422734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c79c1b-bcaa-486c-8002-cb46e717064c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:42.424533 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c79c1b-bcaa-486c-8002-cb46e717064c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:42.432287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:42.482984 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82ad87-babc-4443-acfb-c7156248965b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:42.519009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b030f-1d9b-4cdb-a963-e1b58d4be2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:42.519610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b030f-1d9b-4cdb-a963-e1b58d4be2d3 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:42.519884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b030f-1d9b-4cdb-a963-e1b58d4be2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:42.520152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b030f-1d9b-4cdb-a963-e1b58d4be2d3 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:42.520786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b030f-1d9b-4cdb-a963-e1b58d4be2d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:42.521078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b030f-1d9b-4cdb-a963-e1b58d4be2d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:42.522452 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b030f-1d9b-4cdb-a963-e1b58d4be2d3 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:42.536122 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 267/524] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:42.536122 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c79c1b-bcaa-486c-8002-cb46e717064c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:42.541787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 258/525] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:42.546319 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b030f-1d9b-4cdb-a963-e1b58d4be2d3 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:42.553344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:42.650245 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b030f-1d9b-4cdb-a963-e1b58d4be2d3 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:42.650699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c79c1b-bcaa-486c-8002-cb46e717064c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:42.665203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:42.687485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ec359-35fb-4f34-9079-b8becf24a3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:42.688339 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ec359-35fb-4f34-9079-b8becf24a3db None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:42.688621 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ec359-35fb-4f34-9079-b8becf24a3db None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:42.689475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ec359-35fb-4f34-9079-b8becf24a3db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:42.690741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91734d-1a95-4c97-8c9d-1d1ae75b50a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:42.691400 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91734d-1a95-4c97-8c9d-1d1ae75b50a4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:42.691744 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91734d-1a95-4c97-8c9d-1d1ae75b50a4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:42.692079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91734d-1a95-4c97-8c9d-1d1ae75b50a4 None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:42.693385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91734d-1a95-4c97-8c9d-1d1ae75b50a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:42.693385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91734d-1a95-4c97-8c9d-1d1ae75b50a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:42.694645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91734d-1a95-4c97-8c9d-1d1ae75b50a4 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:42.713315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 259/526] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:42.714190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91734d-1a95-4c97-8c9d-1d1ae75b50a4 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:42.764988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ec359-35fb-4f34-9079-b8becf24a3db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:42.766584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ec359-35fb-4f34-9079-b8becf24a3db None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:42.783688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:42.828854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91734d-1a95-4c97-8c9d-1d1ae75b50a4 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:42.866107 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03cfad-8cf2-4b99-8df9-7486a8c327fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:42.866772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03cfad-8cf2-4b99-8df9-7486a8c327fd None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:42.867051 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03cfad-8cf2-4b99-8df9-7486a8c327fd None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:42.867319 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03cfad-8cf2-4b99-8df9-7486a8c327fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:42.873076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 268/527] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:42.873076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ec359-35fb-4f34-9079-b8becf24a3db None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:42.888482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03cfad-8cf2-4b99-8df9-7486a8c327fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:42.890533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03cfad-8cf2-4b99-8df9-7486a8c327fd None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-3e03cfad-8cf2-4b99-8df9-7486a8c327fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:42.909581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:42.910877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:42.911941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:42.911941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:42.911941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:42.912139 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 260/528] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:42.917031 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03cfad-8cf2-4b99-8df9-7486a8c327fd None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:42.940730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:42.979669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ec359-35fb-4f34-9079-b8becf24a3db None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:42.996472 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:43.016399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18ae60-7c0c-487c-8b52-b52d096440b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:43.017954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ae60-7c0c-487c-8b52-b52d096440b8 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:43.018227 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ae60-7c0c-487c-8b52-b52d096440b8 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:43.018485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ae60-7c0c-487c-8b52-b52d096440b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:43.023191 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03cfad-8cf2-4b99-8df9-7486a8c327fd None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:43.025180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18ae60-7c0c-487c-8b52-b52d096440b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:43.026836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18ae60-7c0c-487c-8b52-b52d096440b8 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-9e18ae60-7c0c-487c-8b52-b52d096440b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:43.038497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:43.039574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:43.040602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:43.040602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:43.040602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:43.040602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:43.040602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:43.040602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:43.040602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:43.040602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:43.044441 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 269/529] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:43.045081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18ae60-7c0c-487c-8b52-b52d096440b8 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:43.060750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3fda7-3ca8-464a-b410-4a21abbf0473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:43.061484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3fda7-3ca8-464a-b410-4a21abbf0473 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:43.061864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3fda7-3ca8-464a-b410-4a21abbf0473 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:43.062236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3fda7-3ca8-464a-b410-4a21abbf0473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:43.063348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3fda7-3ca8-464a-b410-4a21abbf0473 None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=515e548efd984b87bca742e26eec162a) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:43.063778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3fda7-3ca8-464a-b410-4a21abbf0473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:43.065724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3fda7-3ca8-464a-b410-4a21abbf0473 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:43.071272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 261/530] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:42 2022] GET /identity/v3/role_assignments?user.id=515e548efd984b87bca742e26eec162a&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:43.071846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3fda7-3ca8-464a-b410-4a21abbf0473 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:43.188527 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:43.201163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18ae60-7c0c-487c-8b52-b52d096440b8 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:43.203500 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3fda7-3ca8-464a-b410-4a21abbf0473 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:43.253939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe688aa-f2a7-48d1-9a9b-d579e0a8cc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:43.254782 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe688aa-f2a7-48d1-9a9b-d579e0a8cc3b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:43.255163 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe688aa-f2a7-48d1-9a9b-d579e0a8cc3b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:43.255520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe688aa-f2a7-48d1-9a9b-d579e0a8cc3b None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:43.256279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe688aa-f2a7-48d1-9a9b-d579e0a8cc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:43.256676 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe688aa-f2a7-48d1-9a9b-d579e0a8cc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:43.257737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d9ff1-455c-491e-9ac0-732e95336173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:43.258272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe688aa-f2a7-48d1-9a9b-d579e0a8cc3b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:43.258724 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d9ff1-455c-491e-9ac0-732e95336173 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:43.259318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d9ff1-455c-491e-9ac0-732e95336173 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:43.259745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d9ff1-455c-491e-9ac0-732e95336173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:43.279873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 262/531] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:43.279873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe688aa-f2a7-48d1-9a9b-d579e0a8cc3b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:43.281507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d9ff1-455c-491e-9ac0-732e95336173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:43.283696 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d9ff1-455c-491e-9ac0-732e95336173 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-4f2d9ff1-455c-491e-9ac0-732e95336173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:43.299133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:43.300065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:43.302447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:43.302447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:43.302447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:43.302447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 270/532] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:43.302447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d9ff1-455c-491e-9ac0-732e95336173 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:43.338897 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:43.403410 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe688aa-f2a7-48d1-9a9b-d579e0a8cc3b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:43.408893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d9ff1-455c-491e-9ac0-732e95336173 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:43.448996 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54b0b1-0bf1-4e9c-a447-45055fea961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:43.449264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19241b1d-cdd1-4b75-8806-79a04d78ba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:43.450036 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19241b1d-cdd1-4b75-8806-79a04d78ba3a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:43.450259 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54b0b1-0bf1-4e9c-a447-45055fea961e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:43.450364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19241b1d-cdd1-4b75-8806-79a04d78ba3a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:43.450728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19241b1d-cdd1-4b75-8806-79a04d78ba3a None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:43.450993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54b0b1-0bf1-4e9c-a447-45055fea961e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:43.451427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54b0b1-0bf1-4e9c-a447-45055fea961e None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:43.451541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19241b1d-cdd1-4b75-8806-79a04d78ba3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:43.451896 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19241b1d-cdd1-4b75-8806-79a04d78ba3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:43.453471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19241b1d-cdd1-4b75-8806-79a04d78ba3a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:43.459437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54b0b1-0bf1-4e9c-a447-45055fea961e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:43.461127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54b0b1-0bf1-4e9c-a447-45055fea961e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-8c54b0b1-0bf1-4e9c-a447-45055fea961e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:43.473321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:43.474199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:43.475094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:43.475094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:43.475094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:43.475094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:43.475094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:43.475094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:43.475094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:43.475094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:43.475509 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 263/533] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:43.475509 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19241b1d-cdd1-4b75-8806-79a04d78ba3a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:43.477848 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 271/534] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:43.479217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54b0b1-0bf1-4e9c-a447-45055fea961e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:43.495289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:43.577810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:43.593246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54b0b1-0bf1-4e9c-a447-45055fea961e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:43.599589 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19241b1d-cdd1-4b75-8806-79a04d78ba3a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:43.631805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55769bca-8921-4b1b-b4a3-4eeb2d6171ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:43.632407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769bca-8921-4b1b-b4a3-4eeb2d6171ef None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:43.632699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769bca-8921-4b1b-b4a3-4eeb2d6171ef None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:43.632879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8a23c-bf0b-496f-96d6-b5eb0953b655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:43.632986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769bca-8921-4b1b-b4a3-4eeb2d6171ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:43.633480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8a23c-bf0b-496f-96d6-b5eb0953b655 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:43.633665 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55769bca-8921-4b1b-b4a3-4eeb2d6171ef None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=20d8e253a72c44f7a5a986f981660df2) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:43.633757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8a23c-bf0b-496f-96d6-b5eb0953b655 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:43.633984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55769bca-8921-4b1b-b4a3-4eeb2d6171ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:43.634080 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8a23c-bf0b-496f-96d6-b5eb0953b655 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:43.634668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8a23c-bf0b-496f-96d6-b5eb0953b655 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:43.634973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8a23c-bf0b-496f-96d6-b5eb0953b655 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:43.635450 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55769bca-8921-4b1b-b4a3-4eeb2d6171ef None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:43.636328 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8a23c-bf0b-496f-96d6-b5eb0953b655 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:43.650892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 272/535] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:43 2022] GET /identity/v3/role_assignments?user.id=20d8e253a72c44f7a5a986f981660df2&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:43.650892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55769bca-8921-4b1b-b4a3-4eeb2d6171ef None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:43.665350 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 264/536] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:43.666849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766b5aa-c2ab-4042-82ac-0817f5d276a5 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:43.667130 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766b5aa-c2ab-4042-82ac-0817f5d276a5 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:43.667404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766b5aa-c2ab-4042-82ac-0817f5d276a5 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:43.673078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 265/537] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:43.673078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766b5aa-c2ab-4042-82ac-0817f5d276a5 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:43.751806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:43.791986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55769bca-8921-4b1b-b4a3-4eeb2d6171ef None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:43.799773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766b5aa-c2ab-4042-82ac-0817f5d276a5 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:43.843866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aad82f-99ef-49e8-88e5-d405fbf99e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:43.844869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aad82f-99ef-49e8-88e5-d405fbf99e63 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:43.845943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aad82f-99ef-49e8-88e5-d405fbf99e63 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:43.846416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aad82f-99ef-49e8-88e5-d405fbf99e63 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:43.847354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aad82f-99ef-49e8-88e5-d405fbf99e63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:43.847860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aad82f-99ef-49e8-88e5-d405fbf99e63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:43.849776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aad82f-99ef-49e8-88e5-d405fbf99e63 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:43.855692 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f4e18-0be4-4720-aa23-95ffecb56aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:43.856610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f4e18-0be4-4720-aa23-95ffecb56aa2 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:43.857032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f4e18-0be4-4720-aa23-95ffecb56aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:43.857444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f4e18-0be4-4720-aa23-95ffecb56aa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:43.871444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f4e18-0be4-4720-aa23-95ffecb56aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:43.872902 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f4e18-0be4-4720-aa23-95ffecb56aa2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:43.878586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 273/538] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:43.880039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec2bc9-91ae-4efc-b86c-d5c83f525580 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:43.880324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec2bc9-91ae-4efc-b86c-d5c83f525580 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:43.880598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec2bc9-91ae-4efc-b86c-d5c83f525580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-1a2f4e18-0be4-4720-aa23-95ffecb56aa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:43.890989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:43.891900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:43.892739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:43.892739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:43.892739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:43.892739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:43.892739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:43.892739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:43.892739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:43.892739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:43.897444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 266/539] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:43.898338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f4e18-0be4-4720-aa23-95ffecb56aa2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:43.902903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-89ec2bc9-91ae-4efc-b86c-d5c83f525580 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:43.904169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-89ec2bc9-91ae-4efc-b86c-d5c83f525580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:43.913071 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:43.986656 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 274/540] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:43.987753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec2bc9-91ae-4efc-b86c-d5c83f525580 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:44.029577 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f4e18-0be4-4720-aa23-95ffecb56aa2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:44.080664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:44.098149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52136614-413a-462c-989f-ef809d4d00b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:44.098791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52136614-413a-462c-989f-ef809d4d00b9 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:44.099079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52136614-413a-462c-989f-ef809d4d00b9 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:44.099356 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52136614-413a-462c-989f-ef809d4d00b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:44.100090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52136614-413a-462c-989f-ef809d4d00b9 None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=fc48962e649c40ca82cf3173ce9940e9) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:44.100398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52136614-413a-462c-989f-ef809d4d00b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:44.102152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52136614-413a-462c-989f-ef809d4d00b9 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:44.114321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 267/541] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:43 2022] GET /identity/v3/role_assignments?user.id=fc48962e649c40ca82cf3173ce9940e9&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:44.185674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec2bc9-91ae-4efc-b86c-d5c83f525580 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:44.245418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17ad9e-12ce-4bb3-b7fa-80aa9e398fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:44.246370 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17ad9e-12ce-4bb3-b7fa-80aa9e398fb0 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:44.246895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17ad9e-12ce-4bb3-b7fa-80aa9e398fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:44.247393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17ad9e-12ce-4bb3-b7fa-80aa9e398fb0 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:44.248345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17ad9e-12ce-4bb3-b7fa-80aa9e398fb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:44.248926 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17ad9e-12ce-4bb3-b7fa-80aa9e398fb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:44.250663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17ad9e-12ce-4bb3-b7fa-80aa9e398fb0 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:44.268228 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 275/542] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:44.274657 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52136614-413a-462c-989f-ef809d4d00b9 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:44.373770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17ad9e-12ce-4bb3-b7fa-80aa9e398fb0 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:44.377211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:44.403361 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52136614-413a-462c-989f-ef809d4d00b9 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:44.469536 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99510ef8-000d-4a59-9375-4880d7501b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:44.470820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99510ef8-000d-4a59-9375-4880d7501b28 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:44.471104 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99510ef8-000d-4a59-9375-4880d7501b28 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:44.471379 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99510ef8-000d-4a59-9375-4880d7501b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:44.472109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99510ef8-000d-4a59-9375-4880d7501b28 None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=d51f44d06b0f4303a753709bd1bcf3e5) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:44.472416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99510ef8-000d-4a59-9375-4880d7501b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:44.473852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99510ef8-000d-4a59-9375-4880d7501b28 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:44.489874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 268/543] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:44 2022] GET /identity/v3/role_assignments?user.id=d51f44d06b0f4303a753709bd1bcf3e5&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:44.539235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17ad9e-12ce-4bb3-b7fa-80aa9e398fb0 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:44.598893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c8ed1-b0fb-41e2-b8c4-59e2a5d85dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:44.600572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c8ed1-b0fb-41e2-b8c4-59e2a5d85dc6 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:44.601149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c8ed1-b0fb-41e2-b8c4-59e2a5d85dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:44.601627 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c8ed1-b0fb-41e2-b8c4-59e2a5d85dc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:44.617771 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c8ed1-b0fb-41e2-b8c4-59e2a5d85dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-749c8ed1-b0fb-41e2-b8c4-59e2a5d85dc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:44.623222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:44.624197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:44.625008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:44.625008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:44.625008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:44.625008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:44.625008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:44.625008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:44.625008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:44.625008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:44.625008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:44.625008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:44.625008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:44.625008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:44.625008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 276/544] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:44.630656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99510ef8-000d-4a59-9375-4880d7501b28 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:44.695617 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:44.745995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99510ef8-000d-4a59-9375-4880d7501b28 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:44.783317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ac8ee-c1cf-4be3-bb82-fe68e91eb9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:44.783929 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ac8ee-c1cf-4be3-bb82-fe68e91eb9c3 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:44.784212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ac8ee-c1cf-4be3-bb82-fe68e91eb9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:44.784484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ac8ee-c1cf-4be3-bb82-fe68e91eb9c3 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:44.785149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ac8ee-c1cf-4be3-bb82-fe68e91eb9c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:44.785450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ac8ee-c1cf-4be3-bb82-fe68e91eb9c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:44.786857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ac8ee-c1cf-4be3-bb82-fe68e91eb9c3 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:44.795430 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 269/545] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:44.801828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c8ed1-b0fb-41e2-b8c4-59e2a5d85dc6 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:44.868302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:44.910853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c8ed1-b0fb-41e2-b8c4-59e2a5d85dc6 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:44.946284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760cbf8-8789-4af6-a3ad-6548595c839f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:44.946946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760cbf8-8789-4af6-a3ad-6548595c839f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:44.947228 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760cbf8-8789-4af6-a3ad-6548595c839f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:44.947505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760cbf8-8789-4af6-a3ad-6548595c839f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:44.958401 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760cbf8-8789-4af6-a3ad-6548595c839f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:44.959993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760cbf8-8789-4af6-a3ad-6548595c839f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-b760cbf8-8789-4af6-a3ad-6548595c839f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:44.974532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:44.976565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:44.978592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:44.978592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:44.978592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:44.978592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 277/546] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:44.981463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ac8ee-c1cf-4be3-bb82-fe68e91eb9c3 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:45.122260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ac8ee-c1cf-4be3-bb82-fe68e91eb9c3 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:45.140435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:45.158047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c51c3-f67e-4991-b26b-bf72d6d76d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:45.158683 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c51c3-f67e-4991-b26b-bf72d6d76d78 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:45.158966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c51c3-f67e-4991-b26b-bf72d6d76d78 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:45.159236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c51c3-f67e-4991-b26b-bf72d6d76d78 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:45.159877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c51c3-f67e-4991-b26b-bf72d6d76d78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:45.160179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c51c3-f67e-4991-b26b-bf72d6d76d78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:45.161602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c51c3-f67e-4991-b26b-bf72d6d76d78 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:45.174592 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 270/547] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:45.179798 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760cbf8-8789-4af6-a3ad-6548595c839f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:45.331299 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760cbf8-8789-4af6-a3ad-6548595c839f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:45.346621 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:45.378111 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db201c6d-86e1-4c6b-802a-83ba307d79cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:45.378770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db201c6d-86e1-4c6b-802a-83ba307d79cb None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:45.379053 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db201c6d-86e1-4c6b-802a-83ba307d79cb None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:45.379326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db201c6d-86e1-4c6b-802a-83ba307d79cb None admin] PATH_INFO: `/v3/users/swift` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:45.387341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db201c6d-86e1-4c6b-802a-83ba307d79cb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:45.388886 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db201c6d-86e1-4c6b-802a-83ba307d79cb None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-db201c6d-86e1-4c6b-802a-83ba307d79cb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:45.405539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:45.407270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:45.409109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:45.409109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:45.409109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:45.409109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:45.409109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:45.409109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:45.409109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:45.409109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:45.409109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 05:21:45.409109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:45.409109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 278/548] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:21:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:45.413381 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c51c3-f67e-4991-b26b-bf72d6d76d78 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:45.546954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b687e09-7a77-4e10-a9be-8ce9b420f164 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:45.547244 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b687e09-7a77-4e10-a9be-8ce9b420f164 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:45.547563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b687e09-7a77-4e10-a9be-8ce9b420f164 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:45.549720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 279/549] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:45.555832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc40927-b4a4-4cf3-9b91-4174deb8994b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:45.556302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc40927-b4a4-4cf3-9b91-4174deb8994b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:45.556766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc40927-b4a4-4cf3-9b91-4174deb8994b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:45.561980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c51c3-f67e-4991-b26b-bf72d6d76d78 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:45.590490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-efc40927-b4a4-4cf3-9b91-4174deb8994b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:45.591834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-efc40927-b4a4-4cf3-9b91-4174deb8994b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:45.600393 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24c787-309d-42d3-a82d-bb503312dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:45.601415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24c787-309d-42d3-a82d-bb503312dad0 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:45.601879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24c787-309d-42d3-a82d-bb503312dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:45.602342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24c787-309d-42d3-a82d-bb503312dad0 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:45.603270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24c787-309d-42d3-a82d-bb503312dad0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:45.603754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24c787-309d-42d3-a82d-bb503312dad0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:45.605381 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24c787-309d-42d3-a82d-bb503312dad0 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:45.630273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 271/550] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 16 05:21:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:45.636404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24c787-309d-42d3-a82d-bb503312dad0 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:45.686958 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:45.731855 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 280/551] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:45.784809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24c787-309d-42d3-a82d-bb503312dad0 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:45.832739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbe54f-9443-4152-99bf-0cfc6d931496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:45.833632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbe54f-9443-4152-99bf-0cfc6d931496 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:45.834093 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbe54f-9443-4152-99bf-0cfc6d931496 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:45.834597 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbe54f-9443-4152-99bf-0cfc6d931496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:45.924704 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbe54f-9443-4152-99bf-0cfc6d931496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:45.926617 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbe54f-9443-4152-99bf-0cfc6d931496 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:45.971007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:46.065018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 272/552] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 05:21:46.070637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc40927-b4a4-4cf3-9b91-4174deb8994b None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:46.155475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbe54f-9443-4152-99bf-0cfc6d931496 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:46.231767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc40927-b4a4-4cf3-9b91-4174deb8994b None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:46.246886 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:46.314277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832675e-73ef-40fb-84d8-b36965e9a172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:46.314946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832675e-73ef-40fb-84d8-b36965e9a172 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:46.315219 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832675e-73ef-40fb-84d8-b36965e9a172 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:46.315487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832675e-73ef-40fb-84d8-b36965e9a172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:46.339533 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832675e-73ef-40fb-84d8-b36965e9a172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:46.341712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832675e-73ef-40fb-84d8-b36965e9a172 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:46.349258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbe54f-9443-4152-99bf-0cfc6d931496 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-4832675e-73ef-40fb-84d8-b36965e9a172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:46.361215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:46.362248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:46.363216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:46.363216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:46.363216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:46.363216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 281/553] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:46.365103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f748-468b-4e95-8c9d-712110c94f37 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:46.365479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f748-468b-4e95-8c9d-712110c94f37 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:46.366194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f748-468b-4e95-8c9d-712110c94f37 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:46.367954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 282/554] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:46.371567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68f748-468b-4e95-8c9d-712110c94f37 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:46.390497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf6aa3-f167-445d-9351-4e0d7921a319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:46.391330 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6aa3-f167-445d-9351-4e0d7921a319 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:46.391614 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6aa3-f167-445d-9351-4e0d7921a319 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:46.391915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6aa3-f167-445d-9351-4e0d7921a319 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:46.395261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:46.404112 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf6aa3-f167-445d-9351-4e0d7921a319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-efdf6aa3-f167-445d-9351-4e0d7921a319 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:46.409612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:46.411866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:46.414087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:46.414087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:46.414087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:46.414087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:46.414087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:46.414087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:46.414087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:46.414087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:46.414087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:46.414087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:46.414087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:46.414087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:46.414087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 273/555] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:46.420870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06edcb-f4a2-4c8f-bfb7-d6b12b72c704 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:46.420870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06edcb-f4a2-4c8f-bfb7-d6b12b72c704 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:46.420870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06edcb-f4a2-4c8f-bfb7-d6b12b72c704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:46.437249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-4d06edcb-f4a2-4c8f-bfb7-d6b12b72c704 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:46.439932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4d06edcb-f4a2-4c8f-bfb7-d6b12b72c704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:46.484353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68f748-468b-4e95-8c9d-712110c94f37 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:46.520341 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 274/556] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:46.521204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06edcb-f4a2-4c8f-bfb7-d6b12b72c704 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:46.545442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66f146-9a07-455c-aace-d9be0fc764d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:46.546046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66f146-9a07-455c-aace-d9be0fc764d2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:46.546320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66f146-9a07-455c-aace-d9be0fc764d2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:46.546615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66f146-9a07-455c-aace-d9be0fc764d2 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:46.547259 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66f146-9a07-455c-aace-d9be0fc764d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:46.547551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66f146-9a07-455c-aace-d9be0fc764d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:46.549738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66f146-9a07-455c-aace-d9be0fc764d2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:46.570941 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 283/557] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:46.578119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66f146-9a07-455c-aace-d9be0fc764d2 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:46.611412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:46.674269 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06edcb-f4a2-4c8f-bfb7-d6b12b72c704 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:46.702682 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:46.713503 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18dafc-1f01-4747-a7e6-222c3cf2c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:46.714301 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18dafc-1f01-4747-a7e6-222c3cf2c995 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:46.714745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18dafc-1f01-4747-a7e6-222c3cf2c995 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:46.715150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18dafc-1f01-4747-a7e6-222c3cf2c995 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:46.716578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18dafc-1f01-4747-a7e6-222c3cf2c995 None admin] RBAC: Adding query filter params (name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:46.717042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18dafc-1f01-4747-a7e6-222c3cf2c995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:46.718716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18dafc-1f01-4747-a7e6-222c3cf2c995 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:46.728918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 275/558] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:46.735309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18dafc-1f01-4747-a7e6-222c3cf2c995 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:46.836683 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66f146-9a07-455c-aace-d9be0fc764d2 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:46.852689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18dafc-1f01-4747-a7e6-222c3cf2c995 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:46.875624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf47ffc-89ac-420f-b38c-489251b45c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:46.876986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf47ffc-89ac-420f-b38c-489251b45c1e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:46.877433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf47ffc-89ac-420f-b38c-489251b45c1e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:46.877839 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf47ffc-89ac-420f-b38c-489251b45c1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:46.886949 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf47ffc-89ac-420f-b38c-489251b45c1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:46.889248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf47ffc-89ac-420f-b38c-489251b45c1e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:46.893337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88600d16-78d8-475f-86c6-60ceb12eb8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:46.893959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88600d16-78d8-475f-86c6-60ceb12eb8c4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:46.894235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88600d16-78d8-475f-86c6-60ceb12eb8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:46.894522 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88600d16-78d8-475f-86c6-60ceb12eb8c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-aaf47ffc-89ac-420f-b38c-489251b45c1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:46.903802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:46.904946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:46.906025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:46.906025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:46.906025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:46.906025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:46.906025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:46.906025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:46.906025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:46.906025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:46.909177 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 284/559] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:21:46.914138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88600d16-78d8-475f-86c6-60ceb12eb8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:46.914138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88600d16-78d8-475f-86c6-60ceb12eb8c4 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:46.915402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf47ffc-89ac-420f-b38c-489251b45c1e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-88600d16-78d8-475f-86c6-60ceb12eb8c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:46.935003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:46.936088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:46.936938 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:46.936938 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:46.936938 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:46.939954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 276/560] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:21:46.945040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88600d16-78d8-475f-86c6-60ceb12eb8c4 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:46.992377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:47.021916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:47.046634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf47ffc-89ac-420f-b38c-489251b45c1e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:47.056335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88600d16-78d8-475f-86c6-60ceb12eb8c4 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:47.082702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c914936-f9a8-40ce-b2cd-657fa8fedc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:47.083325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c914936-f9a8-40ce-b2cd-657fa8fedc57 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:47.083598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c914936-f9a8-40ce-b2cd-657fa8fedc57 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:47.083866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c914936-f9a8-40ce-b2cd-657fa8fedc57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:47.096172 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c914936-f9a8-40ce-b2cd-657fa8fedc57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:47.097048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3fe96-5983-499b-b083-8b032a366c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:47.097895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3fe96-5983-499b-b083-8b032a366c1b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:47.097895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3fe96-5983-499b-b083-8b032a366c1b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:47.098177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3fe96-5983-499b-b083-8b032a366c1b None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:47.098901 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3fe96-5983-499b-b083-8b032a366c1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:47.099200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3fe96-5983-499b-b083-8b032a366c1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:47.100638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3fe96-5983-499b-b083-8b032a366c1b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-3c914936-f9a8-40ce-b2cd-657fa8fedc57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:47.101025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:47.102162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 285/561] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:47.103306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c914936-f9a8-40ce-b2cd-657fa8fedc57 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:47.119618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 277/562] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:47.119618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe99b4d-879c-47e0-a271-1b54a577f9e3 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:47.119618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe99b4d-879c-47e0-a271-1b54a577f9e3 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:47.119618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe99b4d-879c-47e0-a271-1b54a577f9e3 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:47.119618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 278/563] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:47.119618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf41bd-ca05-448d-af35-f2f18597f31b None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:47.120583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf41bd-ca05-448d-af35-f2f18597f31b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:47.120583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf41bd-ca05-448d-af35-f2f18597f31b None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:47.120583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 279/564] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:47.121267 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf41bd-ca05-448d-af35-f2f18597f31b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:47.205209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c914936-f9a8-40ce-b2cd-657fa8fedc57 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:47.216355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:47.220208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf41bd-ca05-448d-af35-f2f18597f31b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:47.238413 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1826511-c490-449a-b82e-d2f9d1389aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:47.239048 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1826511-c490-449a-b82e-d2f9d1389aa5 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:47.239325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1826511-c490-449a-b82e-d2f9d1389aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:47.239595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1826511-c490-449a-b82e-d2f9d1389aa5 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:47.240231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1826511-c490-449a-b82e-d2f9d1389aa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:47.240529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1826511-c490-449a-b82e-d2f9d1389aa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:47.242130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1826511-c490-449a-b82e-d2f9d1389aa5 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:47.244366 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:47.254759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 286/565] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:47.255547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1826511-c490-449a-b82e-d2f9d1389aa5 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:47.261769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dedff-49cd-4e67-b7f7-7bb7e0efa527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:47.262371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dedff-49cd-4e67-b7f7-7bb7e0efa527 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:47.262677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dedff-49cd-4e67-b7f7-7bb7e0efa527 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:47.262946 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dedff-49cd-4e67-b7f7-7bb7e0efa527 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:47.263606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dedff-49cd-4e67-b7f7-7bb7e0efa527 None admin] RBAC: Adding query filter params (name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:47.263905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dedff-49cd-4e67-b7f7-7bb7e0efa527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:47.265257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dedff-49cd-4e67-b7f7-7bb7e0efa527 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:47.273587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 280/566] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:47.274759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cff8d-7d59-46d5-b236-56f545a0f367 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:47.275045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cff8d-7d59-46d5-b236-56f545a0f367 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:47.275318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cff8d-7d59-46d5-b236-56f545a0f367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:47.292607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-af1cff8d-7d59-46d5-b236-56f545a0f367 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:47.293789 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-af1cff8d-7d59-46d5-b236-56f545a0f367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:47.359740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1826511-c490-449a-b82e-d2f9d1389aa5 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:47.361789 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 281/567] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:47.363144 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432882ab-b2dd-41d6-817f-d97c3653267e None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:47.363436 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432882ab-b2dd-41d6-817f-d97c3653267e None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:47.363709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432882ab-b2dd-41d6-817f-d97c3653267e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:47.381730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-432882ab-b2dd-41d6-817f-d97c3653267e None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:47.382942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-432882ab-b2dd-41d6-817f-d97c3653267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:47.406765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf2c48-87f5-407e-b749-dfcfc0f20845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:47.407637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf2c48-87f5-407e-b749-dfcfc0f20845 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:47.408072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf2c48-87f5-407e-b749-dfcfc0f20845 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:47.408343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf2c48-87f5-407e-b749-dfcfc0f20845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:47.409063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf2c48-87f5-407e-b749-dfcfc0f20845 None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=bae43204e3984619b4fdb64f36ef47ea) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:47.409371 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf2c48-87f5-407e-b749-dfcfc0f20845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:47.410825 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf2c48-87f5-407e-b749-dfcfc0f20845 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:47.416707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 287/568] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:47 2022] GET /identity/v3/role_assignments?user.id=bae43204e3984619b4fdb64f36ef47ea&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:47.417531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf2c48-87f5-407e-b749-dfcfc0f20845 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:47.466281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 282/569] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:47.467193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432882ab-b2dd-41d6-817f-d97c3653267e None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:47.521691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:47.546473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:47.637243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf2c48-87f5-407e-b749-dfcfc0f20845 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:47.670196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432882ab-b2dd-41d6-817f-d97c3653267e None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:47.677445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567af71f-856a-4160-9b92-30f0be2a64ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:47.678071 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567af71f-856a-4160-9b92-30f0be2a64ca None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:47.678439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567af71f-856a-4160-9b92-30f0be2a64ca None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:47.678750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567af71f-856a-4160-9b92-30f0be2a64ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:47.686746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567af71f-856a-4160-9b92-30f0be2a64ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:47.688684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567af71f-856a-4160-9b92-30f0be2a64ca None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-567af71f-856a-4160-9b92-30f0be2a64ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:47.700613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:47.701580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:47.703130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:47.703130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:47.703130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:47.703130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:47.703130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:47.703130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:47.703130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:47.703130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:47.703130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:21:47.703130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:47.703130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 288/570] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 05:21:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:47.703130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567af71f-856a-4160-9b92-30f0be2a64ca None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:47.713918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef7b41-2aa1-41c1-b5e0-1f8a8e35e9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:47.715348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef7b41-2aa1-41c1-b5e0-1f8a8e35e9b4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:47.715850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef7b41-2aa1-41c1-b5e0-1f8a8e35e9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:47.716359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef7b41-2aa1-41c1-b5e0-1f8a8e35e9b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:47.728349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef7b41-2aa1-41c1-b5e0-1f8a8e35e9b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:47.730469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef7b41-2aa1-41c1-b5e0-1f8a8e35e9b4 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-dbef7b41-2aa1-41c1-b5e0-1f8a8e35e9b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:47.746989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:47.747973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:47.748866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:47.748866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:47.748866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:47.750905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 283/571] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:47.751964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef7b41-2aa1-41c1-b5e0-1f8a8e35e9b4 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:47.808417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567af71f-856a-4160-9b92-30f0be2a64ca None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:47.827959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:47.837630 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:47.845766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb9811-ccc5-4f7f-bf42-d7a12b5572d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:47.846386 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9811-ccc5-4f7f-bf42-d7a12b5572d5 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:47.846688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9811-ccc5-4f7f-bf42-d7a12b5572d5 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:47.846954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9811-ccc5-4f7f-bf42-d7a12b5572d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:47.857753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb9811-ccc5-4f7f-bf42-d7a12b5572d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-28eb9811-ccc5-4f7f-bf42-d7a12b5572d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:47.862947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:47.863883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:47.864723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:47.864723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:47.864723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:47.864723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:47.864723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:47.864723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:47.864723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:47.864723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:47.864723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:47.864723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:47.864723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:47.864723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:47.868902 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 289/572] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:47.869514 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb9811-ccc5-4f7f-bf42-d7a12b5572d5 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:47.869759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef7b41-2aa1-41c1-b5e0-1f8a8e35e9b4 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:47.908987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3c983-d78f-448c-afb5-1463fcfc2ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:47.909595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3c983-d78f-448c-afb5-1463fcfc2ede None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:47.909874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3c983-d78f-448c-afb5-1463fcfc2ede None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:47.910258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3c983-d78f-448c-afb5-1463fcfc2ede None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:47.911011 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3c983-d78f-448c-afb5-1463fcfc2ede None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:47.911322 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3c983-d78f-448c-afb5-1463fcfc2ede None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:47.912856 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3c983-d78f-448c-afb5-1463fcfc2ede None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:47.934568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 284/573] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 05:21:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:47.934568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3c983-d78f-448c-afb5-1463fcfc2ede None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:47.981364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb9811-ccc5-4f7f-bf42-d7a12b5572d5 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:48.018157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89ddfd-53aa-4ea1-9b2b-4363f5d97c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:48.019302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89ddfd-53aa-4ea1-9b2b-4363f5d97c99 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:48.019586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89ddfd-53aa-4ea1-9b2b-4363f5d97c99 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:48.019858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89ddfd-53aa-4ea1-9b2b-4363f5d97c99 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:48.020878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89ddfd-53aa-4ea1-9b2b-4363f5d97c99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:48.021192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89ddfd-53aa-4ea1-9b2b-4363f5d97c99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:48.022968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89ddfd-53aa-4ea1-9b2b-4363f5d97c99 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:48.034932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 290/574] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:48.035718 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89ddfd-53aa-4ea1-9b2b-4363f5d97c99 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:48.049161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3c983-d78f-448c-afb5-1463fcfc2ede None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:48.081194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:48.081742 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:48.088295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711f523-7dc5-45e7-a67e-f216a8956940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:48.089238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711f523-7dc5-45e7-a67e-f216a8956940 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:48.089736 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711f523-7dc5-45e7-a67e-f216a8956940 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:48.090297 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711f523-7dc5-45e7-a67e-f216a8956940 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:48.101565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711f523-7dc5-45e7-a67e-f216a8956940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-a711f523-7dc5-45e7-a67e-f216a8956940 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:48.106390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:48.107332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:48.108190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:48.108190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:48.108190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:48.108190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:48.108190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:48.108190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:48.108190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:48.108190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:48.108190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:48.108190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:48.108190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:48.108190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:48.111002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 285/575] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:48.111810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711f523-7dc5-45e7-a67e-f216a8956940 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:48.147662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89ddfd-53aa-4ea1-9b2b-4363f5d97c99 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:48.182968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647393c-7f31-473b-b41c-a73443b64fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:48.183566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647393c-7f31-473b-b41c-a73443b64fcc None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:48.183940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647393c-7f31-473b-b41c-a73443b64fcc None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:48.184102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647393c-7f31-473b-b41c-a73443b64fcc None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:48.184746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647393c-7f31-473b-b41c-a73443b64fcc None admin] RBAC: Adding query filter params (name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:48.185051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647393c-7f31-473b-b41c-a73443b64fcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:48.186421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647393c-7f31-473b-b41c-a73443b64fcc None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:48.196214 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 291/576] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:48.201254 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647393c-7f31-473b-b41c-a73443b64fcc None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:48.218841 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711f523-7dc5-45e7-a67e-f216a8956940 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:48.258216 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddcbeb-4b31-47aa-be92-1d8eb40f7bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:48.258875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddcbeb-4b31-47aa-be92-1d8eb40f7bac None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:48.259150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddcbeb-4b31-47aa-be92-1d8eb40f7bac None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:48.259705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddcbeb-4b31-47aa-be92-1d8eb40f7bac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:48.269922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddcbeb-4b31-47aa-be92-1d8eb40f7bac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:48.271390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddcbeb-4b31-47aa-be92-1d8eb40f7bac None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-04ddcbeb-4b31-47aa-be92-1d8eb40f7bac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:48.287347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:48.288292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:48.289180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:48.289180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:48.289180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:48.289180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 286/577] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:48.289180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddcbeb-4b31-47aa-be92-1d8eb40f7bac None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:48.312206 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647393c-7f31-473b-b41c-a73443b64fcc None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:48.314132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:48.338353 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:48.350017 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1f652-06d7-43af-adf6-fb12e752c6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:48.350697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1f652-06d7-43af-adf6-fb12e752c6de None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:48.350982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1f652-06d7-43af-adf6-fb12e752c6de None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:48.351248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1f652-06d7-43af-adf6-fb12e752c6de None admin] PATH_INFO: `/v3/users/glance` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:48.359947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1f652-06d7-43af-adf6-fb12e752c6de None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:48.362035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1f652-06d7-43af-adf6-fb12e752c6de None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-63b1f652-06d7-43af-adf6-fb12e752c6de None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:48.373953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:48.380425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:48.381392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:48.381392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:48.381392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:48.381392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:48.381392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:48.381392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:48.381392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:48.381392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:48.381392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 05:21:48.381392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:48.381392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 292/578] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:48.381392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1f652-06d7-43af-adf6-fb12e752c6de None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:48.400014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddcbeb-4b31-47aa-be92-1d8eb40f7bac None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:48.437326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdedcd2-c4d4-44ac-8428-56c3bdd6fe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:48.438178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdedcd2-c4d4-44ac-8428-56c3bdd6fe34 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:48.438972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdedcd2-c4d4-44ac-8428-56c3bdd6fe34 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:48.439257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdedcd2-c4d4-44ac-8428-56c3bdd6fe34 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:48.439880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdedcd2-c4d4-44ac-8428-56c3bdd6fe34 None admin] RBAC: Adding query filter params (name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:48.440184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdedcd2-c4d4-44ac-8428-56c3bdd6fe34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:48.441561 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdedcd2-c4d4-44ac-8428-56c3bdd6fe34 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:48.453882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 287/579] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:48.453882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdedcd2-c4d4-44ac-8428-56c3bdd6fe34 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:48.488320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1f652-06d7-43af-adf6-fb12e752c6de None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:48.521591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820353b-290a-45f8-837d-8d0a85453563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:48.522199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820353b-290a-45f8-837d-8d0a85453563 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:48.522473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820353b-290a-45f8-837d-8d0a85453563 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:48.522777 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820353b-290a-45f8-837d-8d0a85453563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:48.533011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820353b-290a-45f8-837d-8d0a85453563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:48.534444 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820353b-290a-45f8-837d-8d0a85453563 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-2820353b-290a-45f8-837d-8d0a85453563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:48.548085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:48.549022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:48.549934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:48.549934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:48.549934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:48.549934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 293/580] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:48.549934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820353b-290a-45f8-837d-8d0a85453563 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:48.558719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdedcd2-c4d4-44ac-8428-56c3bdd6fe34 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:48.566493 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:48.567260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:48.596539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d6e01-f278-439b-be81-8133ec1db023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:48.597074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d6e01-f278-439b-be81-8133ec1db023 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:48.597363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d6e01-f278-439b-be81-8133ec1db023 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:48.597640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d6e01-f278-439b-be81-8133ec1db023 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:48.598277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d6e01-f278-439b-be81-8133ec1db023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:48.598615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d6e01-f278-439b-be81-8133ec1db023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:48.599993 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d6e01-f278-439b-be81-8133ec1db023 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:48.613566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 288/581] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:48.614276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d6e01-f278-439b-be81-8133ec1db023 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:48.654925 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820353b-290a-45f8-837d-8d0a85453563 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:48.689657 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbd67-a4d2-4cc3-822d-5e751d39852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:48.690262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbd67-a4d2-4cc3-822d-5e751d39852d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:48.690566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbd67-a4d2-4cc3-822d-5e751d39852d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:48.690842 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbd67-a4d2-4cc3-822d-5e751d39852d None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:48.691563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acbd67-a4d2-4cc3-822d-5e751d39852d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:48.691869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acbd67-a4d2-4cc3-822d-5e751d39852d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:48.693310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acbd67-a4d2-4cc3-822d-5e751d39852d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:48.715607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 294/582] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 16 05:21:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:48.715607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbd67-a4d2-4cc3-822d-5e751d39852d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:48.726848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d6e01-f278-439b-be81-8133ec1db023 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:48.762254 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a368d95-c9f9-4af5-ba05-a42b0a6bde65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:48.762912 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a368d95-c9f9-4af5-ba05-a42b0a6bde65 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:48.763186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a368d95-c9f9-4af5-ba05-a42b0a6bde65 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:48.763451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a368d95-c9f9-4af5-ba05-a42b0a6bde65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:48.774241 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a368d95-c9f9-4af5-ba05-a42b0a6bde65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:48.775709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a368d95-c9f9-4af5-ba05-a42b0a6bde65 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:48.785635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-4a368d95-c9f9-4af5-ba05-a42b0a6bde65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:48.791076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:48.792189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:48.793064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:48.793064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:48.793064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:48.793064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 289/583] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:48.793064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a368d95-c9f9-4af5-ba05-a42b0a6bde65 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:48.812999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:48.822106 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbd67-a4d2-4cc3-822d-5e751d39852d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:48.857172 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858701bc-393d-410c-b7b3-96935fe5413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:48.857765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858701bc-393d-410c-b7b3-96935fe5413f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:48.857969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858701bc-393d-410c-b7b3-96935fe5413f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:48.858244 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858701bc-393d-410c-b7b3-96935fe5413f None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:48.859015 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858701bc-393d-410c-b7b3-96935fe5413f None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:48.859317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858701bc-393d-410c-b7b3-96935fe5413f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:48.860727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858701bc-393d-410c-b7b3-96935fe5413f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:48.872093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 295/584] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:48.872876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858701bc-393d-410c-b7b3-96935fe5413f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:48.900790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a368d95-c9f9-4af5-ba05-a42b0a6bde65 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:48.938481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5792c7-e52e-483f-a5ae-3f08d2f1f196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:48.939131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5792c7-e52e-483f-a5ae-3f08d2f1f196 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:48.939422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5792c7-e52e-483f-a5ae-3f08d2f1f196 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:48.939680 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5792c7-e52e-483f-a5ae-3f08d2f1f196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:48.946560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5792c7-e52e-483f-a5ae-3f08d2f1f196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:48.948228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5792c7-e52e-483f-a5ae-3f08d2f1f196 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-cd5792c7-e52e-483f-a5ae-3f08d2f1f196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:48.961930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:48.962828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:48.963705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:48.963705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:48.963705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:48.963705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:48.963705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:48.963705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:48.963705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:48.963705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:48.963705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 290/585] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:48.964181 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5792c7-e52e-483f-a5ae-3f08d2f1f196 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:48.983131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858701bc-393d-410c-b7b3-96935fe5413f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:49.016324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:49.024544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabf3d0-bad1-4fdf-8526-ef15eecd25e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:49.025176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabf3d0-bad1-4fdf-8526-ef15eecd25e5 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:49.025464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabf3d0-bad1-4fdf-8526-ef15eecd25e5 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:49.025889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabf3d0-bad1-4fdf-8526-ef15eecd25e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:49.036928 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabf3d0-bad1-4fdf-8526-ef15eecd25e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:49.038385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabf3d0-bad1-4fdf-8526-ef15eecd25e5 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:49.049062 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-9aabf3d0-bad1-4fdf-8526-ef15eecd25e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:49.052678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:49.053636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:49.054500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:49.054500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:49.054500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:49.054500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 296/586] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:49.055527 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabf3d0-bad1-4fdf-8526-ef15eecd25e5 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:49.074786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5792c7-e52e-483f-a5ae-3f08d2f1f196 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:49.111958 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5462ee9-2cae-4172-a22d-3f9dafb36e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:49.112375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462ee9-2cae-4172-a22d-3f9dafb36e78 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:49.112711 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462ee9-2cae-4172-a22d-3f9dafb36e78 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:49.112993 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462ee9-2cae-4172-a22d-3f9dafb36e78 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:49.113634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5462ee9-2cae-4172-a22d-3f9dafb36e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:49.113937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5462ee9-2cae-4172-a22d-3f9dafb36e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:49.115329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5462ee9-2cae-4172-a22d-3f9dafb36e78 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:49.128037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 291/587] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:49.131528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5462ee9-2cae-4172-a22d-3f9dafb36e78 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:49.165362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabf3d0-bad1-4fdf-8526-ef15eecd25e5 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:49.200409 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089aefd-5a46-4f74-b595-1b316821938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:49.201034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089aefd-5a46-4f74-b595-1b316821938c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:49.201330 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089aefd-5a46-4f74-b595-1b316821938c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:49.201570 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089aefd-5a46-4f74-b595-1b316821938c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:49.210539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089aefd-5a46-4f74-b595-1b316821938c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:49.211990 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089aefd-5a46-4f74-b595-1b316821938c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-3089aefd-5a46-4f74-b595-1b316821938c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:49.223266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:49.224255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:49.225215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:49.225215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:49.225215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:49.225215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:49.225215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:49.225215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:49.225215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:49.225215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:49.225215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 05:21:49.225215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:49.225215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 297/588] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:49.225809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089aefd-5a46-4f74-b595-1b316821938c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:49.248408 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5462ee9-2cae-4172-a22d-3f9dafb36e78 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:49.282822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:49.287515 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f32d8b-a618-479e-a6cf-011dccc95701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:49.288113 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32d8b-a618-479e-a6cf-011dccc95701 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:49.288414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32d8b-a618-479e-a6cf-011dccc95701 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:49.288666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32d8b-a618-479e-a6cf-011dccc95701 None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:49.289359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f32d8b-a618-479e-a6cf-011dccc95701 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:49.289666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f32d8b-a618-479e-a6cf-011dccc95701 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:49.291154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f32d8b-a618-479e-a6cf-011dccc95701 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:49.298403 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:49.310868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 292/589] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:49.310868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f32d8b-a618-479e-a6cf-011dccc95701 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:49.348487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089aefd-5a46-4f74-b595-1b316821938c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:49.384740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ed811-fea9-4892-9672-d3eb82348c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:49.385265 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ed811-fea9-4892-9672-d3eb82348c11 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:49.385944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ed811-fea9-4892-9672-d3eb82348c11 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:49.385944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ed811-fea9-4892-9672-d3eb82348c11 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:49.386425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ed811-fea9-4892-9672-d3eb82348c11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:49.386753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ed811-fea9-4892-9672-d3eb82348c11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:49.388150 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ed811-fea9-4892-9672-d3eb82348c11 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:49.404382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 298/590] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:49.404382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ed811-fea9-4892-9672-d3eb82348c11 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:49.425382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f32d8b-a618-479e-a6cf-011dccc95701 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:49.461732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2315-f0f1-42f1-a405-7b4ec147f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:49.462383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2315-f0f1-42f1-a405-7b4ec147f2ac None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:49.462804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2315-f0f1-42f1-a405-7b4ec147f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:49.463085 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2315-f0f1-42f1-a405-7b4ec147f2ac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:49.471943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c2315-f0f1-42f1-a405-7b4ec147f2ac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:49.473678 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c2315-f0f1-42f1-a405-7b4ec147f2ac None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-881c2315-f0f1-42f1-a405-7b4ec147f2ac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:49.487318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:49.488277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:49.489240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:49.489240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:49.489240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:49.489240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:49.489240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:49.489240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:49.489240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:49.489240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:49.489240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 05:21:49.489240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:49.489240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 293/591] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:49.489240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2315-f0f1-42f1-a405-7b4ec147f2ac None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:49.510789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ed811-fea9-4892-9672-d3eb82348c11 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:49.514101 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:49.551163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964eec4-011f-41d5-b6da-b7bb26946056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:49.551772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964eec4-011f-41d5-b6da-b7bb26946056 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:49.552069 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964eec4-011f-41d5-b6da-b7bb26946056 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:49.552322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964eec4-011f-41d5-b6da-b7bb26946056 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:49.553057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964eec4-011f-41d5-b6da-b7bb26946056 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:49.553364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964eec4-011f-41d5-b6da-b7bb26946056 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:49.554831 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964eec4-011f-41d5-b6da-b7bb26946056 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:49.556787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:49.573339 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 299/592] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 16 05:21:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:49.573974 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964eec4-011f-41d5-b6da-b7bb26946056 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:49.609688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2315-f0f1-42f1-a405-7b4ec147f2ac None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:49.647199 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c756e-910d-486f-8bdc-a61927fcadda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:49.647763 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c756e-910d-486f-8bdc-a61927fcadda None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:49.648042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c756e-910d-486f-8bdc-a61927fcadda None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:49.648315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c756e-910d-486f-8bdc-a61927fcadda None admin] PATH_INFO: `/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/515e548efd984b87bca742e26eec162a/roles/bed020f3301c4f169f2a6d5795cd26f0` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:49.662314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c756e-910d-486f-8bdc-a61927fcadda None admin] RBAC: Authorizing `identity:create_grant(project_id=74c9d19fb1534f8f8888e957d1007640, user_id=515e548efd984b87bca742e26eec162a, role_id=bed020f3301c4f169f2a6d5795cd26f0)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:49.663783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c756e-910d-486f-8bdc-a61927fcadda None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:49.676635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 294/593] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:21:49 2022] PUT /identity/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/515e548efd984b87bca742e26eec162a/roles/bed020f3301c4f169f2a6d5795cd26f0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:49.677417 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c756e-910d-486f-8bdc-a61927fcadda None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:49.678455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964eec4-011f-41d5-b6da-b7bb26946056 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:49.719420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c59e7-92af-46b7-8f90-0eb3aa884a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:49.720592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c59e7-92af-46b7-8f90-0eb3aa884a81 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:49.720873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c59e7-92af-46b7-8f90-0eb3aa884a81 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:49.721146 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c59e7-92af-46b7-8f90-0eb3aa884a81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:49.728552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c59e7-92af-46b7-8f90-0eb3aa884a81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:49.730055 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c59e7-92af-46b7-8f90-0eb3aa884a81 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-889c59e7-92af-46b7-8f90-0eb3aa884a81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:49.743248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:49.744234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:49.745190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:49.745190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:49.745190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:49.745190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:49.745190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:49.745190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:49.745190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:49.745190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:49.745190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 300/594] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:49.745690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c59e7-92af-46b7-8f90-0eb3aa884a81 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:49.774587 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:49.799360 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c756e-910d-486f-8bdc-a61927fcadda None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:49.809831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:49.840396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969af425-ceac-4a28-a3e7-8e1746673a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:49.841110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af425-ceac-4a28-a3e7-8e1746673a61 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:49.841389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af425-ceac-4a28-a3e7-8e1746673a61 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:49.841660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af425-ceac-4a28-a3e7-8e1746673a61 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:49.842389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969af425-ceac-4a28-a3e7-8e1746673a61 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:49.842794 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969af425-ceac-4a28-a3e7-8e1746673a61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:49.844241 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969af425-ceac-4a28-a3e7-8e1746673a61 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:49.868274 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 295/595] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Sep 16 05:21:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:49.868545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c59e7-92af-46b7-8f90-0eb3aa884a81 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:49.870381 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993b80b-4b7e-454a-ae86-0cea57c55fd0 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:49.870946 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993b80b-4b7e-454a-ae86-0cea57c55fd0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:49.871367 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993b80b-4b7e-454a-ae86-0cea57c55fd0 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:49.872583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 296/596] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:49.873270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993b80b-4b7e-454a-ae86-0cea57c55fd0 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:49.908631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667b405-f75c-47c3-829c-fb1546ec1116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:49.909174 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667b405-f75c-47c3-829c-fb1546ec1116 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:49.909453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667b405-f75c-47c3-829c-fb1546ec1116 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:49.909721 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667b405-f75c-47c3-829c-fb1546ec1116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:49.921444 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667b405-f75c-47c3-829c-fb1546ec1116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:49.923635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667b405-f75c-47c3-829c-fb1546ec1116 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-8667b405-f75c-47c3-829c-fb1546ec1116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:49.939037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:49.940196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:49.941251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:49.941251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:49.941251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:49.942659 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 301/597] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:49.944161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667b405-f75c-47c3-829c-fb1546ec1116 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:49.987403 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993b80b-4b7e-454a-ae86-0cea57c55fd0 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:50.020723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:50.023767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f58d4-e01d-4ec4-a894-c5ecbefac2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:50.024482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f58d4-e01d-4ec4-a894-c5ecbefac2fc None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:50.024852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f58d4-e01d-4ec4-a894-c5ecbefac2fc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:50.025263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f58d4-e01d-4ec4-a894-c5ecbefac2fc None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:50.026054 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f58d4-e01d-4ec4-a894-c5ecbefac2fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:50.026399 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f58d4-e01d-4ec4-a894-c5ecbefac2fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:50.028205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f58d4-e01d-4ec4-a894-c5ecbefac2fc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:50.042097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 297/598] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:50.043372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fac06-047e-4f05-ab34-003a0750bd2e None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:50.043721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fac06-047e-4f05-ab34-003a0750bd2e None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:50.044064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fac06-047e-4f05-ab34-003a0750bd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:50.053795 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667b405-f75c-47c3-829c-fb1546ec1116 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:50.064694 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-b62fac06-047e-4f05-ab34-003a0750bd2e None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:50.066295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b62fac06-047e-4f05-ab34-003a0750bd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:50.088937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:50.092719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af21062-97c7-4503-b9ac-61e7e69f2b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:50.093421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21062-97c7-4503-b9ac-61e7e69f2b9f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:50.093771 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21062-97c7-4503-b9ac-61e7e69f2b9f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:50.094045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21062-97c7-4503-b9ac-61e7e69f2b9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:50.105985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af21062-97c7-4503-b9ac-61e7e69f2b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:50.107453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af21062-97c7-4503-b9ac-61e7e69f2b9f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-7af21062-97c7-4503-b9ac-61e7e69f2b9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:50.121455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:50.122421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:50.123349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:50.123349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:50.123349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:50.123349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 302/599] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:50.123349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af21062-97c7-4503-b9ac-61e7e69f2b9f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:50.154219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 298/600] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:50.154219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fac06-047e-4f05-ab34-003a0750bd2e None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:50.255331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af21062-97c7-4503-b9ac-61e7e69f2b9f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:50.269505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fac06-047e-4f05-ab34-003a0750bd2e None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:50.289274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:50.300315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ac7bb-89cb-468a-89f4-cf4c32cba523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:50.301169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ac7bb-89cb-468a-89f4-cf4c32cba523 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:50.301589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ac7bb-89cb-468a-89f4-cf4c32cba523 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:50.302002 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ac7bb-89cb-468a-89f4-cf4c32cba523 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:50.302834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ac7bb-89cb-468a-89f4-cf4c32cba523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:50.303277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ac7bb-89cb-468a-89f4-cf4c32cba523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:50.304796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ac7bb-89cb-468a-89f4-cf4c32cba523 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:50.305822 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1c7d5-e70f-40b0-8b0b-7ba9c55103e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:50.306568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1c7d5-e70f-40b0-8b0b-7ba9c55103e2 None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:50.306914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1c7d5-e70f-40b0-8b0b-7ba9c55103e2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:50.307253 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1c7d5-e70f-40b0-8b0b-7ba9c55103e2 None admin] PATH_INFO: `/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/20d8e253a72c44f7a5a986f981660df2/roles/bed020f3301c4f169f2a6d5795cd26f0` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:50.319271 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 303/601] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:50.320506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ac7bb-89cb-468a-89f4-cf4c32cba523 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:50.323252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1c7d5-e70f-40b0-8b0b-7ba9c55103e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=74c9d19fb1534f8f8888e957d1007640, user_id=20d8e253a72c44f7a5a986f981660df2, role_id=bed020f3301c4f169f2a6d5795cd26f0)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:50.324952 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1c7d5-e70f-40b0-8b0b-7ba9c55103e2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:50.339668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 299/602] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:21:50 2022] PUT /identity/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/20d8e253a72c44f7a5a986f981660df2/roles/bed020f3301c4f169f2a6d5795cd26f0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:50.340492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1c7d5-e70f-40b0-8b0b-7ba9c55103e2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:50.349476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:50.455262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1c7d5-e70f-40b0-8b0b-7ba9c55103e2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:50.493490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aecacf-c233-4d23-9d3e-06a2b0bb326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:50.494190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aecacf-c233-4d23-9d3e-06a2b0bb326b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:50.494495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aecacf-c233-4d23-9d3e-06a2b0bb326b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:50.494918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aecacf-c233-4d23-9d3e-06a2b0bb326b None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:50.503561 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aecacf-c233-4d23-9d3e-06a2b0bb326b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:50.505108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aecacf-c233-4d23-9d3e-06a2b0bb326b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-e9aecacf-c233-4d23-9d3e-06a2b0bb326b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:50.518170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:50.519320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:50.520412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:50.520412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:50.520412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:50.520412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:50.520412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:50.520412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:50.520412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:50.520412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:50.521653 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 300/603] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:50.532178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aecacf-c233-4d23-9d3e-06a2b0bb326b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:50.538017 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ac7bb-89cb-468a-89f4-cf4c32cba523 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:50.580956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a062ca0-c705-4a51-a736-d5c1ddedceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:50.581584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a062ca0-c705-4a51-a736-d5c1ddedceea None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:50.581869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a062ca0-c705-4a51-a736-d5c1ddedceea None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:50.582138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a062ca0-c705-4a51-a736-d5c1ddedceea None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:50.582834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a062ca0-c705-4a51-a736-d5c1ddedceea None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:50.583140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a062ca0-c705-4a51-a736-d5c1ddedceea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:50.584578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a062ca0-c705-4a51-a736-d5c1ddedceea None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:50.601772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 304/604] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:50.602738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a062ca0-c705-4a51-a736-d5c1ddedceea None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:50.614440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:50.655016 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:50.659116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aecacf-c233-4d23-9d3e-06a2b0bb326b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:50.702074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96217b2d-321f-48fc-a814-2198a6a7ba44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:50.702970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96217b2d-321f-48fc-a814-2198a6a7ba44 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:50.703251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96217b2d-321f-48fc-a814-2198a6a7ba44 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:50.703526 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96217b2d-321f-48fc-a814-2198a6a7ba44 None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:50.704396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96217b2d-321f-48fc-a814-2198a6a7ba44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:50.705015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96217b2d-321f-48fc-a814-2198a6a7ba44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:50.706739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96217b2d-321f-48fc-a814-2198a6a7ba44 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:50.710893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a062ca0-c705-4a51-a736-d5c1ddedceea None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:50.722599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 301/605] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:50.723565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96217b2d-321f-48fc-a814-2198a6a7ba44 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:50.760334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b1828-fc49-4603-a19a-ab189d6ecc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:50.761153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b1828-fc49-4603-a19a-ab189d6ecc1d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:50.761436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b1828-fc49-4603-a19a-ab189d6ecc1d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:50.761707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b1828-fc49-4603-a19a-ab189d6ecc1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:50.779764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b1828-fc49-4603-a19a-ab189d6ecc1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-643b1828-fc49-4603-a19a-ab189d6ecc1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:50.786175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:50.787270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:50.788284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:50.788284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:50.788284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:50.788284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:50.788284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:50.788284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:50.788284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:50.788284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:50.788284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:50.788284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:50.788284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:50.788284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:50.794647 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 305/606] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:50.795565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b1828-fc49-4603-a19a-ab189d6ecc1d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:50.853944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96217b2d-321f-48fc-a814-2198a6a7ba44 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:50.884523 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:50.900894 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c0055-61db-4a60-86b2-2f14291fe6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:50.901508 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0055-61db-4a60-86b2-2f14291fe6b4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:50.901814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0055-61db-4a60-86b2-2f14291fe6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:50.902149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0055-61db-4a60-86b2-2f14291fe6b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:50.905715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b1828-fc49-4603-a19a-ab189d6ecc1d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:50.911042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c0055-61db-4a60-86b2-2f14291fe6b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:50.912489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c0055-61db-4a60-86b2-2f14291fe6b4 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:50.914325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-e38c0055-61db-4a60-86b2-2f14291fe6b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:50.927161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:50.928125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:50.929004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:50.929004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:50.929004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:50.929004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:50.929004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:50.929004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:50.929004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:50.929004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:50.929004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 302/607] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:50.929004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c0055-61db-4a60-86b2-2f14291fe6b4 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:50.961813 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655a8f0-9873-4e28-95f2-681f6364afff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:50.963199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655a8f0-9873-4e28-95f2-681f6364afff None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:50.963917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655a8f0-9873-4e28-95f2-681f6364afff None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:50.964343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655a8f0-9873-4e28-95f2-681f6364afff None admin] PATH_INFO: `/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/fc48962e649c40ca82cf3173ce9940e9/roles/bed020f3301c4f169f2a6d5795cd26f0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:50.986768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655a8f0-9873-4e28-95f2-681f6364afff None admin] RBAC: Authorizing `identity:create_grant(project_id=74c9d19fb1534f8f8888e957d1007640, user_id=fc48962e649c40ca82cf3173ce9940e9, role_id=bed020f3301c4f169f2a6d5795cd26f0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:50.988772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655a8f0-9873-4e28-95f2-681f6364afff None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:51.011543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 306/608] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:21:50 2022] PUT /identity/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/fc48962e649c40ca82cf3173ce9940e9/roles/bed020f3301c4f169f2a6d5795cd26f0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:51.013394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655a8f0-9873-4e28-95f2-681f6364afff None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:51.056207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c0055-61db-4a60-86b2-2f14291fe6b4 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:51.098228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd7a1a-9ac5-4457-aab9-76f30d77b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:51.099415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd7a1a-9ac5-4457-aab9-76f30d77b62d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:51.099805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd7a1a-9ac5-4457-aab9-76f30d77b62d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:51.100424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd7a1a-9ac5-4457-aab9-76f30d77b62d None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:51.101210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd7a1a-9ac5-4457-aab9-76f30d77b62d None admin] RBAC: Adding query filter params (name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:51.101610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd7a1a-9ac5-4457-aab9-76f30d77b62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:51.103498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd7a1a-9ac5-4457-aab9-76f30d77b62d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:51.113757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 303/609] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:51.124488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd7a1a-9ac5-4457-aab9-76f30d77b62d None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:51.162259 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655a8f0-9873-4e28-95f2-681f6364afff None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:51.209803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9e85d-627a-4d26-adae-14eac16aefad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:51.210774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9e85d-627a-4d26-adae-14eac16aefad None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:51.211224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9e85d-627a-4d26-adae-14eac16aefad None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:51.211970 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9e85d-627a-4d26-adae-14eac16aefad None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:51.213482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9e85d-627a-4d26-adae-14eac16aefad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:51.213975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9e85d-627a-4d26-adae-14eac16aefad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:51.215823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9e85d-627a-4d26-adae-14eac16aefad None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:51.234806 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 307/610] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:51.244868 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9e85d-627a-4d26-adae-14eac16aefad None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:51.261136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:51.271827 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:51.349358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd7a1a-9ac5-4457-aab9-76f30d77b62d None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:51.398787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9e85d-627a-4d26-adae-14eac16aefad None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:51.417756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb60ea-8c84-4b73-a283-8b75f478e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:51.418741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb60ea-8c84-4b73-a283-8b75f478e97f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:51.419190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb60ea-8c84-4b73-a283-8b75f478e97f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:51.419621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb60ea-8c84-4b73-a283-8b75f478e97f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:51.432843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb60ea-8c84-4b73-a283-8b75f478e97f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:51.434751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb60ea-8c84-4b73-a283-8b75f478e97f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-91bb60ea-8c84-4b73-a283-8b75f478e97f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:51.452039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:51.453258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:51.454893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:51.454893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:51.454893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:51.456578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 304/611] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:51.462494 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb60ea-8c84-4b73-a283-8b75f478e97f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:51.503251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a65468-d48c-4d66-b8e6-a4d77e49d30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:51.503931 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a65468-d48c-4d66-b8e6-a4d77e49d30f None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:51.504209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a65468-d48c-4d66-b8e6-a4d77e49d30f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:51.504479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a65468-d48c-4d66-b8e6-a4d77e49d30f None admin] PATH_INFO: `/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/d51f44d06b0f4303a753709bd1bcf3e5/roles/bed020f3301c4f169f2a6d5795cd26f0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:51.567622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a65468-d48c-4d66-b8e6-a4d77e49d30f None admin] RBAC: Authorizing `identity:create_grant(project_id=74c9d19fb1534f8f8888e957d1007640, user_id=d51f44d06b0f4303a753709bd1bcf3e5, role_id=bed020f3301c4f169f2a6d5795cd26f0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:51.568836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a65468-d48c-4d66-b8e6-a4d77e49d30f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:51.570709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb60ea-8c84-4b73-a283-8b75f478e97f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:51.581095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:51.603578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 308/612] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:21:51 2022] PUT /identity/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/d51f44d06b0f4303a753709bd1bcf3e5/roles/bed020f3301c4f169f2a6d5795cd26f0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:51.608533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed55fc-cbd2-4aba-8da0-eb344b93f2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:51.609411 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed55fc-cbd2-4aba-8da0-eb344b93f2fc None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:51.609878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed55fc-cbd2-4aba-8da0-eb344b93f2fc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:51.610860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed55fc-cbd2-4aba-8da0-eb344b93f2fc None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:51.611733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed55fc-cbd2-4aba-8da0-eb344b93f2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:51.612194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed55fc-cbd2-4aba-8da0-eb344b93f2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:51.613801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed55fc-cbd2-4aba-8da0-eb344b93f2fc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:51.628689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 305/613] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:51.634637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a65468-d48c-4d66-b8e6-a4d77e49d30f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:51.727990 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:51.775394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a65468-d48c-4d66-b8e6-a4d77e49d30f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:51.814415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83dc9a-f4ff-4e47-9887-9328384876e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:51.815107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83dc9a-f4ff-4e47-9887-9328384876e6 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:51.815387 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83dc9a-f4ff-4e47-9887-9328384876e6 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:51.815663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83dc9a-f4ff-4e47-9887-9328384876e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:51.824185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83dc9a-f4ff-4e47-9887-9328384876e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:51.825612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83dc9a-f4ff-4e47-9887-9328384876e6 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-6f83dc9a-f4ff-4e47-9887-9328384876e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:51.840629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:51.841618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:51.842582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:51.842582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:51.842582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:51.842582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:51.842582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:51.842582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:51.842582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:51.842582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:51.842582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 05:21:51.842582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:51.843697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 309/614] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:21:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:51.851473 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed55fc-cbd2-4aba-8da0-eb344b93f2fc None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:51.964944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed55fc-cbd2-4aba-8da0-eb344b93f2fc None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:52.001177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793500df-c115-4c76-8297-1d902937427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:52.001783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793500df-c115-4c76-8297-1d902937427d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:52.002061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793500df-c115-4c76-8297-1d902937427d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:52.002333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793500df-c115-4c76-8297-1d902937427d None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:52.003088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793500df-c115-4c76-8297-1d902937427d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:52.003393 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793500df-c115-4c76-8297-1d902937427d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:52.004839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793500df-c115-4c76-8297-1d902937427d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:52.023531 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 306/615] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 16 05:21:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:52.029268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83dc9a-f4ff-4e47-9887-9328384876e6 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:52.053906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b54910-c337-434a-85ff-8b81a687891c None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:52.054211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b54910-c337-434a-85ff-8b81a687891c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:52.054441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b54910-c337-434a-85ff-8b81a687891c None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:52.056583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 307/616] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:21:52.074611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660da68c-2861-4189-9dae-e3402f2d3027 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:52.074611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660da68c-2861-4189-9dae-e3402f2d3027 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:52.074611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660da68c-2861-4189-9dae-e3402f2d3027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:52.091849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-660da68c-2861-4189-9dae-e3402f2d3027 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:52.093304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-660da68c-2861-4189-9dae-e3402f2d3027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:52.114908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:52.167845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 308/617] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:21:52.224321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83dc9a-f4ff-4e47-9887-9328384876e6 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:52.265882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:52.278225 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365295c-e7cb-4ff4-a6be-348dd882683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:52.278900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365295c-e7cb-4ff4-a6be-348dd882683c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:52.279235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365295c-e7cb-4ff4-a6be-348dd882683c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:52.279456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365295c-e7cb-4ff4-a6be-348dd882683c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:52.293084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365295c-e7cb-4ff4-a6be-348dd882683c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:52.294716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365295c-e7cb-4ff4-a6be-348dd882683c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-5365295c-e7cb-4ff4-a6be-348dd882683c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:52.310059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:52.311082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:52.313297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:52.313297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:52.313297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:52.313297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 310/618] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:52.317467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660da68c-2861-4189-9dae-e3402f2d3027 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:52.422924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660da68c-2861-4189-9dae-e3402f2d3027 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:52.458338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb9bd2-05e1-439b-afc6-44c8c2dbb8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:52.459057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb9bd2-05e1-439b-afc6-44c8c2dbb8c2 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:52.459399 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb9bd2-05e1-439b-afc6-44c8c2dbb8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:52.459599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb9bd2-05e1-439b-afc6-44c8c2dbb8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:52.460239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb9bd2-05e1-439b-afc6-44c8c2dbb8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:52.460541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb9bd2-05e1-439b-afc6-44c8c2dbb8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:52.461981 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb9bd2-05e1-439b-afc6-44c8c2dbb8c2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:52.478724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 309/619] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:52.480185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365295c-e7cb-4ff4-a6be-348dd882683c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:52.520161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb9bd2-05e1-439b-afc6-44c8c2dbb8c2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:52.531615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:52.644036 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb9bd2-05e1-439b-afc6-44c8c2dbb8c2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:52.654447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365295c-e7cb-4ff4-a6be-348dd882683c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:52.681537 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70433168-a9d5-49c9-85d8-c2c77f73b255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:52.682094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70433168-a9d5-49c9-85d8-c2c77f73b255 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:52.682372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70433168-a9d5-49c9-85d8-c2c77f73b255 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:52.682672 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70433168-a9d5-49c9-85d8-c2c77f73b255 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:52.694754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70433168-a9d5-49c9-85d8-c2c77f73b255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-70433168-a9d5-49c9-85d8-c2c77f73b255 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:52.700884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:52.701803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:52.703612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:52.703612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:52.703612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:52.703612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:52.703612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:52.703612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:52.703612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:52.703612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:52.703612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:52.703612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:52.703612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:52.703612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:52.703612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 310/620] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:21:52.708725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70433168-a9d5-49c9-85d8-c2c77f73b255 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:52.741510 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac03c69-c691-4e1f-af4a-09f3cda50d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:52.742240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac03c69-c691-4e1f-af4a-09f3cda50d5d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:52.742539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac03c69-c691-4e1f-af4a-09f3cda50d5d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:52.742814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac03c69-c691-4e1f-af4a-09f3cda50d5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:52.759620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac03c69-c691-4e1f-af4a-09f3cda50d5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:52.761169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac03c69-c691-4e1f-af4a-09f3cda50d5d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:52.778944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-fac03c69-c691-4e1f-af4a-09f3cda50d5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:52.792830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:52.793743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:52.795726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:52.795726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:52.795726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:52.795726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:52.795726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:52.795726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:52.795726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:52.795726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:52.795726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 311/621] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:52.803525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac03c69-c691-4e1f-af4a-09f3cda50d5d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:52.815971 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70433168-a9d5-49c9-85d8-c2c77f73b255 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:52.852769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb9d9b-6320-4b5e-838e-261eebba9240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:52.853386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb9d9b-6320-4b5e-838e-261eebba9240 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:52.853708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb9d9b-6320-4b5e-838e-261eebba9240 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:52.853984 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb9d9b-6320-4b5e-838e-261eebba9240 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:52.854724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb9d9b-6320-4b5e-838e-261eebba9240 None admin] RBAC: Adding query filter params (name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:52.855065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb9d9b-6320-4b5e-838e-261eebba9240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:52.856442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb9d9b-6320-4b5e-838e-261eebba9240 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:52.866144 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 311/622] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:52.872312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb9d9b-6320-4b5e-838e-261eebba9240 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:52.910392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:52.982037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb9d9b-6320-4b5e-838e-261eebba9240 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:53.021911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:53.023288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c1e19-90e5-4bb4-a3f6-cee2c3234213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:53.023931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c1e19-90e5-4bb4-a3f6-cee2c3234213 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:53.024302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c1e19-90e5-4bb4-a3f6-cee2c3234213 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:53.024604 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c1e19-90e5-4bb4-a3f6-cee2c3234213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:53.037211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c1e19-90e5-4bb4-a3f6-cee2c3234213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:53.038776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c1e19-90e5-4bb4-a3f6-cee2c3234213 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-f11c1e19-90e5-4bb4-a3f6-cee2c3234213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:53.057753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:53.058771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:53.060256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:53.060256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:53.060256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:53.060256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 312/623] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:53.065423 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c1e19-90e5-4bb4-a3f6-cee2c3234213 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:53.122789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac03c69-c691-4e1f-af4a-09f3cda50d5d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:53.160479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8b18f-3f8c-41f8-92be-bde1dffe7406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:53.161101 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8b18f-3f8c-41f8-92be-bde1dffe7406 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:53.161388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8b18f-3f8c-41f8-92be-bde1dffe7406 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:53.161663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8b18f-3f8c-41f8-92be-bde1dffe7406 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:53.162478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8b18f-3f8c-41f8-92be-bde1dffe7406 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:53.162915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8b18f-3f8c-41f8-92be-bde1dffe7406 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:53.164392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8b18f-3f8c-41f8-92be-bde1dffe7406 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:53.178013 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 312/624] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:53.183754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c1e19-90e5-4bb4-a3f6-cee2c3234213 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:53.184047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b58bf-263a-4797-bd11-5cd2ffd71c3a None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:53.184337 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b58bf-263a-4797-bd11-5cd2ffd71c3a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:53.184616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b58bf-263a-4797-bd11-5cd2ffd71c3a None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:53.186301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 313/625] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:53.187046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b58bf-263a-4797-bd11-5cd2ffd71c3a None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:53.227982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2d28b-6552-42cd-b3ae-6def7a8d58ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:53.228595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2d28b-6552-42cd-b3ae-6def7a8d58ad None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:53.228871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2d28b-6552-42cd-b3ae-6def7a8d58ad None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:53.229141 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2d28b-6552-42cd-b3ae-6def7a8d58ad None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:53.230176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2d28b-6552-42cd-b3ae-6def7a8d58ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:53.230484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2d28b-6552-42cd-b3ae-6def7a8d58ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:53.231949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2d28b-6552-42cd-b3ae-6def7a8d58ad None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:53.253944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 313/626] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:53.253944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed5792-a726-44a1-aada-a48d1b58c880 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:53.253944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed5792-a726-44a1-aada-a48d1b58c880 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:53.253944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed5792-a726-44a1-aada-a48d1b58c880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:53.274445 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-7eed5792-a726-44a1-aada-a48d1b58c880 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:53.275813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7eed5792-a726-44a1-aada-a48d1b58c880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:53.306668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:53.317374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b58bf-263a-4797-bd11-5cd2ffd71c3a None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:53.324811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:53.359199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ecda9-eb41-4570-9373-0635b10d6afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:53.360256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ecda9-eb41-4570-9373-0635b10d6afc None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:53.360371 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ecda9-eb41-4570-9373-0635b10d6afc None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:53.360652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ecda9-eb41-4570-9373-0635b10d6afc None admin] PATH_INFO: `/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/bae43204e3984619b4fdb64f36ef47ea/roles/bed020f3301c4f169f2a6d5795cd26f0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:53.370040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 314/627] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:53.371179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed5792-a726-44a1-aada-a48d1b58c880 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:53.377688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ecda9-eb41-4570-9373-0635b10d6afc None admin] RBAC: Authorizing `identity:create_grant(project_id=74c9d19fb1534f8f8888e957d1007640, user_id=bae43204e3984619b4fdb64f36ef47ea, role_id=bed020f3301c4f169f2a6d5795cd26f0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:53.379257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ecda9-eb41-4570-9373-0635b10d6afc None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:53.399004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 314/628] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:21:53 2022] PUT /identity/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/bae43204e3984619b4fdb64f36ef47ea/roles/bed020f3301c4f169f2a6d5795cd26f0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:21:53.485810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed5792-a726-44a1-aada-a48d1b58c880 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:53.524795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5421b-b483-46a0-8f3f-fb40d1577a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:53.525805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5421b-b483-46a0-8f3f-fb40d1577a10 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:53.526295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5421b-b483-46a0-8f3f-fb40d1577a10 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:53.526824 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5421b-b483-46a0-8f3f-fb40d1577a10 None admin] PATH_INFO: `/v3/users/nova` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:53.535700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5421b-b483-46a0-8f3f-fb40d1577a10 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:53.537571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5421b-b483-46a0-8f3f-fb40d1577a10 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-f2b5421b-b483-46a0-8f3f-fb40d1577a10 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:53.551240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:53.552345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:53.553302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:53.553302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:53.553302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:53.553302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:53.553302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:53.553302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:53.553302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:53.553302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:53.553302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:21:53.553302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:53.555887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 315/629] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 05:21:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:53.562776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ecda9-eb41-4570-9373-0635b10d6afc None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:53.654308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ea12-b4b8-4152-b84d-e68417dddffe None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:53.654978 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ea12-b4b8-4152-b84d-e68417dddffe None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:53.655469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ea12-b4b8-4152-b84d-e68417dddffe None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:53.659250 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 316/630] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:53.664336 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba69f-bb01-44f7-a4bc-99726ab0f5ce None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:53.664615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba69f-bb01-44f7-a4bc-99726ab0f5ce None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:53.664888 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba69f-bb01-44f7-a4bc-99726ab0f5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:53.696378 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-352ba69f-bb01-44f7-a4bc-99726ab0f5ce None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:53.696714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-352ba69f-bb01-44f7-a4bc-99726ab0f5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:53.709062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ecda9-eb41-4570-9373-0635b10d6afc None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:53.726333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:53.750762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338511f2-95fe-4bdb-b293-3cdc60f9b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:53.751376 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338511f2-95fe-4bdb-b293-3cdc60f9b362 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:53.753038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338511f2-95fe-4bdb-b293-3cdc60f9b362 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:53.753263 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338511f2-95fe-4bdb-b293-3cdc60f9b362 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:53.754007 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338511f2-95fe-4bdb-b293-3cdc60f9b362 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:53.754414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338511f2-95fe-4bdb-b293-3cdc60f9b362 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:53.755822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338511f2-95fe-4bdb-b293-3cdc60f9b362 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:53.779275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 317/631] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:53.781002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ba69f-bb01-44f7-a4bc-99726ab0f5ce None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:53.783193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 315/632] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 05:21:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:53.791603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338511f2-95fe-4bdb-b293-3cdc60f9b362 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:53.806634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:53.953285 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338511f2-95fe-4bdb-b293-3cdc60f9b362 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:53.981760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ba69f-bb01-44f7-a4bc-99726ab0f5ce None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:53.991615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866df70b-7359-4dc3-82b1-abef7ff24802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:53.992609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df70b-7359-4dc3-82b1-abef7ff24802 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:53.993118 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df70b-7359-4dc3-82b1-abef7ff24802 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:53.993595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df70b-7359-4dc3-82b1-abef7ff24802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:54.040307 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62369ab3-a3e0-4808-92e4-e494986b7609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:54.040944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62369ab3-a3e0-4808-92e4-e494986b7609 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:54.041116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62369ab3-a3e0-4808-92e4-e494986b7609 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:54.041385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62369ab3-a3e0-4808-92e4-e494986b7609 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:54.062838 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62369ab3-a3e0-4808-92e4-e494986b7609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-62369ab3-a3e0-4808-92e4-e494986b7609 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:54.068318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:54.069290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:54.070187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:54.070187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:54.070187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:54.070187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:54.070187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:54.070187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:54.070187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:54.070187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:54.070187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:54.070187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:54.070187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:54.070187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:54.070187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 318/633] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:54.078987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62369ab3-a3e0-4808-92e4-e494986b7609 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:54.105334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866df70b-7359-4dc3-82b1-abef7ff24802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:54.105823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:54.108430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866df70b-7359-4dc3-82b1-abef7ff24802 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:54.118557 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:54.194087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62369ab3-a3e0-4808-92e4-e494986b7609 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:54.240047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 316/634] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:54.241045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866df70b-7359-4dc3-82b1-abef7ff24802 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:54.241175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f3418-9d97-4da9-a10c-aa59297657b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:54.241757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f3418-9d97-4da9-a10c-aa59297657b4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:54.242039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f3418-9d97-4da9-a10c-aa59297657b4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:54.242416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f3418-9d97-4da9-a10c-aa59297657b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:54.259797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f3418-9d97-4da9-a10c-aa59297657b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-301f3418-9d97-4da9-a10c-aa59297657b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:54.265569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:54.267314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:54.268150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:54.268150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:54.268150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:54.268150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:54.268150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:54.268150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:54.268150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:54.268150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:54.268150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:54.268150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:54.268150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:54.268150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:54.270547 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 319/635] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:54.271616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f3418-9d97-4da9-a10c-aa59297657b4 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:54.364621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:54.383796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866df70b-7359-4dc3-82b1-abef7ff24802 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:54.385327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f3418-9d97-4da9-a10c-aa59297657b4 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:54.392872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:54.421141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37630b-423d-4e3a-9ace-d34e4da517cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:54.421505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787faed6-84ae-4501-a756-342b88999dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:54.421740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37630b-423d-4e3a-9ace-d34e4da517cb None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:54.422014 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37630b-423d-4e3a-9ace-d34e4da517cb None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:54.422120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787faed6-84ae-4501-a756-342b88999dfd None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:54.422278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37630b-423d-4e3a-9ace-d34e4da517cb None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:54.422378 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787faed6-84ae-4501-a756-342b88999dfd None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:54.422691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787faed6-84ae-4501-a756-342b88999dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:54.423001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37630b-423d-4e3a-9ace-d34e4da517cb None admin] RBAC: Adding query filter params (name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:54.423296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37630b-423d-4e3a-9ace-d34e4da517cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:54.424661 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37630b-423d-4e3a-9ace-d34e4da517cb None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:54.432493 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 317/636] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:54.433358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37630b-423d-4e3a-9ace-d34e4da517cb None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:54.441928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787faed6-84ae-4501-a756-342b88999dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:54.441928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787faed6-84ae-4501-a756-342b88999dfd None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-787faed6-84ae-4501-a756-342b88999dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:54.451814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:54.452846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:54.454610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:54.454610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:54.454610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:54.454610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 320/637] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:54.455034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e98673-d328-44a4-941c-2cbf0f8cb01d None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:54.455200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e98673-d328-44a4-941c-2cbf0f8cb01d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:54.455451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e98673-d328-44a4-941c-2cbf0f8cb01d None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:54.456819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 321/638] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:54.460433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e98673-d328-44a4-941c-2cbf0f8cb01d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:54.545702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37630b-423d-4e3a-9ace-d34e4da517cb None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:54.581865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d6304-ea1b-411d-93bb-a118007b6884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:54.582488 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d6304-ea1b-411d-93bb-a118007b6884 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:54.582789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d6304-ea1b-411d-93bb-a118007b6884 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:54.582905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e98673-d328-44a4-941c-2cbf0f8cb01d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:54.583103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d6304-ea1b-411d-93bb-a118007b6884 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:54.583699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d6304-ea1b-411d-93bb-a118007b6884 None admin] RBAC: Adding query filter params (name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:54.583995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d6304-ea1b-411d-93bb-a118007b6884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:54.586357 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d6304-ea1b-411d-93bb-a118007b6884 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:54.599692 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 318/639] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:54.599692 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d6304-ea1b-411d-93bb-a118007b6884 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:54.624583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d021c4-e1ae-46aa-aa40-87a7068e3839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:54.625163 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d021c4-e1ae-46aa-aa40-87a7068e3839 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:54.625403 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d021c4-e1ae-46aa-aa40-87a7068e3839 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:54.626217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d021c4-e1ae-46aa-aa40-87a7068e3839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:54.628110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:54.628797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:54.638547 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d021c4-e1ae-46aa-aa40-87a7068e3839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:54.639980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d021c4-e1ae-46aa-aa40-87a7068e3839 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-60d021c4-e1ae-46aa-aa40-87a7068e3839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:54.654082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:54.655061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:54.655946 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:54.655946 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:54.655946 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:54.655946 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 322/640] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:54.656697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688afd00-fae0-4276-8916-e68f9fb7d65a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:54.656697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688afd00-fae0-4276-8916-e68f9fb7d65a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:54.656898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688afd00-fae0-4276-8916-e68f9fb7d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:54.675848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-688afd00-fae0-4276-8916-e68f9fb7d65a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:54.677194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-688afd00-fae0-4276-8916-e68f9fb7d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:54.707257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d6304-ea1b-411d-93bb-a118007b6884 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:54.742601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef966c-1ae2-4327-b98d-41dbb808b613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:54.743191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef966c-1ae2-4327-b98d-41dbb808b613 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:54.743468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef966c-1ae2-4327-b98d-41dbb808b613 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:54.743733 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef966c-1ae2-4327-b98d-41dbb808b613 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:54.744362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef966c-1ae2-4327-b98d-41dbb808b613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:54.744784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef966c-1ae2-4327-b98d-41dbb808b613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:54.746294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef966c-1ae2-4327-b98d-41dbb808b613 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:54.756009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 323/641] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:54.756648 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688afd00-fae0-4276-8916-e68f9fb7d65a None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:54.768809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 319/642] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:54.770235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef966c-1ae2-4327-b98d-41dbb808b613 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:54.864958 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688afd00-fae0-4276-8916-e68f9fb7d65a None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:54.884270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:54.892184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:54.904443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b474f57-0433-4403-b296-0de910ee44c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:54.905070 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b474f57-0433-4403-b296-0de910ee44c7 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:54.905343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b474f57-0433-4403-b296-0de910ee44c7 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:54.905616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b474f57-0433-4403-b296-0de910ee44c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:54.906403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef966c-1ae2-4327-b98d-41dbb808b613 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:54.916835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b474f57-0433-4403-b296-0de910ee44c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:54.918093 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b474f57-0433-4403-b296-0de910ee44c7 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-6b474f57-0433-4403-b296-0de910ee44c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:54.933773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:54.934831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:54.935746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:54.935746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:54.935746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:54.939029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 324/643] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:54.939859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b474f57-0433-4403-b296-0de910ee44c7 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:54.953417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872de4c-1e2a-4949-b474-f422dce464a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:54.954919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872de4c-1e2a-4949-b474-f422dce464a6 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:54.955561 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872de4c-1e2a-4949-b474-f422dce464a6 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:54.956058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872de4c-1e2a-4949-b474-f422dce464a6 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:54.957256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872de4c-1e2a-4949-b474-f422dce464a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:54.958289 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872de4c-1e2a-4949-b474-f422dce464a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:54.960639 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872de4c-1e2a-4949-b474-f422dce464a6 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:54.978170 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 320/644] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:54.979349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872de4c-1e2a-4949-b474-f422dce464a6 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:55.058476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b474f57-0433-4403-b296-0de910ee44c7 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:55.093811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6da99f-4f80-468c-8053-90e548ac0201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:55.094969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6da99f-4f80-468c-8053-90e548ac0201 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:55.095250 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6da99f-4f80-468c-8053-90e548ac0201 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:55.095515 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6da99f-4f80-468c-8053-90e548ac0201 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:55.100507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872de4c-1e2a-4949-b474-f422dce464a6 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:55.102015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6da99f-4f80-468c-8053-90e548ac0201 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:55.103474 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6da99f-4f80-468c-8053-90e548ac0201 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-1d6da99f-4f80-468c-8053-90e548ac0201 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:55.115182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:55.116116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:55.117164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:55.117164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:55.117164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:55.117164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:55.117164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:55.117164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:55.117164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:55.117164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:55.117164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 325/645] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:55.117164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6da99f-4f80-468c-8053-90e548ac0201 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:55.141300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3cb0-fa5e-4883-abc6-8d3b2e430738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:55.141834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3cb0-fa5e-4883-abc6-8d3b2e430738 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:55.142145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3cb0-fa5e-4883-abc6-8d3b2e430738 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:55.142416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3cb0-fa5e-4883-abc6-8d3b2e430738 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:55.143113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3cb0-fa5e-4883-abc6-8d3b2e430738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:55.143415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3cb0-fa5e-4883-abc6-8d3b2e430738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:55.144785 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3cb0-fa5e-4883-abc6-8d3b2e430738 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:55.149647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:55.159622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 321/646] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:55.161276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3cb0-fa5e-4883-abc6-8d3b2e430738 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:55.175241 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:55.233165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6da99f-4f80-468c-8053-90e548ac0201 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:55.271724 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3cb0-fa5e-4883-abc6-8d3b2e430738 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:55.272238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb30087-5941-4b39-ad42-0ca80ba26b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:55.272571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb30087-5941-4b39-ad42-0ca80ba26b54 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:55.272844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb30087-5941-4b39-ad42-0ca80ba26b54 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:55.273114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb30087-5941-4b39-ad42-0ca80ba26b54 None admin] PATH_INFO: `/v3/users/glance` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:55.280934 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb30087-5941-4b39-ad42-0ca80ba26b54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:55.283082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb30087-5941-4b39-ad42-0ca80ba26b54 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-ebb30087-5941-4b39-ad42-0ca80ba26b54 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:55.294446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:55.295615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:55.296716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:55.296716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:55.296716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:55.296716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:55.296716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:55.296716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:55.296716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:55.296716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:55.296716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 05:21:55.296716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:55.299105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 326/647] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:55.300012 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb30087-5941-4b39-ad42-0ca80ba26b54 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:55.312116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb205e9b-61a3-4ba9-b79b-7fd0c28cab23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:55.313439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb205e9b-61a3-4ba9-b79b-7fd0c28cab23 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:55.313735 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb205e9b-61a3-4ba9-b79b-7fd0c28cab23 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:55.314003 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb205e9b-61a3-4ba9-b79b-7fd0c28cab23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:55.326340 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb205e9b-61a3-4ba9-b79b-7fd0c28cab23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-fb205e9b-61a3-4ba9-b79b-7fd0c28cab23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:55.331860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:55.332800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:55.333637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:55.333637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:55.333637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:55.333637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:55.333637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:55.333637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:55.333637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:55.333637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:55.333637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:55.333637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:55.333637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:55.333637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:55.333637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 322/648] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:55.334336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb205e9b-61a3-4ba9-b79b-7fd0c28cab23 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:55.400886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:55.404002 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:55.417940 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb30087-5941-4b39-ad42-0ca80ba26b54 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:55.435208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb205e9b-61a3-4ba9-b79b-7fd0c28cab23 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:55.456969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1d852-80d8-4902-8fad-41c32a193a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:55.457855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1d852-80d8-4902-8fad-41c32a193a1b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:55.458475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1d852-80d8-4902-8fad-41c32a193a1b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:55.459339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1d852-80d8-4902-8fad-41c32a193a1b None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:55.460447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1d852-80d8-4902-8fad-41c32a193a1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:55.460931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1d852-80d8-4902-8fad-41c32a193a1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:55.462705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1d852-80d8-4902-8fad-41c32a193a1b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:55.470019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518407-678b-49ed-a217-0ea1566986de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:55.470674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518407-678b-49ed-a217-0ea1566986de None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:55.470954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518407-678b-49ed-a217-0ea1566986de None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:55.471225 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518407-678b-49ed-a217-0ea1566986de None admin] PATH_INFO: `/v3/users/cinder` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:55.482089 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74518407-678b-49ed-a217-0ea1566986de None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:55.482089 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74518407-678b-49ed-a217-0ea1566986de None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:55.482912 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 327/649] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:55.484533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1d852-80d8-4902-8fad-41c32a193a1b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-74518407-678b-49ed-a217-0ea1566986de None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:55.493446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:55.494599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:55.495830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:55.495830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:55.495830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:55.495830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:55.495830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:55.495830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:55.495830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:55.495830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:55.495830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 05:21:55.495830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:55.498974 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 323/650] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:55.499776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518407-678b-49ed-a217-0ea1566986de None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:55.592715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1d852-80d8-4902-8fad-41c32a193a1b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:55.601584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518407-678b-49ed-a217-0ea1566986de None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:55.630111 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:55.631894 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febd78c-b293-4117-8d29-7832314c870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:55.632982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febd78c-b293-4117-8d29-7832314c870f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:55.633263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febd78c-b293-4117-8d29-7832314c870f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:55.633537 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febd78c-b293-4117-8d29-7832314c870f None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:55.634442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febd78c-b293-4117-8d29-7832314c870f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:55.634815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febd78c-b293-4117-8d29-7832314c870f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:55.636205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febd78c-b293-4117-8d29-7832314c870f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:55.636723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2c707-1838-491b-a108-6daca22e9ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:55.637322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2c707-1838-491b-a108-6daca22e9ae7 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:55.637644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2c707-1838-491b-a108-6daca22e9ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:55.637940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2c707-1838-491b-a108-6daca22e9ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:55.638596 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2c707-1838-491b-a108-6daca22e9ae7 None admin] RBAC: Adding query filter params (name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:55.639503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2c707-1838-491b-a108-6daca22e9ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:55.640256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2c707-1838-491b-a108-6daca22e9ae7 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:55.653164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 324/651] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:55.653164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2c707-1838-491b-a108-6daca22e9ae7 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:55.662724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 328/652] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 16 05:21:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:55.662724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febd78c-b293-4117-8d29-7832314c870f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:55.672081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:55.760821 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2c707-1838-491b-a108-6daca22e9ae7 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:55.777870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febd78c-b293-4117-8d29-7832314c870f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:55.794462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344185f-b330-467f-a346-3a947c299fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:55.795097 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344185f-b330-467f-a346-3a947c299fa3 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:55.795361 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344185f-b330-467f-a346-3a947c299fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:55.795629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344185f-b330-467f-a346-3a947c299fa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:55.796335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344185f-b330-467f-a346-3a947c299fa3 None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=515e548efd984b87bca742e26eec162a) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:55.796638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344185f-b330-467f-a346-3a947c299fa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:55.798095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344185f-b330-467f-a346-3a947c299fa3 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:55.804554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 325/653] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:55 2022] GET /identity/v3/role_assignments?user.id=515e548efd984b87bca742e26eec162a&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:55.805560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344185f-b330-467f-a346-3a947c299fa3 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:55.828238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914dfc8-01ce-4a33-8805-b024624d7bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:55.829423 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914dfc8-01ce-4a33-8805-b024624d7bde None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:55.829723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914dfc8-01ce-4a33-8805-b024624d7bde None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:55.829993 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914dfc8-01ce-4a33-8805-b024624d7bde None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:55.830777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914dfc8-01ce-4a33-8805-b024624d7bde None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:55.831082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914dfc8-01ce-4a33-8805-b024624d7bde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:55.833516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914dfc8-01ce-4a33-8805-b024624d7bde None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:55.854494 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 329/654] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 16 05:21:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:55.855682 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914dfc8-01ce-4a33-8805-b024624d7bde None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:55.878722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:55.926575 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:55.930364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344185f-b330-467f-a346-3a947c299fa3 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:55.968728 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e60c7-e750-42f3-909e-d2df79aaf041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:55.970431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e60c7-e750-42f3-909e-d2df79aaf041 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:55.970904 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e60c7-e750-42f3-909e-d2df79aaf041 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:55.971334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e60c7-e750-42f3-909e-d2df79aaf041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:55.971679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914dfc8-01ce-4a33-8805-b024624d7bde None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:55.987230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e60c7-e750-42f3-909e-d2df79aaf041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:55.988924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e60c7-e750-42f3-909e-d2df79aaf041 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-4f9e60c7-e750-42f3-909e-d2df79aaf041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:56.009879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:56.010956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:56.011979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:56.011979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:56.011979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:56.011979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 326/655] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:56.013011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85c40-9d34-46db-8eca-c513e11d3526 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:56.013552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85c40-9d34-46db-8eca-c513e11d3526 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:56.013943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2b853-0111-40c1-8b93-8147da43531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:56.014058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85c40-9d34-46db-8eca-c513e11d3526 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:56.014591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b853-0111-40c1-8b93-8147da43531d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:56.014868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b853-0111-40c1-8b93-8147da43531d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:56.015140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2b853-0111-40c1-8b93-8147da43531d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:56.015711 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 327/656] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:56.016501 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c85c40-9d34-46db-8eca-c513e11d3526 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:56.106252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2b853-0111-40c1-8b93-8147da43531d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:56.107744 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2b853-0111-40c1-8b93-8147da43531d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:56.129771 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c85c40-9d34-46db-8eca-c513e11d3526 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:56.139747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:56.170102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a7170-917f-49db-a973-dcf16aa5c582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:56.170760 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a7170-917f-49db-a973-dcf16aa5c582 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:56.171010 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a7170-917f-49db-a973-dcf16aa5c582 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:56.171280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a7170-917f-49db-a973-dcf16aa5c582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:56.173138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:56.218213 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 330/657] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:56.218990 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2b853-0111-40c1-8b93-8147da43531d None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:56.250862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a7170-917f-49db-a973-dcf16aa5c582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:56.252379 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a7170-917f-49db-a973-dcf16aa5c582 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:56.332044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2b853-0111-40c1-8b93-8147da43531d None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:56.355681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 328/658] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:56.356985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1292c9-0c48-455f-831d-c331e3c78f97 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:56.357268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1292c9-0c48-455f-831d-c331e3c78f97 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:56.357534 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1292c9-0c48-455f-831d-c331e3c78f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:56.376029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-ca1292c9-0c48-455f-831d-c331e3c78f97 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:56.377010 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948a7f-754f-441b-80b3-c162cc10704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:56.377232 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ca1292c9-0c48-455f-831d-c331e3c78f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:56.378055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948a7f-754f-441b-80b3-c162cc10704d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:56.378559 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948a7f-754f-441b-80b3-c162cc10704d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:56.379055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948a7f-754f-441b-80b3-c162cc10704d None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:56.379368 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:56.379989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a948a7f-754f-441b-80b3-c162cc10704d None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:56.380897 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a948a7f-754f-441b-80b3-c162cc10704d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:56.381919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a948a7f-754f-441b-80b3-c162cc10704d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:56.398325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 331/659] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:56.398325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948a7f-754f-441b-80b3-c162cc10704d None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:56.425422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:56.453024 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 329/660] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:56.454261 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1292c9-0c48-455f-831d-c331e3c78f97 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:56.521289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948a7f-754f-441b-80b3-c162cc10704d None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:56.562185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1292c9-0c48-455f-831d-c331e3c78f97 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:56.567728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4d72-a189-41f7-9e56-e8ec1113c2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:56.568420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4d72-a189-41f7-9e56-e8ec1113c2ac None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:56.568700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4d72-a189-41f7-9e56-e8ec1113c2ac None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:56.568969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4d72-a189-41f7-9e56-e8ec1113c2ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:56.581834 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda4d72-a189-41f7-9e56-e8ec1113c2ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:56.583797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda4d72-a189-41f7-9e56-e8ec1113c2ac None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-8bda4d72-a189-41f7-9e56-e8ec1113c2ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:56.601295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:56.602338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:56.603255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:56.603255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:56.603255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:56.603255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 332/661] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:56.604105 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af7832-07f5-4268-83b5-b8f656c573f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:56.605005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af7832-07f5-4268-83b5-b8f656c573f6 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:56.605528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af7832-07f5-4268-83b5-b8f656c573f6 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:56.605989 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af7832-07f5-4268-83b5-b8f656c573f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:56.607337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4d72-a189-41f7-9e56-e8ec1113c2ac None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:56.614455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:56.619228 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af7832-07f5-4268-83b5-b8f656c573f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:56.621758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af7832-07f5-4268-83b5-b8f656c573f6 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-46af7832-07f5-4268-83b5-b8f656c573f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:56.637377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:56.638374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:56.639296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:56.639296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:56.639296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:56.641342 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 330/662] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:56.642311 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af7832-07f5-4268-83b5-b8f656c573f6 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:56.703658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:56.730638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4d72-a189-41f7-9e56-e8ec1113c2ac None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:56.747616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af7832-07f5-4268-83b5-b8f656c573f6 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:56.767674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b16de-8fa0-4d54-93c4-62c2c7ee5f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:56.768324 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b16de-8fa0-4d54-93c4-62c2c7ee5f20 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:56.768604 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b16de-8fa0-4d54-93c4-62c2c7ee5f20 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:56.768872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b16de-8fa0-4d54-93c4-62c2c7ee5f20 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:56.778288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b16de-8fa0-4d54-93c4-62c2c7ee5f20 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:56.779695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b16de-8fa0-4d54-93c4-62c2c7ee5f20 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:56.785964 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08242208-5cd6-420b-91a4-56e8ebf0112b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:56.786597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08242208-5cd6-420b-91a4-56e8ebf0112b None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:56.786872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08242208-5cd6-420b-91a4-56e8ebf0112b None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:56.787137 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08242208-5cd6-420b-91a4-56e8ebf0112b None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:56.787775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08242208-5cd6-420b-91a4-56e8ebf0112b None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:56.788072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08242208-5cd6-420b-91a4-56e8ebf0112b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:56.789417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08242208-5cd6-420b-91a4-56e8ebf0112b None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-392b16de-8fa0-4d54-93c4-62c2c7ee5f20 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:56.791859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:56.792861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:56.793806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:56.793806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:56.793806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:56.793806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:56.793806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:56.793806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:56.793806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:56.793806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:56.793806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 05:21:56.793806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:56.798328 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 333/663] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:56.799108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b16de-8fa0-4d54-93c4-62c2c7ee5f20 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:56.807028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 331/664] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:56.807028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08242208-5cd6-420b-91a4-56e8ebf0112b None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:56.850493 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:56.901466 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08242208-5cd6-420b-91a4-56e8ebf0112b None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:56.912547 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b16de-8fa0-4d54-93c4-62c2c7ee5f20 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:56.936318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a171e-9e30-46f4-840c-58a081f80fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:56.936936 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a171e-9e30-46f4-840c-58a081f80fac None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:56.937218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a171e-9e30-46f4-840c-58a081f80fac None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:56.937737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a171e-9e30-46f4-840c-58a081f80fac None admin] PATH_INFO: `/v3/roles/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:56.947729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba1aef-98bd-44d9-88ca-2f02b5256d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:56.948336 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1aef-98bd-44d9-88ca-2f02b5256d4f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:56.948615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1aef-98bd-44d9-88ca-2f02b5256d4f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:56.948885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1aef-98bd-44d9-88ca-2f02b5256d4f None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:56.949169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a171e-9e30-46f4-840c-58a081f80fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:56.949524 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba1aef-98bd-44d9-88ca-2f02b5256d4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:56.949825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba1aef-98bd-44d9-88ca-2f02b5256d4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:56.951217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba1aef-98bd-44d9-88ca-2f02b5256d4f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:56.953473 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-161a171e-9e30-46f4-840c-58a081f80fac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:56.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:56.956545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 332/665] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:21:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:56.957988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a171e-9e30-46f4-840c-58a081f80fac None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:56.974039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 334/666] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:56.974039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba1aef-98bd-44d9-88ca-2f02b5256d4f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:57.064063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a171e-9e30-46f4-840c-58a081f80fac None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:57.074805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:57.075320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba1aef-98bd-44d9-88ca-2f02b5256d4f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:57.102756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa7541-65d8-485d-a0df-c10952d66332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:57.103360 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa7541-65d8-485d-a0df-c10952d66332 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:57.103661 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa7541-65d8-485d-a0df-c10952d66332 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:57.103903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa7541-65d8-485d-a0df-c10952d66332 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:57.104629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa7541-65d8-485d-a0df-c10952d66332 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:57.104933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa7541-65d8-485d-a0df-c10952d66332 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:57.107419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa7541-65d8-485d-a0df-c10952d66332 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:57.112365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acfb20-0e0b-479e-b546-96799d446821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:57.112988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acfb20-0e0b-479e-b546-96799d446821 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:57.113261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acfb20-0e0b-479e-b546-96799d446821 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:57.113631 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acfb20-0e0b-479e-b546-96799d446821 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:57.120815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acfb20-0e0b-479e-b546-96799d446821 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:57.122294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acfb20-0e0b-479e-b546-96799d446821 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:57.129751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 333/667] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Sep 16 05:21:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:57.130805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa7541-65d8-485d-a0df-c10952d66332 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-31acfb20-0e0b-479e-b546-96799d446821 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:57.133640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:57.134530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:57.135421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:57.135421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:57.135421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:57.135421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:57.135421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:57.135421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:57.135421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:57.135421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:57.135421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 335/668] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:57.135904 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acfb20-0e0b-479e-b546-96799d446821 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:57.202138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:57.248305 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acfb20-0e0b-479e-b546-96799d446821 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:57.252167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa7541-65d8-485d-a0df-c10952d66332 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:57.285177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee6fbb-f3eb-4764-9a67-ffa65244d580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:57.285806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee6fbb-f3eb-4764-9a67-ffa65244d580 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:57.286087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee6fbb-f3eb-4764-9a67-ffa65244d580 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:57.286357 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee6fbb-f3eb-4764-9a67-ffa65244d580 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:57.290396 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828cce8-1f76-4214-97a1-24d772b1597f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:57.291272 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828cce8-1f76-4214-97a1-24d772b1597f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:57.291754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828cce8-1f76-4214-97a1-24d772b1597f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:57.292241 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828cce8-1f76-4214-97a1-24d772b1597f None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:57.293057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee6fbb-f3eb-4764-9a67-ffa65244d580 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:57.293321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828cce8-1f76-4214-97a1-24d772b1597f None admin] RBAC: Adding query filter params (name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:57.293826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828cce8-1f76-4214-97a1-24d772b1597f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:57.294478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee6fbb-f3eb-4764-9a67-ffa65244d580 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:57.295642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828cce8-1f76-4214-97a1-24d772b1597f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:57.303893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 334/669] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:21:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:57.304904 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828cce8-1f76-4214-97a1-24d772b1597f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-85ee6fbb-f3eb-4764-9a67-ffa65244d580 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:57.305668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:57.306564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:57.307458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:57.307458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:57.307458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:57.307458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:57.307458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:57.307458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:57.307458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:57.307458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:57.310649 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 336/670] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:57.313889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee6fbb-f3eb-4764-9a67-ffa65244d580 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:57.343926 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:57.416975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828cce8-1f76-4214-97a1-24d772b1597f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:57.427600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee6fbb-f3eb-4764-9a67-ffa65244d580 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:57.445098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:57.456231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a1bf4-ed00-49a4-980e-c8cd230d1a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:57.456844 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a1bf4-ed00-49a4-980e-c8cd230d1a6d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:57.457129 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a1bf4-ed00-49a4-980e-c8cd230d1a6d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:57.457403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a1bf4-ed00-49a4-980e-c8cd230d1a6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:57.463926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e758fd7-b3ea-441e-91b2-2fcd89049058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:57.464526 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e758fd7-b3ea-441e-91b2-2fcd89049058 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:57.464801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e758fd7-b3ea-441e-91b2-2fcd89049058 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:57.465067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e758fd7-b3ea-441e-91b2-2fcd89049058 None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:57.465754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e758fd7-b3ea-441e-91b2-2fcd89049058 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:57.466058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e758fd7-b3ea-441e-91b2-2fcd89049058 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:57.467515 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e758fd7-b3ea-441e-91b2-2fcd89049058 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:57.485218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 337/671] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:57.486224 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e758fd7-b3ea-441e-91b2-2fcd89049058 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:57.529234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a1bf4-ed00-49a4-980e-c8cd230d1a6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:57.530859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a1bf4-ed00-49a4-980e-c8cd230d1a6d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:57.561115 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:57.589631 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e758fd7-b3ea-441e-91b2-2fcd89049058 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:57.623819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f9163-68cb-4e2c-aba6-17c609296897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:57.624366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9163-68cb-4e2c-aba6-17c609296897 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:57.624646 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9163-68cb-4e2c-aba6-17c609296897 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:57.624916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9163-68cb-4e2c-aba6-17c609296897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:57.635880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f9163-68cb-4e2c-aba6-17c609296897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:57.637323 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f9163-68cb-4e2c-aba6-17c609296897 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:57.642687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 335/672] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:57.643577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a1bf4-ed00-49a4-980e-c8cd230d1a6d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-386f9163-68cb-4e2c-aba6-17c609296897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:57.655552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:57.656541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:57.657497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:57.657497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:57.657497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:57.657497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 338/673] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:57.657497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f9163-68cb-4e2c-aba6-17c609296897 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:57.694299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:57.747505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a1bf4-ed00-49a4-980e-c8cd230d1a6d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:57.777117 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:57.778664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f9163-68cb-4e2c-aba6-17c609296897 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:57.784407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb6cc5-eb40-4b75-96f7-365c66253652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:57.785013 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb6cc5-eb40-4b75-96f7-365c66253652 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:57.785286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb6cc5-eb40-4b75-96f7-365c66253652 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:57.785552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb6cc5-eb40-4b75-96f7-365c66253652 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:57.786245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb6cc5-eb40-4b75-96f7-365c66253652 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:57.786567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb6cc5-eb40-4b75-96f7-365c66253652 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:57.788005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb6cc5-eb40-4b75-96f7-365c66253652 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:57.800392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 336/674] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:57.801517 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb6cc5-eb40-4b75-96f7-365c66253652 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:57.816172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea2503-98ac-4dba-a572-a74d143337fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:57.816772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2503-98ac-4dba-a572-a74d143337fd None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:57.817052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2503-98ac-4dba-a572-a74d143337fd None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:57.817321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2503-98ac-4dba-a572-a74d143337fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:57.818047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea2503-98ac-4dba-a572-a74d143337fd None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=20d8e253a72c44f7a5a986f981660df2) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:57.818633 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea2503-98ac-4dba-a572-a74d143337fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:57.819824 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea2503-98ac-4dba-a572-a74d143337fd None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:57.826169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 339/675] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:57 2022] GET /identity/v3/role_assignments?user.id=20d8e253a72c44f7a5a986f981660df2&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:57.826982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea2503-98ac-4dba-a572-a74d143337fd None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:57.945212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb6cc5-eb40-4b75-96f7-365c66253652 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:57.963553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:57.980088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea2503-98ac-4dba-a572-a74d143337fd None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:57.987412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b7a53-8c69-4ce3-91fc-dbc666dd1d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:57.988255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7a53-8c69-4ce3-91fc-dbc666dd1d00 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:57.988637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7a53-8c69-4ce3-91fc-dbc666dd1d00 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:57.988980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7a53-8c69-4ce3-91fc-dbc666dd1d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:58.002168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b7a53-8c69-4ce3-91fc-dbc666dd1d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:58.003903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b7a53-8c69-4ce3-91fc-dbc666dd1d00 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-9d3b7a53-8c69-4ce3-91fc-dbc666dd1d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:58.020099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:58.021133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:58.022021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:58.022021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:58.022021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:58.022021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 337/676] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:58.022886 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b7a53-8c69-4ce3-91fc-dbc666dd1d00 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:58.036161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a7c61-9ebe-41ae-85a8-7ffab368603a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:58.036776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a7c61-9ebe-41ae-85a8-7ffab368603a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:58.037283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a7c61-9ebe-41ae-85a8-7ffab368603a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:58.037283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a7c61-9ebe-41ae-85a8-7ffab368603a None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:58.037959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a7c61-9ebe-41ae-85a8-7ffab368603a None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:58.038255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a7c61-9ebe-41ae-85a8-7ffab368603a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:58.042572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a7c61-9ebe-41ae-85a8-7ffab368603a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:58.055657 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 340/677] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:58.056376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a7c61-9ebe-41ae-85a8-7ffab368603a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:58.077138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:58.150574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b7a53-8c69-4ce3-91fc-dbc666dd1d00 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:58.184170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a7c61-9ebe-41ae-85a8-7ffab368603a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:58.184683 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c92146-fff8-45b5-bc33-2b6fc397d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:58.185294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92146-fff8-45b5-bc33-2b6fc397d59a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:58.185586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92146-fff8-45b5-bc33-2b6fc397d59a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:58.185838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92146-fff8-45b5-bc33-2b6fc397d59a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:58.186590 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c92146-fff8-45b5-bc33-2b6fc397d59a None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=fc48962e649c40ca82cf3173ce9940e9) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:58.186897 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c92146-fff8-45b5-bc33-2b6fc397d59a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:58.189104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c92146-fff8-45b5-bc33-2b6fc397d59a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:58.202613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 338/678] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:58 2022] GET /identity/v3/role_assignments?user.id=fc48962e649c40ca82cf3173ce9940e9&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:58.202613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c92146-fff8-45b5-bc33-2b6fc397d59a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:58.240455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057203f-4dae-4c21-b82f-39f6b3fe1fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:58.241075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057203f-4dae-4c21-b82f-39f6b3fe1fb0 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:58.241349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057203f-4dae-4c21-b82f-39f6b3fe1fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:58.241616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057203f-4dae-4c21-b82f-39f6b3fe1fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:58.242263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057203f-4dae-4c21-b82f-39f6b3fe1fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:58.243072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057203f-4dae-4c21-b82f-39f6b3fe1fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:58.243956 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057203f-4dae-4c21-b82f-39f6b3fe1fb0 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:58.259035 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 341/679] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:58.260750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bab16e-8edf-426c-829c-f0420da1fec1 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:58.261237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bab16e-8edf-426c-829c-f0420da1fec1 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:58.261739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bab16e-8edf-426c-829c-f0420da1fec1 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:58.268490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 342/680] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:21:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:21:58.269555 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bab16e-8edf-426c-829c-f0420da1fec1 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:58.286396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:58.337412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c92146-fff8-45b5-bc33-2b6fc397d59a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:58.346193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:58.380176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675524be-63a2-411e-97b9-d54efcbb6f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:58.380846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675524be-63a2-411e-97b9-d54efcbb6f46 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:58.381525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675524be-63a2-411e-97b9-d54efcbb6f46 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:58.381525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675524be-63a2-411e-97b9-d54efcbb6f46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:58.390807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675524be-63a2-411e-97b9-d54efcbb6f46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:58.392297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675524be-63a2-411e-97b9-d54efcbb6f46 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-675524be-63a2-411e-97b9-d54efcbb6f46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:21:58.407176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:58.408190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:58.409130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:58.409130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:58.409130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:21:58.409130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:21:58.409130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:21:58.409130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:21:58.409130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:21:58.409130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:21:58.409130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 05:21:58.409130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:58.410111 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 339/681] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:21:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:58.411930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2a28-67e1-4226-bae5-0e852ed4399a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:58.412405 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2a28-67e1-4226-bae5-0e852ed4399a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:58.412859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2a28-67e1-4226-bae5-0e852ed4399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:58.416649 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bab16e-8edf-426c-829c-f0420da1fec1 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:58.438787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-a1bb2a28-67e1-4226-bae5-0e852ed4399a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:21:58.439766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a1bb2a28-67e1-4226-bae5-0e852ed4399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:21:58.465210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2a5bc-20e8-4ce8-9622-5c0288dafb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:58.465772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2a5bc-20e8-4ce8-9622-5c0288dafb06 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:58.466026 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2a5bc-20e8-4ce8-9622-5c0288dafb06 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:58.466303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2a5bc-20e8-4ce8-9622-5c0288dafb06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:58.474276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2a5bc-20e8-4ce8-9622-5c0288dafb06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:58.475846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2a5bc-20e8-4ce8-9622-5c0288dafb06 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-a0e2a5bc-20e8-4ce8-9622-5c0288dafb06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:58.489501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:58.490446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:58.491412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:58.491412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:58.491412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:58.491412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:58.491412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:58.491412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:58.491412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:58.491412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:58.491412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 343/682] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:58.491914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2a5bc-20e8-4ce8-9622-5c0288dafb06 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:58.534207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 340/683] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:21:58.535511 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb2a28-67e1-4226-bae5-0e852ed4399a None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:58.572660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:58.605851 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2a5bc-20e8-4ce8-9622-5c0288dafb06 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:58.646872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845879bf-50e9-4f3c-a942-7cfb6fecfbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:58.647531 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845879bf-50e9-4f3c-a942-7cfb6fecfbcf None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:58.647816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845879bf-50e9-4f3c-a942-7cfb6fecfbcf None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:58.648091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845879bf-50e9-4f3c-a942-7cfb6fecfbcf None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:58.648817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845879bf-50e9-4f3c-a942-7cfb6fecfbcf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:58.649124 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845879bf-50e9-4f3c-a942-7cfb6fecfbcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:58.650596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845879bf-50e9-4f3c-a942-7cfb6fecfbcf None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:58.664643 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:58.673892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb2a28-67e1-4226-bae5-0e852ed4399a None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:58.674052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 344/684] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 16 05:21:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:58.683110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845879bf-50e9-4f3c-a942-7cfb6fecfbcf None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:58.775315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d88a7b-87c2-461b-9be4-a1599a7f506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:58.775840 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d88a7b-87c2-461b-9be4-a1599a7f506e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:58.776118 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d88a7b-87c2-461b-9be4-a1599a7f506e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:58.776386 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d88a7b-87c2-461b-9be4-a1599a7f506e None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:58.777077 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d88a7b-87c2-461b-9be4-a1599a7f506e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:58.777376 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d88a7b-87c2-461b-9be4-a1599a7f506e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:58.778862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d88a7b-87c2-461b-9be4-a1599a7f506e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:58.808960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 341/685] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:58.811872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845879bf-50e9-4f3c-a942-7cfb6fecfbcf None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:58.815385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d88a7b-87c2-461b-9be4-a1599a7f506e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:58.845675 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:58.851307 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17360c90-9795-4943-89fa-e7af75a2b42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:58.852696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17360c90-9795-4943-89fa-e7af75a2b42b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:58.853186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17360c90-9795-4943-89fa-e7af75a2b42b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:58.853661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17360c90-9795-4943-89fa-e7af75a2b42b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:58.935038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17360c90-9795-4943-89fa-e7af75a2b42b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:58.937205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17360c90-9795-4943-89fa-e7af75a2b42b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:59.010088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d88a7b-87c2-461b-9be4-a1599a7f506e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:59.047666 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92614012-8dc3-4c68-8ffb-3cdec747a340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:59.048188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92614012-8dc3-4c68-8ffb-3cdec747a340 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:59.048756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92614012-8dc3-4c68-8ffb-3cdec747a340 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:59.048878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92614012-8dc3-4c68-8ffb-3cdec747a340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:59.049531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92614012-8dc3-4c68-8ffb-3cdec747a340 None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=d51f44d06b0f4303a753709bd1bcf3e5) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:59.049835 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92614012-8dc3-4c68-8ffb-3cdec747a340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:59.051308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92614012-8dc3-4c68-8ffb-3cdec747a340 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:59.057483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 345/686] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:21:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:21:59.058814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17360c90-9795-4943-89fa-e7af75a2b42b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:59.063975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 342/687] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:58 2022] GET /identity/v3/role_assignments?user.id=d51f44d06b0f4303a753709bd1bcf3e5&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:59.065190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92614012-8dc3-4c68-8ffb-3cdec747a340 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:59.092292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:59.103170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:59.184642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92614012-8dc3-4c68-8ffb-3cdec747a340 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:59.201767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17360c90-9795-4943-89fa-e7af75a2b42b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:59.222168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c7c8d-26ec-439b-8f2a-01256cc2b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:59.222941 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7c8d-26ec-439b-8f2a-01256cc2b9ea None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:59.223127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7c8d-26ec-439b-8f2a-01256cc2b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:59.223393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7c8d-26ec-439b-8f2a-01256cc2b9ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:59.236251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c7c8d-26ec-439b-8f2a-01256cc2b9ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:59.237710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c7c8d-26ec-439b-8f2a-01256cc2b9ea None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:59.249025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb6906-a065-4d66-971b-1f9387d70900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:59.250029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb6906-a065-4d66-971b-1f9387d70900 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:59.251159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb6906-a065-4d66-971b-1f9387d70900 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:59.251646 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb6906-a065-4d66-971b-1f9387d70900 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-cf0c7c8d-26ec-439b-8f2a-01256cc2b9ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:59.253649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:59.254648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:59.255546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:59.255546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:59.255546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:59.255546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 343/688] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:59.260608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c7c8d-26ec-439b-8f2a-01256cc2b9ea None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:59.268030 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb6906-a065-4d66-971b-1f9387d70900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-3afb6906-a065-4d66-971b-1f9387d70900 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:21:59.275346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:59.276346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:59.277180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:59.277180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:59.277180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:59.277180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:59.277180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:21:59.277180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:21:59.277180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:21:59.277180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:21:59.277180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:21:59.277180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:21:59.277180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:21:59.277180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:59.279703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 346/689] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:21:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:59.286848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb6906-a065-4d66-971b-1f9387d70900 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:59.396560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:59.434493 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:59.437650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c7c8d-26ec-439b-8f2a-01256cc2b9ea None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:59.447075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb6906-a065-4d66-971b-1f9387d70900 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:59.476686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279898af-d5b1-4509-aa5e-789be5c9cf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:59.478076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279898af-d5b1-4509-aa5e-789be5c9cf6a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:59.478603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279898af-d5b1-4509-aa5e-789be5c9cf6a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:59.479080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279898af-d5b1-4509-aa5e-789be5c9cf6a None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:59.480033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279898af-d5b1-4509-aa5e-789be5c9cf6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:59.480586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279898af-d5b1-4509-aa5e-789be5c9cf6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:59.482313 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279898af-d5b1-4509-aa5e-789be5c9cf6a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:59.482846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae655f-6863-48ac-a985-6b28ee06d1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:59.483545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae655f-6863-48ac-a985-6b28ee06d1ca None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:59.483934 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae655f-6863-48ac-a985-6b28ee06d1ca None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:59.484310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae655f-6863-48ac-a985-6b28ee06d1ca None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:59.485607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae655f-6863-48ac-a985-6b28ee06d1ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:59.486005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae655f-6863-48ac-a985-6b28ee06d1ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:59.487484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae655f-6863-48ac-a985-6b28ee06d1ca None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:59.497861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 344/691] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:59.498079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 347/691] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:21:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:21:59.503818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279898af-d5b1-4509-aa5e-789be5c9cf6a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:59.503965 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae655f-6863-48ac-a985-6b28ee06d1ca None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:59.607279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae655f-6863-48ac-a985-6b28ee06d1ca None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:59.613383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279898af-d5b1-4509-aa5e-789be5c9cf6a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:59.649611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c987f34-b18a-44e9-8430-629d36258b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:59.650600 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c987f34-b18a-44e9-8430-629d36258b96 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:59.651136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c987f34-b18a-44e9-8430-629d36258b96 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:59.651588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c987f34-b18a-44e9-8430-629d36258b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:59.652045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf56211-b853-404b-b12c-510046b78ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:59.652747 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf56211-b853-404b-b12c-510046b78ee1 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:59.653121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf56211-b853-404b-b12c-510046b78ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:59.653462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf56211-b853-404b-b12c-510046b78ee1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:59.654814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:59.663774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf56211-b853-404b-b12c-510046b78ee1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:59.665049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c987f34-b18a-44e9-8430-629d36258b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:59.665741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf56211-b853-404b-b12c-510046b78ee1 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:59.667353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c987f34-b18a-44e9-8430-629d36258b96 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-abf56211-b853-404b-b12c-510046b78ee1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:21:59.680261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:59.681179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:59.682063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:21:59.682063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:21:59.682063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:21:59.682063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:21:59.682063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:21:59.682063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:21:59.682063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:21:59.682063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:21:59.682063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 348/692] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:21:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-8c987f34-b18a-44e9-8430-629d36258b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:21:59.686787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:21:59.688029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:21:59.688920 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:21:59.688920 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:21:59.688920 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:21:59.690892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 345/693] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:21:59.694623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf56211-b853-404b-b12c-510046b78ee1 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:59.696887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c987f34-b18a-44e9-8430-629d36258b96 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:59.723674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:21:59.825757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c987f34-b18a-44e9-8430-629d36258b96 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:59.889321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf56211-b853-404b-b12c-510046b78ee1 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:21:59.892732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac05cdc-1f0d-46b0-bfde-0ac8f3106737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:59.893369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac05cdc-1f0d-46b0-bfde-0ac8f3106737 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:59.893642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac05cdc-1f0d-46b0-bfde-0ac8f3106737 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:59.893908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac05cdc-1f0d-46b0-bfde-0ac8f3106737 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:59.894638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac05cdc-1f0d-46b0-bfde-0ac8f3106737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:59.894854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac05cdc-1f0d-46b0-bfde-0ac8f3106737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:59.896238 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac05cdc-1f0d-46b0-bfde-0ac8f3106737 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:59.918158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 346/694] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:59.925006 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac05cdc-1f0d-46b0-bfde-0ac8f3106737 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:21:59.957157 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b530876-74c3-4cf6-8520-63fb290eb395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:21:59.957768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b530876-74c3-4cf6-8520-63fb290eb395 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:21:59.958042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b530876-74c3-4cf6-8520-63fb290eb395 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:21:59.958313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b530876-74c3-4cf6-8520-63fb290eb395 None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:21:59.959031 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b530876-74c3-4cf6-8520-63fb290eb395 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:21:59.959338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b530876-74c3-4cf6-8520-63fb290eb395 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:21:59.960803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b530876-74c3-4cf6-8520-63fb290eb395 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:21:59.987763 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 349/695] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:21:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:21:59.992785 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b530876-74c3-4cf6-8520-63fb290eb395 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:00.015150 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:00.104418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac05cdc-1f0d-46b0-bfde-0ac8f3106737 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:00.128708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:00.165570 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bca7e-8501-4e30-891b-d4afb747643e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:00.166204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bca7e-8501-4e30-891b-d4afb747643e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:00.166483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bca7e-8501-4e30-891b-d4afb747643e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:00.166773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bca7e-8501-4e30-891b-d4afb747643e None admin] PATH_INFO: `/v3/users/nova` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:00.181898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459bca7e-8501-4e30-891b-d4afb747643e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:00.183320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459bca7e-8501-4e30-891b-d4afb747643e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:00.185759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b530876-74c3-4cf6-8520-63fb290eb395 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-459bca7e-8501-4e30-891b-d4afb747643e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:00.209973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:00.211022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:00.211979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:00.211979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:00.211979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:00.211979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:00.211979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:00.211979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:00.211979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:00.211979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:00.211979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:22:00.211979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:00.211979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 347/696] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 05:21:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:00.220356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bca7e-8501-4e30-891b-d4afb747643e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:00.240832 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5648f-464a-400b-93d0-4044c45fd9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:00.241497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5648f-464a-400b-93d0-4044c45fd9e3 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:00.241719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5648f-464a-400b-93d0-4044c45fd9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:00.242043 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5648f-464a-400b-93d0-4044c45fd9e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:00.243503 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5648f-464a-400b-93d0-4044c45fd9e3 None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=bae43204e3984619b4fdb64f36ef47ea) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:00.243816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5648f-464a-400b-93d0-4044c45fd9e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:00.245252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5648f-464a-400b-93d0-4044c45fd9e3 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:00.252382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 350/697] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:21:59 2022] GET /identity/v3/role_assignments?user.id=bae43204e3984619b4fdb64f36ef47ea&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:00.349961 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bca7e-8501-4e30-891b-d4afb747643e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:00.352911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:00.395716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2552f-b6b5-4a0f-b437-1707a61ccedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:00.396350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2552f-b6b5-4a0f-b437-1707a61ccedf None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:00.396622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2552f-b6b5-4a0f-b437-1707a61ccedf None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:00.396893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2552f-b6b5-4a0f-b437-1707a61ccedf None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:00.397627 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2552f-b6b5-4a0f-b437-1707a61ccedf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:00.397934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2552f-b6b5-4a0f-b437-1707a61ccedf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:00.399403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2552f-b6b5-4a0f-b437-1707a61ccedf None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:00.428959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 348/698] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 05:22:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:00.435073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5648f-464a-400b-93d0-4044c45fd9e3 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:00.474640 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d387f84-59d9-4e0c-aad1-34b0b8dea82b None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:00.474948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d387f84-59d9-4e0c-aad1-34b0b8dea82b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:00.475192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d387f84-59d9-4e0c-aad1-34b0b8dea82b None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:00.476767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 349/699] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:00.481846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6072038-f3ac-4365-b199-90fa4cd4481f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:00.482125 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6072038-f3ac-4365-b199-90fa4cd4481f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:00.482394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6072038-f3ac-4365-b199-90fa4cd4481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:00.503095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-a6072038-f3ac-4365-b199-90fa4cd4481f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:00.504323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a6072038-f3ac-4365-b199-90fa4cd4481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:00.606844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5648f-464a-400b-93d0-4044c45fd9e3 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:00.626067 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 350/700] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:22:00.653478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44dc5-7f3f-41f9-b984-464ec5c43b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:00.654130 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44dc5-7f3f-41f9-b984-464ec5c43b01 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:00.654415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44dc5-7f3f-41f9-b984-464ec5c43b01 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:00.654711 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44dc5-7f3f-41f9-b984-464ec5c43b01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:00.659754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:00.728292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44dc5-7f3f-41f9-b984-464ec5c43b01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:00.729745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44dc5-7f3f-41f9-b984-464ec5c43b01 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:00.848794 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 351/701] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:22:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:22:00.854262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6072038-f3ac-4365-b199-90fa4cd4481f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:00.916960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e05a-713d-4c71-a5a7-2358687dea95 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:00.917285 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e05a-713d-4c71-a5a7-2358687dea95 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:00.917521 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e05a-713d-4c71-a5a7-2358687dea95 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:00.919202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 352/702] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:00.925208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005232f-8a00-4d59-b9b0-a9c862acd794 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:00.925495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005232f-8a00-4d59-b9b0-a9c862acd794 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:00.925768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005232f-8a00-4d59-b9b0-a9c862acd794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:00.947161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8005232f-8a00-4d59-b9b0-a9c862acd794 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:00.948374 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8005232f-8a00-4d59-b9b0-a9c862acd794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:00.960494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:00.971753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6072038-f3ac-4365-b199-90fa4cd4481f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:00.986644 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:01.013141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d9de9-3605-4db1-a009-a7571e3d54ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:01.013691 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d9de9-3605-4db1-a009-a7571e3d54ba None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:01.013972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d9de9-3605-4db1-a009-a7571e3d54ba None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:01.014303 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d9de9-3605-4db1-a009-a7571e3d54ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:01.025875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d9de9-3605-4db1-a009-a7571e3d54ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:01.028521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d9de9-3605-4db1-a009-a7571e3d54ba None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:01.033613 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 353/703] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:22:01.034753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005232f-8a00-4d59-b9b0-a9c862acd794 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-320d9de9-3605-4db1-a009-a7571e3d54ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:01.049434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:01.050539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:01.051525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:01.051525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:01.051525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:01.051525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 351/704] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:01.059403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d9de9-3605-4db1-a009-a7571e3d54ba None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:01.222386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005232f-8a00-4d59-b9b0-a9c862acd794 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:01.262090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d9de9-3605-4db1-a009-a7571e3d54ba None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:01.298033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64610cb7-b28c-41d5-aea8-e4dde537597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:01.298737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64610cb7-b28c-41d5-aea8-e4dde537597c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:01.298969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64610cb7-b28c-41d5-aea8-e4dde537597c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:01.299235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64610cb7-b28c-41d5-aea8-e4dde537597c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:01.305966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a78e93-a253-432a-ba68-57c06fa89c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:01.306932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a78e93-a253-432a-ba68-57c06fa89c01 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:01.307408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a78e93-a253-432a-ba68-57c06fa89c01 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:01.307874 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a78e93-a253-432a-ba68-57c06fa89c01 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:01.308702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a78e93-a253-432a-ba68-57c06fa89c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:01.309199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a78e93-a253-432a-ba68-57c06fa89c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:01.310921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a78e93-a253-432a-ba68-57c06fa89c01 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:01.319672 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64610cb7-b28c-41d5-aea8-e4dde537597c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:01.321248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64610cb7-b28c-41d5-aea8-e4dde537597c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:01.324769 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 352/705] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:01.331519 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a78e93-a253-432a-ba68-57c06fa89c01 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:01.338103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-64610cb7-b28c-41d5-aea8-e4dde537597c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:01.350481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:01.351553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:01.352448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:01.352448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:01.352448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:01.354407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 354/706] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:01.355604 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64610cb7-b28c-41d5-aea8-e4dde537597c None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:01.418881 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:01.441967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a78e93-a253-432a-ba68-57c06fa89c01 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:01.480224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36fd41-b129-4cc4-92c9-2e8a1152a2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:01.480895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36fd41-b129-4cc4-92c9-2e8a1152a2d2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:01.481120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36fd41-b129-4cc4-92c9-2e8a1152a2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:01.481382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36fd41-b129-4cc4-92c9-2e8a1152a2d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:01.486427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64610cb7-b28c-41d5-aea8-e4dde537597c None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:01.490746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36fd41-b129-4cc4-92c9-2e8a1152a2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:01.492210 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36fd41-b129-4cc4-92c9-2e8a1152a2d2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-ab36fd41-b129-4cc4-92c9-2e8a1152a2d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:01.507650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:01.508604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:01.509494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:01.509494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:01.509494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:01.509494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:01.509494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:01.509494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:01.509494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:01.509494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:01.514314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 353/707] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:01.515419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36fd41-b129-4cc4-92c9-2e8a1152a2d2 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:01.533201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e276a-094f-4fbf-99c0-32c96a0e004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:01.534301 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e276a-094f-4fbf-99c0-32c96a0e004c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:01.534798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e276a-094f-4fbf-99c0-32c96a0e004c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:01.535534 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e276a-094f-4fbf-99c0-32c96a0e004c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:01.536885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e276a-094f-4fbf-99c0-32c96a0e004c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:01.539046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e276a-094f-4fbf-99c0-32c96a0e004c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-882e276a-094f-4fbf-99c0-32c96a0e004c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:01.556179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:01.557280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 05:22:01.558108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:01.560228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 355/708] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Sep 16 05:22:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:01.566271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e276a-094f-4fbf-99c0-32c96a0e004c None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:01.596936 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:01.637623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36fd41-b129-4cc4-92c9-2e8a1152a2d2 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:01.673209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3896c3-fee0-4890-9311-d6a8c002167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:01.673810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3896c3-fee0-4890-9311-d6a8c002167d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:01.674085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3896c3-fee0-4890-9311-d6a8c002167d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:01.674356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3896c3-fee0-4890-9311-d6a8c002167d None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:01.675036 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3896c3-fee0-4890-9311-d6a8c002167d None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:01.675336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3896c3-fee0-4890-9311-d6a8c002167d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:01.676781 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3896c3-fee0-4890-9311-d6a8c002167d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:01.684828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:01.690924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 354/709] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:01.691823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3896c3-fee0-4890-9311-d6a8c002167d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:01.710556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e276a-094f-4fbf-99c0-32c96a0e004c None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:01.760437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a1612-e763-4b36-97e3-20bd6d039a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:01.762040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a1612-e763-4b36-97e3-20bd6d039a92 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:01.762691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a1612-e763-4b36-97e3-20bd6d039a92 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:01.763168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a1612-e763-4b36-97e3-20bd6d039a92 None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:01.764831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a1612-e763-4b36-97e3-20bd6d039a92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:01.765644 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a1612-e763-4b36-97e3-20bd6d039a92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:01.768007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a1612-e763-4b36-97e3-20bd6d039a92 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:01.785200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 356/710] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:01.786436 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a1612-e763-4b36-97e3-20bd6d039a92 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:01.815010 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3896c3-fee0-4890-9311-d6a8c002167d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:01.843211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:01.855943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780342f-1202-4fc2-a9bc-7ca5f83caeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:01.856552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780342f-1202-4fc2-a9bc-7ca5f83caeb2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:01.856831 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780342f-1202-4fc2-a9bc-7ca5f83caeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:01.857146 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780342f-1202-4fc2-a9bc-7ca5f83caeb2 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:01.857778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780342f-1202-4fc2-a9bc-7ca5f83caeb2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:01.858075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780342f-1202-4fc2-a9bc-7ca5f83caeb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:01.859734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780342f-1202-4fc2-a9bc-7ca5f83caeb2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:01.868772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 355/711] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 16 05:22:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:01.868772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780342f-1202-4fc2-a9bc-7ca5f83caeb2 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:01.923818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a1612-e763-4b36-97e3-20bd6d039a92 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:01.960986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05a156-3897-4112-bb70-5302afb78794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:01.962072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05a156-3897-4112-bb70-5302afb78794 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:01.962946 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05a156-3897-4112-bb70-5302afb78794 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:01.963419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05a156-3897-4112-bb70-5302afb78794 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:01.964268 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05a156-3897-4112-bb70-5302afb78794 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:01.966455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05a156-3897-4112-bb70-5302afb78794 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:01.977044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780342f-1202-4fc2-a9bc-7ca5f83caeb2 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:01.984924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:01.992800 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 357/712] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:22:01 2022] POST /identity/v3/users => generated 254 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:22:01.993948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05a156-3897-4112-bb70-5302afb78794 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:02.013309 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765ddd3-0c2f-4d93-ac2c-c214bfd7405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:02.013851 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ddd3-0c2f-4d93-ac2c-c214bfd7405d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:02.014180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ddd3-0c2f-4d93-ac2c-c214bfd7405d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:02.014481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ddd3-0c2f-4d93-ac2c-c214bfd7405d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:02.015357 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765ddd3-0c2f-4d93-ac2c-c214bfd7405d None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=515e548efd984b87bca742e26eec162a) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:02.015674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765ddd3-0c2f-4d93-ac2c-c214bfd7405d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:02.017778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765ddd3-0c2f-4d93-ac2c-c214bfd7405d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:02.028319 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 356/713] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:22:01 2022] GET /identity/v3/role_assignments?user.id=515e548efd984b87bca742e26eec162a&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:02.029298 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc837df6-2a6e-4eb3-9f7f-868b96683775 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:02.029643 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc837df6-2a6e-4eb3-9f7f-868b96683775 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:02.029871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc837df6-2a6e-4eb3-9f7f-868b96683775 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:02.035655 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 357/714] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:02.037184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174378b-f2ed-406f-b460-4bd2c0462d3c None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:02.037468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174378b-f2ed-406f-b460-4bd2c0462d3c None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:02.037740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174378b-f2ed-406f-b460-4bd2c0462d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:02.057616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-d174378b-f2ed-406f-b460-4bd2c0462d3c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:02.058898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d174378b-f2ed-406f-b460-4bd2c0462d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:02.120388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:02.148899 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 358/715] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:22:02.154067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05a156-3897-4112-bb70-5302afb78794 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:02.192738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306023f5-2c08-436b-8da4-3d5835ca555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:02.193604 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306023f5-2c08-436b-8da4-3d5835ca555b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:02.194054 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306023f5-2c08-436b-8da4-3d5835ca555b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:02.194472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306023f5-2c08-436b-8da4-3d5835ca555b None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:02.195295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306023f5-2c08-436b-8da4-3d5835ca555b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:02.195746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306023f5-2c08-436b-8da4-3d5835ca555b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:02.197295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306023f5-2c08-436b-8da4-3d5835ca555b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:02.204294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 358/716] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 16 05:22:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:02.474990 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174378b-f2ed-406f-b460-4bd2c0462d3c None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:02.587686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174378b-f2ed-406f-b460-4bd2c0462d3c None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:02.626072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a7071-10f6-4124-89f8-49455af7f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:02.626744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a7071-10f6-4124-89f8-49455af7f34a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:02.627023 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a7071-10f6-4124-89f8-49455af7f34a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:02.627293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a7071-10f6-4124-89f8-49455af7f34a None admin] PATH_INFO: `/v3/services/network` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:02.627879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a7071-10f6-4124-89f8-49455af7f34a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:02.629325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a7071-10f6-4124-89f8-49455af7f34a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-db7a7071-10f6-4124-89f8-49455af7f34a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:02.640684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:02.642407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:02.643449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 359/717] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:02 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:02.648422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306023f5-2c08-436b-8da4-3d5835ca555b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:02.722355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:02.769095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306023f5-2c08-436b-8da4-3d5835ca555b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:02.805066 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43feb8ce-bc21-403a-810a-18cf27714fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:02.805671 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feb8ce-bc21-403a-810a-18cf27714fd1 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:02.805949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feb8ce-bc21-403a-810a-18cf27714fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:02.806220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feb8ce-bc21-403a-810a-18cf27714fd1 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:02.806876 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43feb8ce-bc21-403a-810a-18cf27714fd1 None admin] RBAC: Adding query filter params (name=network) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:02.807175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43feb8ce-bc21-403a-810a-18cf27714fd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:02.808533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43feb8ce-bc21-403a-810a-18cf27714fd1 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:02.814429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 359/718] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 05:22:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:02.819628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a7071-10f6-4124-89f8-49455af7f34a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:02.899039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:02.965829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a7071-10f6-4124-89f8-49455af7f34a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:03.004382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0555a5-99d9-4613-a5d3-377850a08129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:03.005005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0555a5-99d9-4613-a5d3-377850a08129 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:03.005290 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0555a5-99d9-4613-a5d3-377850a08129 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:03.005566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0555a5-99d9-4613-a5d3-377850a08129 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:03.006219 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0555a5-99d9-4613-a5d3-377850a08129 None admin] RBAC: Adding query filter params (type=network) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:03.006548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0555a5-99d9-4613-a5d3-377850a08129 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:03.008060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0555a5-99d9-4613-a5d3-377850a08129 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:03.014876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 360/719] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 05:22:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:03.161645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d5620-2813-4ec6-a61c-450f2e2c1cdb None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:03.162000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d5620-2813-4ec6-a61c-450f2e2c1cdb None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:03.162198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d5620-2813-4ec6-a61c-450f2e2c1cdb None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:03.163951 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 360/720] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:03.169297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b98dc-156d-4ceb-b4e6-269a27c745db None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:03.169589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b98dc-156d-4ceb-b4e6-269a27c745db None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:03.169855 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b98dc-156d-4ceb-b4e6-269a27c745db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:03.195714 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-eb6b98dc-156d-4ceb-b4e6-269a27c745db None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:03.196954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-eb6b98dc-156d-4ceb-b4e6-269a27c745db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:03.279157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 361/721] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:22:03.619388 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d5620-2813-4ec6-a61c-450f2e2c1cdb None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:03.746784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d5620-2813-4ec6-a61c-450f2e2c1cdb None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:03.773579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:03.783258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa657d-6fdf-4e50-b23b-626c34e97614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:03.783935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa657d-6fdf-4e50-b23b-626c34e97614 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:03.784206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa657d-6fdf-4e50-b23b-626c34e97614 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:03.784471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa657d-6fdf-4e50-b23b-626c34e97614 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:03.795406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa657d-6fdf-4e50-b23b-626c34e97614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-84fa657d-6fdf-4e50-b23b-626c34e97614 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:03.800308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:03.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:03.802168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:03.802168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:03.802168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:03.802168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:03.802168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:03.802168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:03.802168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:03.802168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:03.802168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:03.802168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:03.802168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:03.802168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:03.802168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 361/722] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:22:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:03.807698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b98dc-156d-4ceb-b4e6-269a27c745db None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:03.860787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:03.931323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b98dc-156d-4ceb-b4e6-269a27c745db None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:03.976531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c331a-a544-427b-99a4-47aa34666107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:03.977133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c331a-a544-427b-99a4-47aa34666107 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:03.977411 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c331a-a544-427b-99a4-47aa34666107 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:03.977677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c331a-a544-427b-99a4-47aa34666107 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:03.978325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c331a-a544-427b-99a4-47aa34666107 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:03.978652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c331a-a544-427b-99a4-47aa34666107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:03.980084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c331a-a544-427b-99a4-47aa34666107 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:03.988387 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 362/723] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:22:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:03.994143 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa657d-6fdf-4e50-b23b-626c34e97614 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:04.097424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa657d-6fdf-4e50-b23b-626c34e97614 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:04.132964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786b6b9-611c-4ba1-b922-4354963e1da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:04.133595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786b6b9-611c-4ba1-b922-4354963e1da2 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:04.133867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786b6b9-611c-4ba1-b922-4354963e1da2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:04.134138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786b6b9-611c-4ba1-b922-4354963e1da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:04.145953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786b6b9-611c-4ba1-b922-4354963e1da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:04.147434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786b6b9-611c-4ba1-b922-4354963e1da2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-3786b6b9-611c-4ba1-b922-4354963e1da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:04.164315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:04.165642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:04.167406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:04.167406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:04.167406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:04.167406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 362/724] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:04.171475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c331a-a544-427b-99a4-47aa34666107 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:04.286428 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c331a-a544-427b-99a4-47aa34666107 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:04.288162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:04.355891 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad24cb-8854-4ca0-8426-f699e5e7afdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:04.356576 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad24cb-8854-4ca0-8426-f699e5e7afdb None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:04.356853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad24cb-8854-4ca0-8426-f699e5e7afdb None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:04.357133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad24cb-8854-4ca0-8426-f699e5e7afdb None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:04.357761 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad24cb-8854-4ca0-8426-f699e5e7afdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:04.358055 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad24cb-8854-4ca0-8426-f699e5e7afdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:04.359992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad24cb-8854-4ca0-8426-f699e5e7afdb None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:04.407995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 363/725] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:04.417712 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786b6b9-611c-4ba1-b922-4354963e1da2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:04.524137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:04.614660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786b6b9-611c-4ba1-b922-4354963e1da2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:04.686392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a0f23-0b4d-4ad0-ad44-be356d8756e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:04.687061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a0f23-0b4d-4ad0-ad44-be356d8756e1 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:04.688212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a0f23-0b4d-4ad0-ad44-be356d8756e1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:04.688490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a0f23-0b4d-4ad0-ad44-be356d8756e1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:04.707635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a0f23-0b4d-4ad0-ad44-be356d8756e1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:04.709088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a0f23-0b4d-4ad0-ad44-be356d8756e1 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-367a0f23-0b4d-4ad0-ad44-be356d8756e1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:04.732375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:04.733517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:04.734560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:04.734560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:04.734560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:04.734560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:04.734560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:04.734560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:04.734560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:04.734560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:04.734560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 05:22:04.734560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:04.734560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 363/726] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:22:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:04.739671 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad24cb-8854-4ca0-8426-f699e5e7afdb None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:04.946734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad24cb-8854-4ca0-8426-f699e5e7afdb None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:05.005538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ca2ef-b5b9-4ded-8e03-aed301ebd41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:05.006147 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ca2ef-b5b9-4ded-8e03-aed301ebd41f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:05.006426 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ca2ef-b5b9-4ded-8e03-aed301ebd41f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:05.006718 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ca2ef-b5b9-4ded-8e03-aed301ebd41f None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:05.007612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ca2ef-b5b9-4ded-8e03-aed301ebd41f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:05.008086 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ca2ef-b5b9-4ded-8e03-aed301ebd41f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:05.009664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ca2ef-b5b9-4ded-8e03-aed301ebd41f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:05.026124 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4f845-ad1e-416b-9823-18d7a0b35b5b None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:05.027006 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4f845-ad1e-416b-9823-18d7a0b35b5b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:05.027422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4f845-ad1e-416b-9823-18d7a0b35b5b None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:05.028905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 364/727] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:22:05.034056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fbf78-93f8-41ff-9d6e-ebab096747a5 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:05.034519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fbf78-93f8-41ff-9d6e-ebab096747a5 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:05.034933 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fbf78-93f8-41ff-9d6e-ebab096747a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:05.047113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 364/728] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 16 05:22:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:05.048737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ca2ef-b5b9-4ded-8e03-aed301ebd41f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:05.069292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-ac5fbf78-93f8-41ff-9d6e-ebab096747a5 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:05.070762 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ac5fbf78-93f8-41ff-9d6e-ebab096747a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:05.095252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:05.196682 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 365/729] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:22:05.198467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b689bf-6e80-43a8-9ef6-bbaf62dbcbe3 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:05.200250 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b689bf-6e80-43a8-9ef6-bbaf62dbcbe3 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:05.200930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b689bf-6e80-43a8-9ef6-bbaf62dbcbe3 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:05.203965 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 366/730] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:05.208357 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ca2ef-b5b9-4ded-8e03-aed301ebd41f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:05.209979 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb670b-7819-4f45-ac59-6295764e0510 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:05.212188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb670b-7819-4f45-ac59-6295764e0510 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:05.212638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb670b-7819-4f45-ac59-6295764e0510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:05.261791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-21cb670b-7819-4f45-ac59-6295764e0510 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:05.265432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-21cb670b-7819-4f45-ac59-6295764e0510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:05.320351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2fa88-a159-43e3-9d4c-ad756274f31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:05.321241 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2fa88-a159-43e3-9d4c-ad756274f31c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:05.321684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2fa88-a159-43e3-9d4c-ad756274f31c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:05.322136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2fa88-a159-43e3-9d4c-ad756274f31c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:05.339015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:05.400413 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 367/731] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:22:05.402117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe1ec4-7b0f-4174-9373-982b12cf4656 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:05.402628 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe1ec4-7b0f-4174-9373-982b12cf4656 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:05.403095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe1ec4-7b0f-4174-9373-982b12cf4656 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:05.409489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 368/732] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:05.411176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2025f-d676-4682-bc50-0c3162047e3c None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:05.411681 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2025f-d676-4682-bc50-0c3162047e3c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:05.412152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2025f-d676-4682-bc50-0c3162047e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:05.429729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2fa88-a159-43e3-9d4c-ad756274f31c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:05.431239 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2fa88-a159-43e3-9d4c-ad756274f31c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:05.432056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-0cf2025f-d676-4682-bc50-0c3162047e3c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:05.433581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0cf2025f-d676-4682-bc50-0c3162047e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:05.471034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:05.508184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 369/733] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 05:22:05.514529 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2025f-d676-4682-bc50-0c3162047e3c None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:05.560227 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 365/734] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:22:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 05:22:05.567526 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2fa88-a159-43e3-9d4c-ad756274f31c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:05.621772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:05.634846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2025f-d676-4682-bc50-0c3162047e3c None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:05.673991 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf5ca1-6777-416e-91d8-899c99bed02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:05.674999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf5ca1-6777-416e-91d8-899c99bed02f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:05.675476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf5ca1-6777-416e-91d8-899c99bed02f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:05.675971 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf5ca1-6777-416e-91d8-899c99bed02f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:05.688463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf5ca1-6777-416e-91d8-899c99bed02f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-a0bf5ca1-6777-416e-91d8-899c99bed02f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:05.693670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:05.694627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:05.695457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:05.695457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:05.695457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:05.695457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:05.695457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:05.695457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:05.695457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:05.695457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:05.695457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:05.695457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:05.695457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:05.695457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:05.697975 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 370/735] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:22:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:05.704449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf5ca1-6777-416e-91d8-899c99bed02f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:05.748688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2fa88-a159-43e3-9d4c-ad756274f31c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:05.771841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:05.787961 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2b40f-81a6-49cb-a118-23bbb4d357a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:05.788453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2b40f-81a6-49cb-a118-23bbb4d357a7 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:05.788730 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2b40f-81a6-49cb-a118-23bbb4d357a7 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:05.788997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2b40f-81a6-49cb-a118-23bbb4d357a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:05.801981 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2b40f-81a6-49cb-a118-23bbb4d357a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:05.803560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2b40f-81a6-49cb-a118-23bbb4d357a7 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-a3b2b40f-81a6-49cb-a118-23bbb4d357a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:05.820251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:05.821280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:05.822887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:05.822887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:05.822887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:05.822887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 366/736] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:05.822887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2b40f-81a6-49cb-a118-23bbb4d357a7 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:05.860472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf5ca1-6777-416e-91d8-899c99bed02f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:05.907198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a778409-b1b8-45a3-aefb-886294c8d522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:05.907825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a778409-b1b8-45a3-aefb-886294c8d522 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:05.908151 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a778409-b1b8-45a3-aefb-886294c8d522 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:05.908428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a778409-b1b8-45a3-aefb-886294c8d522 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:05.909097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a778409-b1b8-45a3-aefb-886294c8d522 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:05.909399 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a778409-b1b8-45a3-aefb-886294c8d522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:05.910787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a778409-b1b8-45a3-aefb-886294c8d522 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:05.919518 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 371/737] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:22:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:05.920312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a778409-b1b8-45a3-aefb-886294c8d522 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:05.927341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2b40f-81a6-49cb-a118-23bbb4d357a7 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:05.933192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:05.960575 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaff1e5-c85a-4756-9bf0-873910595183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:05.961179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaff1e5-c85a-4756-9bf0-873910595183 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:05.961441 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaff1e5-c85a-4756-9bf0-873910595183 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:05.961707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaff1e5-c85a-4756-9bf0-873910595183 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:05.962350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaff1e5-c85a-4756-9bf0-873910595183 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:05.963745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaff1e5-c85a-4756-9bf0-873910595183 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:05.978782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 367/738] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:22:05 2022] POST /identity/v3/services => generated 251 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:22:05.979994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaff1e5-c85a-4756-9bf0-873910595183 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:06.018081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:06.033974 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a778409-b1b8-45a3-aefb-886294c8d522 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:06.093899 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c914ad-1b81-4f6c-b5a8-67043be7e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:06.094539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c914ad-1b81-4f6c-b5a8-67043be7e18e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:06.094817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c914ad-1b81-4f6c-b5a8-67043be7e18e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:06.095196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c914ad-1b81-4f6c-b5a8-67043be7e18e None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:06.095846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c914ad-1b81-4f6c-b5a8-67043be7e18e None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:06.096139 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c914ad-1b81-4f6c-b5a8-67043be7e18e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:06.097525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c914ad-1b81-4f6c-b5a8-67043be7e18e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:06.099373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaff1e5-c85a-4756-9bf0-873910595183 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:06.115860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 372/739] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:06.115860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60371e43-7155-4563-b296-832ec379f97a None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:06.115860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60371e43-7155-4563-b296-832ec379f97a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:06.115860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60371e43-7155-4563-b296-832ec379f97a None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:06.115860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 373/740] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:06.115860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60371e43-7155-4563-b296-832ec379f97a None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:06.142521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99babc2b-0c40-4f5f-94b4-cc298dce8593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:06.143182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99babc2b-0c40-4f5f-94b4-cc298dce8593 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:06.143462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99babc2b-0c40-4f5f-94b4-cc298dce8593 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:06.143733 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99babc2b-0c40-4f5f-94b4-cc298dce8593 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:06.157052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99babc2b-0c40-4f5f-94b4-cc298dce8593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-99babc2b-0c40-4f5f-94b4-cc298dce8593 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:06.162363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:06.163341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 368/741] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:22:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:06.164559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99babc2b-0c40-4f5f-94b4-cc298dce8593 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:06.200111 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:06.238993 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60371e43-7155-4563-b296-832ec379f97a None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:06.274482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d42016-351a-4987-9c75-e60f8685f2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:06.274883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:06.275229 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d42016-351a-4987-9c75-e60f8685f2af None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:06.275815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d42016-351a-4987-9c75-e60f8685f2af None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:06.275815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d42016-351a-4987-9c75-e60f8685f2af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:06.285182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99babc2b-0c40-4f5f-94b4-cc298dce8593 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:06.287742 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d42016-351a-4987-9c75-e60f8685f2af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:06.289247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d42016-351a-4987-9c75-e60f8685f2af None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-56d42016-351a-4987-9c75-e60f8685f2af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:06.304387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:06.305342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:06.310817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:06.310817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:06.310817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:06.310817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 374/742] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:06.310817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934a739-fd7b-44f5-8fd9-7da55fe0ee17 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:06.310817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934a739-fd7b-44f5-8fd9-7da55fe0ee17 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:06.310817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934a739-fd7b-44f5-8fd9-7da55fe0ee17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:06.326463 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ee0c0-0371-4ea8-9b04-cfc5edcde4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:06.327176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f934a739-fd7b-44f5-8fd9-7da55fe0ee17 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:06.327283 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ee0c0-0371-4ea8-9b04-cfc5edcde4a6 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:06.327525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ee0c0-0371-4ea8-9b04-cfc5edcde4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:06.327870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ee0c0-0371-4ea8-9b04-cfc5edcde4a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:06.328471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f934a739-fd7b-44f5-8fd9-7da55fe0ee17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:06.334874 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ee0c0-0371-4ea8-9b04-cfc5edcde4a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:06.336385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ee0c0-0371-4ea8-9b04-cfc5edcde4a6 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-4e2ee0c0-0371-4ea8-9b04-cfc5edcde4a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:06.348744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:06.349712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:06.350623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:06.350623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:06.350623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:06.350623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:06.350623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:06.350623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:06.350623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:06.350623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:06.350623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 369/743] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:06.350623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ee0c0-0371-4ea8-9b04-cfc5edcde4a6 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:06.410836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 375/744] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 05:22:06.412728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934a739-fd7b-44f5-8fd9-7da55fe0ee17 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:06.458272 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ee0c0-0371-4ea8-9b04-cfc5edcde4a6 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:06.474219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:06.506815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22385a96-dd9b-4290-bdd0-3f410f7388ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:06.508002 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22385a96-dd9b-4290-bdd0-3f410f7388ca None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:06.508505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22385a96-dd9b-4290-bdd0-3f410f7388ca None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:06.509189 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22385a96-dd9b-4290-bdd0-3f410f7388ca None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:06.510529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22385a96-dd9b-4290-bdd0-3f410f7388ca None admin] RBAC: Adding query filter params (name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:06.511369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22385a96-dd9b-4290-bdd0-3f410f7388ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:06.513573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22385a96-dd9b-4290-bdd0-3f410f7388ca None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:06.529551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 370/745] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:22:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:06.529551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22385a96-dd9b-4290-bdd0-3f410f7388ca None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:06.537207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934a739-fd7b-44f5-8fd9-7da55fe0ee17 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:06.547611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:06.586270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff23d-842b-4d99-91a3-2afc9f5cd3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:06.587180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff23d-842b-4d99-91a3-2afc9f5cd3c7 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:06.587618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff23d-842b-4d99-91a3-2afc9f5cd3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:06.588027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff23d-842b-4d99-91a3-2afc9f5cd3c7 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:06.589342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ff23d-842b-4d99-91a3-2afc9f5cd3c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:06.589793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ff23d-842b-4d99-91a3-2afc9f5cd3c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:06.591852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ff23d-842b-4d99-91a3-2afc9f5cd3c7 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:06.612613 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 376/746] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:06.612613 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff23d-842b-4d99-91a3-2afc9f5cd3c7 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:06.645518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22385a96-dd9b-4290-bdd0-3f410f7388ca None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:06.680364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c667067-95de-4e2e-8044-ff1fb6b4273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:06.681151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c667067-95de-4e2e-8044-ff1fb6b4273f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:06.681613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c667067-95de-4e2e-8044-ff1fb6b4273f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:06.681991 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c667067-95de-4e2e-8044-ff1fb6b4273f None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:06.682815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c667067-95de-4e2e-8044-ff1fb6b4273f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:06.683251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c667067-95de-4e2e-8044-ff1fb6b4273f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:06.684818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c667067-95de-4e2e-8044-ff1fb6b4273f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:06.702063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 371/747] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:06.702063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c667067-95de-4e2e-8044-ff1fb6b4273f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:06.741983 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff23d-842b-4d99-91a3-2afc9f5cd3c7 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:06.752024 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:06.778598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:06.779003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468c228-30ee-498b-a436-bae0c1f91c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:06.779739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468c228-30ee-498b-a436-bae0c1f91c13 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:06.780038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468c228-30ee-498b-a436-bae0c1f91c13 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:06.780488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468c228-30ee-498b-a436-bae0c1f91c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:06.793207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468c228-30ee-498b-a436-bae0c1f91c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:06.794533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468c228-30ee-498b-a436-bae0c1f91c13 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:06.806317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c667067-95de-4e2e-8044-ff1fb6b4273f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-9468c228-30ee-498b-a436-bae0c1f91c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:06.809257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:06.810265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:06.811189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:06.811189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:06.811189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:06.811189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 377/748] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:06.811189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468c228-30ee-498b-a436-bae0c1f91c13 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:06.848967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31211c69-c433-4312-92c7-cc91f3e526fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:06.849684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31211c69-c433-4312-92c7-cc91f3e526fd None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:06.850031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31211c69-c433-4312-92c7-cc91f3e526fd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:06.850374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31211c69-c433-4312-92c7-cc91f3e526fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:06.857845 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31211c69-c433-4312-92c7-cc91f3e526fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:06.859474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31211c69-c433-4312-92c7-cc91f3e526fd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-31211c69-c433-4312-92c7-cc91f3e526fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:06.872182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:06.873213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:06.874148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:06.874148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:06.874148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:06.874148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:06.874148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:06.874148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:06.874148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:06.874148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:06.874148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:22:06.874148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:06.874148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 372/749] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 05:22:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:06.874148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31211c69-c433-4312-92c7-cc91f3e526fd None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:06.925155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468c228-30ee-498b-a436-bae0c1f91c13 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:06.961300 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f202c-110d-4787-bfb7-25b6b9b1b2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:06.962000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f202c-110d-4787-bfb7-25b6b9b1b2f2 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:06.962342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f202c-110d-4787-bfb7-25b6b9b1b2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:06.962724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f202c-110d-4787-bfb7-25b6b9b1b2f2 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:06.963354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f202c-110d-4787-bfb7-25b6b9b1b2f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:06.964710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f202c-110d-4787-bfb7-25b6b9b1b2f2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:06.977260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31211c69-c433-4312-92c7-cc91f3e526fd None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:06.982128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 378/750] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:22:06 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:22:06.983136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f202c-110d-4787-bfb7-25b6b9b1b2f2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:07.016820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:07.029352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:07.036271 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804248e8-36b4-4168-8d27-a2c34b30e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:07.036805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804248e8-36b4-4168-8d27-a2c34b30e9ca None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:07.037085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804248e8-36b4-4168-8d27-a2c34b30e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:07.037405 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804248e8-36b4-4168-8d27-a2c34b30e9ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:07.038151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804248e8-36b4-4168-8d27-a2c34b30e9ca None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=bae43204e3984619b4fdb64f36ef47ea) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:07.038462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804248e8-36b4-4168-8d27-a2c34b30e9ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:07.040877 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804248e8-36b4-4168-8d27-a2c34b30e9ca None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:07.055152 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 373/751] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:22:06 2022] GET /identity/v3/role_assignments?user.id=bae43204e3984619b4fdb64f36ef47ea&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:07.056274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804248e8-36b4-4168-8d27-a2c34b30e9ca None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:07.127330 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f202c-110d-4787-bfb7-25b6b9b1b2f2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:07.179197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca75b3a-a0e4-421b-b920-6d830e14965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:07.179197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca75b3a-a0e4-421b-b920-6d830e14965e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:07.179197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca75b3a-a0e4-421b-b920-6d830e14965e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:07.179197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca75b3a-a0e4-421b-b920-6d830e14965e None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:07.179658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca75b3a-a0e4-421b-b920-6d830e14965e None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:07.179658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca75b3a-a0e4-421b-b920-6d830e14965e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:07.179658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca75b3a-a0e4-421b-b920-6d830e14965e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:07.202998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 379/752] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:07.204984 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca75b3a-a0e4-421b-b920-6d830e14965e None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:07.242638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804248e8-36b4-4168-8d27-a2c34b30e9ca None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:07.290920 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7237b-725f-428e-a66f-5848347de908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:07.291460 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7237b-725f-428e-a66f-5848347de908 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:07.291735 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7237b-725f-428e-a66f-5848347de908 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:07.292004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7237b-725f-428e-a66f-5848347de908 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:07.292753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7237b-725f-428e-a66f-5848347de908 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:07.293030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7237b-725f-428e-a66f-5848347de908 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:07.294467 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7237b-725f-428e-a66f-5848347de908 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:07.319263 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 374/753] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 05:22:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:07.320264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:07.325511 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7237b-725f-428e-a66f-5848347de908 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:07.354950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca75b3a-a0e4-421b-b920-6d830e14965e None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:07.420189 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:07.431219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbcc50-cbb1-4549-bdd8-0933614379f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:07.431872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbcc50-cbb1-4549-bdd8-0933614379f3 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:07.432157 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbcc50-cbb1-4549-bdd8-0933614379f3 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:07.432430 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbcc50-cbb1-4549-bdd8-0933614379f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:07.447880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbcc50-cbb1-4549-bdd8-0933614379f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:07.449511 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbcc50-cbb1-4549-bdd8-0933614379f3 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-09cbcc50-cbb1-4549-bdd8-0933614379f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:07.472094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:07.473119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:07.474068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:07.474068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:07.474068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:07.474068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:07.474068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:07.474068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:07.474068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:07.474068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:07.474068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 05:22:07.474068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:07.477760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 380/754] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 05:22:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:07.480050 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7237b-725f-428e-a66f-5848347de908 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:07.483474 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbcc50-cbb1-4549-bdd8-0933614379f3 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:07.521678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bb883-d141-4574-98d4-f8c727482a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:07.522938 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bb883-d141-4574-98d4-f8c727482a0e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:07.523457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bb883-d141-4574-98d4-f8c727482a0e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:07.523924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bb883-d141-4574-98d4-f8c727482a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:07.536664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bb883-d141-4574-98d4-f8c727482a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:07.539141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bb883-d141-4574-98d4-f8c727482a0e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-3d2bb883-d141-4574-98d4-f8c727482a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:07.558634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:07.559815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:07.560865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:07.560865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:07.560865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:07.564585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 375/755] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:07.570775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bb883-d141-4574-98d4-f8c727482a0e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:07.643321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbcc50-cbb1-4549-bdd8-0933614379f3 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:07.680170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57a337-aa77-4b29-b92c-4ced862c0be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:07.681146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57a337-aa77-4b29-b92c-4ced862c0be2 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:07.681587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57a337-aa77-4b29-b92c-4ced862c0be2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:07.682109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57a337-aa77-4b29-b92c-4ced862c0be2 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:07.683062 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57a337-aa77-4b29-b92c-4ced862c0be2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:07.683513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57a337-aa77-4b29-b92c-4ced862c0be2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:07.685424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57a337-aa77-4b29-b92c-4ced862c0be2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:07.705962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:07.706478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 381/756] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 16 05:22:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:07.711751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57a337-aa77-4b29-b92c-4ced862c0be2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:07.775237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bb883-d141-4574-98d4-f8c727482a0e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:07.783287 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:07.843271 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfbb99-a8a4-4363-a673-f28b7aee046f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:07.848404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfbb99-a8a4-4363-a673-f28b7aee046f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:07.848848 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfbb99-a8a4-4363-a673-f28b7aee046f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:07.849272 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfbb99-a8a4-4363-a673-f28b7aee046f None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:07.850069 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfbb99-a8a4-4363-a673-f28b7aee046f None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:07.850558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfbb99-a8a4-4363-a673-f28b7aee046f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:07.852083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfbb99-a8a4-4363-a673-f28b7aee046f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:07.877778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 376/757] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:07.882795 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfbb99-a8a4-4363-a673-f28b7aee046f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:07.902953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57a337-aa77-4b29-b92c-4ced862c0be2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:07.955208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d704d-62a5-4a50-9530-e7cc9da8a91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:07.956105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d704d-62a5-4a50-9530-e7cc9da8a91f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:07.956542 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d704d-62a5-4a50-9530-e7cc9da8a91f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:07.956957 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d704d-62a5-4a50-9530-e7cc9da8a91f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:08.070624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfbb99-a8a4-4363-a673-f28b7aee046f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:08.082969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:08.087856 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d704d-62a5-4a50-9530-e7cc9da8a91f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:08.089377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d704d-62a5-4a50-9530-e7cc9da8a91f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:08.142427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e7552-1282-4cae-88b2-74f44430d08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:08.143000 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e7552-1282-4cae-88b2-74f44430d08a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:08.143280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e7552-1282-4cae-88b2-74f44430d08a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:08.143547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e7552-1282-4cae-88b2-74f44430d08a None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:08.155992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e7552-1282-4cae-88b2-74f44430d08a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:08.161648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e7552-1282-4cae-88b2-74f44430d08a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-7a4e7552-1282-4cae-88b2-74f44430d08a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:08.179312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:08.180419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:08.181471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:08.181471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:08.181471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:08.181471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:08.181471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:08.181471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:08.181471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:08.181471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:08.181903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 377/758] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:08.189474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e7552-1282-4cae-88b2-74f44430d08a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:08.235435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:08.279542 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 382/759] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:22:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:22:08.291484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d704d-62a5-4a50-9530-e7cc9da8a91f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:08.364518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e7552-1282-4cae-88b2-74f44430d08a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:08.433796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b086de-20bc-49cd-8088-1b6eac6f6539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:08.434323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b086de-20bc-49cd-8088-1b6eac6f6539 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:08.434621 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b086de-20bc-49cd-8088-1b6eac6f6539 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:08.434890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b086de-20bc-49cd-8088-1b6eac6f6539 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:08.435580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b086de-20bc-49cd-8088-1b6eac6f6539 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:08.435881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b086de-20bc-49cd-8088-1b6eac6f6539 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:08.438170 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b086de-20bc-49cd-8088-1b6eac6f6539 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:08.461995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 378/760] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:08.467668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db301c6-8f91-425a-aa2c-434a6c10617d None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:08.467948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db301c6-8f91-425a-aa2c-434a6c10617d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:08.468214 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db301c6-8f91-425a-aa2c-434a6c10617d None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:08.470205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 379/761] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:08.475086 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db301c6-8f91-425a-aa2c-434a6c10617d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:08.487857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:08.491993 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d704d-62a5-4a50-9530-e7cc9da8a91f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:08.531767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fb68d-8a8d-4afe-ab52-015cce7cef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:08.532781 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fb68d-8a8d-4afe-ab52-015cce7cef2d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:08.533204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fb68d-8a8d-4afe-ab52-015cce7cef2d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:08.533617 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fb68d-8a8d-4afe-ab52-015cce7cef2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:08.545389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fb68d-8a8d-4afe-ab52-015cce7cef2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:08.548221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fb68d-8a8d-4afe-ab52-015cce7cef2d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-939fb68d-8a8d-4afe-ab52-015cce7cef2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:08.564769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:08.565936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:08.567056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:08.567056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:08.567056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:08.574168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 383/762] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:08.575579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff77ac-b6d2-4c0b-87cc-eb3b43500e6c None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:08.576428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff77ac-b6d2-4c0b-87cc-eb3b43500e6c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:08.576849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff77ac-b6d2-4c0b-87cc-eb3b43500e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:08.599498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:08.600249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-faff77ac-b6d2-4c0b-87cc-eb3b43500e6c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:08.601586 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-faff77ac-b6d2-4c0b-87cc-eb3b43500e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:08.603376 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db301c6-8f91-425a-aa2c-434a6c10617d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:08.642187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8523e-81b7-4685-b9cc-8e7db57e0ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:08.643054 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8523e-81b7-4685-b9cc-8e7db57e0ed4 None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:08.643428 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8523e-81b7-4685-b9cc-8e7db57e0ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:08.643809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8523e-81b7-4685-b9cc-8e7db57e0ed4 None admin] PATH_INFO: `/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/515e548efd984b87bca742e26eec162a/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:08.645873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8523e-81b7-4685-b9cc-8e7db57e0ed4 None admin] RBAC: Authorizing `identity:create_grant(project_id=74c9d19fb1534f8f8888e957d1007640, user_id=515e548efd984b87bca742e26eec162a, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:08.647427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8523e-81b7-4685-b9cc-8e7db57e0ed4 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:08.667583 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 380/763] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:22:08 2022] PUT /identity/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/515e548efd984b87bca742e26eec162a/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:22:08.669061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8523e-81b7-4685-b9cc-8e7db57e0ed4 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:08.688242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 384/764] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:08.820828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8523e-81b7-4685-b9cc-8e7db57e0ed4 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:08.872789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f3d71-6a98-4afb-b54b-d264682e7999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:08.873610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f3d71-6a98-4afb-b54b-d264682e7999 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:08.873980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f3d71-6a98-4afb-b54b-d264682e7999 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:08.874350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f3d71-6a98-4afb-b54b-d264682e7999 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:08.875174 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f3d71-6a98-4afb-b54b-d264682e7999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:08.875578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f3d71-6a98-4afb-b54b-d264682e7999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:08.877079 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f3d71-6a98-4afb-b54b-d264682e7999 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:08.895171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 381/765] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:08.901092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff77ac-b6d2-4c0b-87cc-eb3b43500e6c None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:08.990919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:09.010901 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff77ac-b6d2-4c0b-87cc-eb3b43500e6c None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:09.027966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f3d71-6a98-4afb-b54b-d264682e7999 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:09.033651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:09.083262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8878e82-f17a-4200-aa88-99eae89eab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:09.084086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8878e82-f17a-4200-aa88-99eae89eab4c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:09.084462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8878e82-f17a-4200-aa88-99eae89eab4c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:09.085013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8878e82-f17a-4200-aa88-99eae89eab4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:09.099733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8878e82-f17a-4200-aa88-99eae89eab4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:09.101344 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8878e82-f17a-4200-aa88-99eae89eab4c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-f8878e82-f17a-4200-aa88-99eae89eab4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:09.124364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:09.125903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:09.126865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:09.126865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:09.126865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:09.126865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:09.126865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:09.126865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:09.126865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:09.126865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:09.135305 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 385/766] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:09.154197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8878e82-f17a-4200-aa88-99eae89eab4c None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:09.157365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f3d71-6a98-4afb-b54b-d264682e7999 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:09.207201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a221b0-6150-494b-b483-2ace116e8714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:09.208186 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a221b0-6150-494b-b483-2ace116e8714 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:09.208645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a221b0-6150-494b-b483-2ace116e8714 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:09.209120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a221b0-6150-494b-b483-2ace116e8714 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:09.209879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a221b0-6150-494b-b483-2ace116e8714 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:09.211662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a221b0-6150-494b-b483-2ace116e8714 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-33a221b0-6150-494b-b483-2ace116e8714 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:09.235536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:09.236573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 05:22:09.237422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:09.239956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 382/767] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Sep 16 05:22:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:09.246584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a221b0-6150-494b-b483-2ace116e8714 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:09.279683 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8878e82-f17a-4200-aa88-99eae89eab4c None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:09.320595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c0ed6-41f1-4c72-9a7f-6a1752e540a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:09.321199 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c0ed6-41f1-4c72-9a7f-6a1752e540a2 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:09.321472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c0ed6-41f1-4c72-9a7f-6a1752e540a2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:09.321738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c0ed6-41f1-4c72-9a7f-6a1752e540a2 None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:09.322429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c0ed6-41f1-4c72-9a7f-6a1752e540a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:09.322753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c0ed6-41f1-4c72-9a7f-6a1752e540a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:09.324204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c0ed6-41f1-4c72-9a7f-6a1752e540a2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:09.343375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:09.352048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 386/768] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:09.357449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c0ed6-41f1-4c72-9a7f-6a1752e540a2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:09.376943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:09.441494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a221b0-6150-494b-b483-2ace116e8714 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:09.485406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c0ed6-41f1-4c72-9a7f-6a1752e540a2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:09.513277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8561c8-72d6-4d21-ac0c-0ac898f013fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:09.513801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8561c8-72d6-4d21-ac0c-0ac898f013fb None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:09.514076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8561c8-72d6-4d21-ac0c-0ac898f013fb None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:09.514430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8561c8-72d6-4d21-ac0c-0ac898f013fb None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:09.515085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8561c8-72d6-4d21-ac0c-0ac898f013fb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:09.516019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8561c8-72d6-4d21-ac0c-0ac898f013fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:09.517402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8561c8-72d6-4d21-ac0c-0ac898f013fb None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:09.520697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502611d0-530e-4e4a-9748-0e8649d51805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:09.521296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502611d0-530e-4e4a-9748-0e8649d51805 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:09.521567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502611d0-530e-4e4a-9748-0e8649d51805 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:09.521828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502611d0-530e-4e4a-9748-0e8649d51805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:09.522569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502611d0-530e-4e4a-9748-0e8649d51805 None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=10247532345a4f75939950b803202cfa) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:09.522873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502611d0-530e-4e4a-9748-0e8649d51805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:09.524277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502611d0-530e-4e4a-9748-0e8649d51805 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:09.530309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 387/769] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:22:09 2022] GET /identity/v3/role_assignments?user.id=10247532345a4f75939950b803202cfa&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:09.532499 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 383/770] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 16 05:22:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:09.538456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502611d0-530e-4e4a-9748-0e8649d51805 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:09.564969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610449e8-d0c2-4784-83ee-8810789b8e57 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:09.565338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610449e8-d0c2-4784-83ee-8810789b8e57 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:09.565531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610449e8-d0c2-4784-83ee-8810789b8e57 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:09.567136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 384/771] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:22:09.575415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea78477-1d1d-42b0-a063-946f19051408 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:09.576044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea78477-1d1d-42b0-a063-946f19051408 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:09.576384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea78477-1d1d-42b0-a063-946f19051408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:09.599858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-eea78477-1d1d-42b0-a063-946f19051408 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:09.601186 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-eea78477-1d1d-42b0-a063-946f19051408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:09.618127 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:09.660502 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502611d0-530e-4e4a-9748-0e8649d51805 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:09.685048 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 385/772] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:09.689053 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244172e8-ad94-48b6-8ae1-29335b21a60c None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:09.689361 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244172e8-ad94-48b6-8ae1-29335b21a60c None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:09.689743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244172e8-ad94-48b6-8ae1-29335b21a60c None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:09.691592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 386/773] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:09.698215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77593859-2596-4c0c-a7cb-67586b101227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:09.698882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77593859-2596-4c0c-a7cb-67586b101227 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:09.699154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77593859-2596-4c0c-a7cb-67586b101227 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:09.699418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77593859-2596-4c0c-a7cb-67586b101227 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:09.700057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77593859-2596-4c0c-a7cb-67586b101227 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:09.700355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77593859-2596-4c0c-a7cb-67586b101227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:09.701727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77593859-2596-4c0c-a7cb-67586b101227 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:09.708430 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 388/774] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 16 05:22:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:09.708697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f49c3-423e-45f5-8d99-2b1d046a254d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:09.708932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f49c3-423e-45f5-8d99-2b1d046a254d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:09.709202 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f49c3-423e-45f5-8d99-2b1d046a254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:09.718249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77593859-2596-4c0c-a7cb-67586b101227 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:09.733657 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-fd5f49c3-423e-45f5-8d99-2b1d046a254d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:09.735385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-fd5f49c3-423e-45f5-8d99-2b1d046a254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:09.805070 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:09.817332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 387/775] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:09.855402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77593859-2596-4c0c-a7cb-67586b101227 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:09.883488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:09.898309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8706ff-057f-4a3a-b9ff-f743440b040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:09.899153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8706ff-057f-4a3a-b9ff-f743440b040a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:09.899428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8706ff-057f-4a3a-b9ff-f743440b040a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:09.899695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8706ff-057f-4a3a-b9ff-f743440b040a None admin] PATH_INFO: `/v3/endpoints` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:09.900401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8706ff-057f-4a3a-b9ff-f743440b040a None admin] RBAC: Adding query filter params (interface=public, service_id=fb1146bd1d0e4f0ba895c6cd394d355b, region_id=RegionOne) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:09.900705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8706ff-057f-4a3a-b9ff-f743440b040a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:09.902056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8706ff-057f-4a3a-b9ff-f743440b040a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:09.911963 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 389/776] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 05:22:09 2022] GET /identity/v3/endpoints?service_id=fb1146bd1d0e4f0ba895c6cd394d355b&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:09.917489 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f49c3-423e-45f5-8d99-2b1d046a254d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:10.003676 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8706ff-057f-4a3a-b9ff-f743440b040a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:10.077479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f49c3-423e-45f5-8d99-2b1d046a254d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:10.121341 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8706ff-057f-4a3a-b9ff-f743440b040a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:10.143635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd67b40-d411-4891-8111-4d8201258d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:10.144256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd67b40-d411-4891-8111-4d8201258d73 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:10.144538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd67b40-d411-4891-8111-4d8201258d73 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:10.144808 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd67b40-d411-4891-8111-4d8201258d73 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:10.145413 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd67b40-d411-4891-8111-4d8201258d73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:10.147049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd67b40-d411-4891-8111-4d8201258d73 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:10.164404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006c4d8-5422-418a-86f4-97e7e67f14c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:10.165051 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006c4d8-5422-418a-86f4-97e7e67f14c0 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:10.165330 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006c4d8-5422-418a-86f4-97e7e67f14c0 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:10.165600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006c4d8-5422-418a-86f4-97e7e67f14c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:10.165783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 388/777] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 05:22:09 2022] GET /identity/v3/services => generated 772 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:10.186863 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006c4d8-5422-418a-86f4-97e7e67f14c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-8006c4d8-5422-418a-86f4-97e7e67f14c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:10.192777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:10.195259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:10.197282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:10.197282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:10.197282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:10.197282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:10.197282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:10.197282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:10.197282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:10.197282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:10.197282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:10.197282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:10.197282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:10.197282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:10.197282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 390/778] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:22:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:10.203110 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd67b40-d411-4891-8111-4d8201258d73 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:10.297930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:10.348802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006c4d8-5422-418a-86f4-97e7e67f14c0 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:10.382714 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd67b40-d411-4891-8111-4d8201258d73 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:10.429244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:10.432895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeeabd5-9992-4bef-bf51-6e5d87d85305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:10.434537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeabd5-9992-4bef-bf51-6e5d87d85305 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:10.435809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeabd5-9992-4bef-bf51-6e5d87d85305 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:10.436293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeabd5-9992-4bef-bf51-6e5d87d85305 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:10.437728 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeeabd5-9992-4bef-bf51-6e5d87d85305 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:10.438746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeeabd5-9992-4bef-bf51-6e5d87d85305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:10.440932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeeabd5-9992-4bef-bf51-6e5d87d85305 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:10.454174 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 389/779] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:22:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:10.459382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeeabd5-9992-4bef-bf51-6e5d87d85305 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:10.489751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006c4d8-5422-418a-86f4-97e7e67f14c0 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:10.530407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ab998-2fd5-455a-92df-93b3f513c89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:10.532579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ab998-2fd5-455a-92df-93b3f513c89a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:10.533068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ab998-2fd5-455a-92df-93b3f513c89a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:10.533546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ab998-2fd5-455a-92df-93b3f513c89a None admin] PATH_INFO: `/v3/services/network` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:10.534338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ab998-2fd5-455a-92df-93b3f513c89a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:10.536085 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ab998-2fd5-455a-92df-93b3f513c89a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-864ab998-2fd5-455a-92df-93b3f513c89a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:10.547895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:10.548911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 05:22:10.549756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:10.557364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 391/780] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:10 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:10.558939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ab998-2fd5-455a-92df-93b3f513c89a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:10.638312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeeabd5-9992-4bef-bf51-6e5d87d85305 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:10.671630 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:10.673954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ab998-2fd5-455a-92df-93b3f513c89a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:10.692271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:10.711219 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac973f-1a5a-43e9-b599-26ce3d103206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:10.713019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac973f-1a5a-43e9-b599-26ce3d103206 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:10.714041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac973f-1a5a-43e9-b599-26ce3d103206 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:10.714880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a6a4-48ca-475a-9a88-0fa80f0daf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:10.715405 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac973f-1a5a-43e9-b599-26ce3d103206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:10.716242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a6a4-48ca-475a-9a88-0fa80f0daf45 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:10.717538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a6a4-48ca-475a-9a88-0fa80f0daf45 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:10.719798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a6a4-48ca-475a-9a88-0fa80f0daf45 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:10.720643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525a6a4-48ca-475a-9a88-0fa80f0daf45 None admin] RBAC: Adding query filter params (name=network) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:10.721166 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525a6a4-48ca-475a-9a88-0fa80f0daf45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:10.723610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525a6a4-48ca-475a-9a88-0fa80f0daf45 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:10.733118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 392/781] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 05:22:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:10.737156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac973f-1a5a-43e9-b599-26ce3d103206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:10.738696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a6a4-48ca-475a-9a88-0fa80f0daf45 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:10.743433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac973f-1a5a-43e9-b599-26ce3d103206 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-0dac973f-1a5a-43e9-b599-26ce3d103206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:10.774148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:10.775230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:10.776757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:10.776757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:10.776757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:10.776757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 390/782] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:10.781362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac973f-1a5a-43e9-b599-26ce3d103206 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:10.854416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a6a4-48ca-475a-9a88-0fa80f0daf45 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:10.892033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420cd1b-7712-48ba-aa98-9a70c8b89218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:10.892992 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420cd1b-7712-48ba-aa98-9a70c8b89218 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:10.893516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420cd1b-7712-48ba-aa98-9a70c8b89218 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:10.894067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420cd1b-7712-48ba-aa98-9a70c8b89218 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:10.895072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420cd1b-7712-48ba-aa98-9a70c8b89218 None admin] RBAC: Adding query filter params (type=network) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:10.895648 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420cd1b-7712-48ba-aa98-9a70c8b89218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:10.897222 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420cd1b-7712-48ba-aa98-9a70c8b89218 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:10.903127 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 393/783] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 05:22:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:10.911511 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420cd1b-7712-48ba-aa98-9a70c8b89218 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:10.970917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:11.019384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420cd1b-7712-48ba-aa98-9a70c8b89218 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:11.056875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de3090-5579-4fae-b182-89ab1cb61d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:11.057557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de3090-5579-4fae-b182-89ab1cb61d27 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:11.057833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de3090-5579-4fae-b182-89ab1cb61d27 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:11.058099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de3090-5579-4fae-b182-89ab1cb61d27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:11.058977 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de3090-5579-4fae-b182-89ab1cb61d27 None admin] RBAC: Adding query filter params (interface=public, service_id=da8a8465ada94554bc8e7b095b49930f, region_id=RegionOne) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:11.059297 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de3090-5579-4fae-b182-89ab1cb61d27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:11.060711 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de3090-5579-4fae-b182-89ab1cb61d27 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:11.066995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 394/784] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 05:22:10 2022] GET /identity/v3/endpoints?service_id=da8a8465ada94554bc8e7b095b49930f&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:11.068711 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac973f-1a5a-43e9-b599-26ce3d103206 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:11.072704 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de3090-5579-4fae-b182-89ab1cb61d27 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:11.160686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408e17a-7e04-41c9-a42e-19df9032fa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:11.161218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408e17a-7e04-41c9-a42e-19df9032fa2a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:11.161494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408e17a-7e04-41c9-a42e-19df9032fa2a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:11.161770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408e17a-7e04-41c9-a42e-19df9032fa2a None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:11.162406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408e17a-7e04-41c9-a42e-19df9032fa2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:11.162725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408e17a-7e04-41c9-a42e-19df9032fa2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:11.164104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408e17a-7e04-41c9-a42e-19df9032fa2a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:11.184612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de3090-5579-4fae-b182-89ab1cb61d27 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:11.190637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 391/785] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:11.197258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408e17a-7e04-41c9-a42e-19df9032fa2a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:11.198730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:11.236248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36969e45-4d07-4aa1-94d6-e02b5195c77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:11.236900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36969e45-4d07-4aa1-94d6-e02b5195c77f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:11.237182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36969e45-4d07-4aa1-94d6-e02b5195c77f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:11.237447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36969e45-4d07-4aa1-94d6-e02b5195c77f None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:11.240834 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36969e45-4d07-4aa1-94d6-e02b5195c77f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:11.240834 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36969e45-4d07-4aa1-94d6-e02b5195c77f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:11.249829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 395/786] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 05:22:11 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:11.278754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:11.371492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408e17a-7e04-41c9-a42e-19df9032fa2a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:11.392144 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb770bb9-9c57-4bdd-a46a-4041ce02d647 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:11.392668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb770bb9-9c57-4bdd-a46a-4041ce02d647 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:11.392901 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb770bb9-9c57-4bdd-a46a-4041ce02d647 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:11.394573 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 396/787] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:11.400848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670351ea-6c2a-4811-aeb0-cd10e830c542 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:11.401171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670351ea-6c2a-4811-aeb0-cd10e830c542 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:11.401399 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670351ea-6c2a-4811-aeb0-cd10e830c542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:11.423568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-670351ea-6c2a-4811-aeb0-cd10e830c542 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:11.424703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-670351ea-6c2a-4811-aeb0-cd10e830c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:11.432335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baf8cc-eb66-4f25-8e54-690e0a30d9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:11.433400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baf8cc-eb66-4f25-8e54-690e0a30d9d6 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:11.433896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baf8cc-eb66-4f25-8e54-690e0a30d9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:11.434375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baf8cc-eb66-4f25-8e54-690e0a30d9d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:11.447847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baf8cc-eb66-4f25-8e54-690e0a30d9d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:11.449346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baf8cc-eb66-4f25-8e54-690e0a30d9d6 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-c6baf8cc-eb66-4f25-8e54-690e0a30d9d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:11.474702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:11.475717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:11.476663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:11.476663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:11.476663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:11.476663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:11.476663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:11.476663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:11.476663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:11.476663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:11.476663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 05:22:11.476663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:11.478843 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 392/788] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:22:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:11.481772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baf8cc-eb66-4f25-8e54-690e0a30d9d6 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:11.509133 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 397/789] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:11.612401 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:11.624294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baf8cc-eb66-4f25-8e54-690e0a30d9d6 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:11.663110 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb371a5-f4b2-48ef-825b-ffdf5585cff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:11.663713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb371a5-f4b2-48ef-825b-ffdf5585cff8 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:11.664248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb371a5-f4b2-48ef-825b-ffdf5585cff8 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:11.664718 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb371a5-f4b2-48ef-825b-ffdf5585cff8 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:11.665885 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb371a5-f4b2-48ef-825b-ffdf5585cff8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:11.666190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb371a5-f4b2-48ef-825b-ffdf5585cff8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:11.667820 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb371a5-f4b2-48ef-825b-ffdf5585cff8 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:11.689341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 393/790] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 16 05:22:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:11.695148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670351ea-6c2a-4811-aeb0-cd10e830c542 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:11.808393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb371a5-f4b2-48ef-825b-ffdf5585cff8 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:11.835942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670351ea-6c2a-4811-aeb0-cd10e830c542 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:11.844180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:11.874057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df7bae-db38-406a-9f81-d95e988fefd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:11.875254 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df7bae-db38-406a-9f81-d95e988fefd2 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:11.875529 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df7bae-db38-406a-9f81-d95e988fefd2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:11.875794 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df7bae-db38-406a-9f81-d95e988fefd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:11.886246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df7bae-db38-406a-9f81-d95e988fefd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:11.887780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df7bae-db38-406a-9f81-d95e988fefd2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-10df7bae-db38-406a-9f81-d95e988fefd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:11.919987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:11.922922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:11.925117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:11.925117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:11.925117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:11.925117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 398/791] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:11.931998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df7bae-db38-406a-9f81-d95e988fefd2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:11.976118 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb371a5-f4b2-48ef-825b-ffdf5585cff8 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:12.020778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59f75b-06ee-4df6-b322-89d40a2b41a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:12.022771 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59f75b-06ee-4df6-b322-89d40a2b41a2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:12.023052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59f75b-06ee-4df6-b322-89d40a2b41a2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:12.023324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59f75b-06ee-4df6-b322-89d40a2b41a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:12.044998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59f75b-06ee-4df6-b322-89d40a2b41a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-2d59f75b-06ee-4df6-b322-89d40a2b41a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:12.051815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:12.052742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:12.054156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:12.054156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:12.054156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:12.054156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:12.054156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:12.054156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:12.054156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:12.054156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:12.054156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:12.054156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:12.054156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:12.054156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:12.054156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 394/792] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:22:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:12.054882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adf59b-f1c5-4a57-8289-47ac0d7bf249 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:12.054882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adf59b-f1c5-4a57-8289-47ac0d7bf249 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:12.055028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adf59b-f1c5-4a57-8289-47ac0d7bf249 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:12.060181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 395/793] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:12.060181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adf59b-f1c5-4a57-8289-47ac0d7bf249 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:12.072539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:12.107976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df7bae-db38-406a-9f81-d95e988fefd2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:12.147134 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde111f9-3187-4050-a2ff-85214fe69655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:12.148192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde111f9-3187-4050-a2ff-85214fe69655 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:12.148678 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde111f9-3187-4050-a2ff-85214fe69655 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:12.149155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde111f9-3187-4050-a2ff-85214fe69655 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:12.149999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde111f9-3187-4050-a2ff-85214fe69655 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:12.150674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde111f9-3187-4050-a2ff-85214fe69655 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:12.152522 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde111f9-3187-4050-a2ff-85214fe69655 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:12.166799 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 399/794] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:12.168601 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43467de7-b5e2-4d65-8896-aff0a1416b92 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:12.169271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43467de7-b5e2-4d65-8896-aff0a1416b92 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:12.169610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43467de7-b5e2-4d65-8896-aff0a1416b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:12.189093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adf59b-f1c5-4a57-8289-47ac0d7bf249 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:12.189348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-43467de7-b5e2-4d65-8896-aff0a1416b92 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:12.190727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-43467de7-b5e2-4d65-8896-aff0a1416b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:12.201228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:12.244979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bf916-8576-4d98-885b-20b9117ddf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:12.245596 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bf916-8576-4d98-885b-20b9117ddf92 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:12.245923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bf916-8576-4d98-885b-20b9117ddf92 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:12.246201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bf916-8576-4d98-885b-20b9117ddf92 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:12.247002 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bf916-8576-4d98-885b-20b9117ddf92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:12.247305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bf916-8576-4d98-885b-20b9117ddf92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:12.248736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bf916-8576-4d98-885b-20b9117ddf92 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:12.261380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 396/795] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:22:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:12.262451 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bf916-8576-4d98-885b-20b9117ddf92 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:12.290677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 400/796] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:12.290677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43467de7-b5e2-4d65-8896-aff0a1416b92 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:12.418784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43467de7-b5e2-4d65-8896-aff0a1416b92 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:12.424571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:12.460497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cdfc1-42fc-4c49-ab82-0d02e2370299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:12.461416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cdfc1-42fc-4c49-ab82-0d02e2370299 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:12.461827 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cdfc1-42fc-4c49-ab82-0d02e2370299 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:12.462224 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cdfc1-42fc-4c49-ab82-0d02e2370299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:12.478835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cdfc1-42fc-4c49-ab82-0d02e2370299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:12.481743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cdfc1-42fc-4c49-ab82-0d02e2370299 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:12.486599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:12.492795 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bf916-8576-4d98-885b-20b9117ddf92 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-391cdfc1-42fc-4c49-ab82-0d02e2370299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:12.509710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:12.510764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:12.512275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:12.512275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:12.512275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:12.512275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 401/797] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:12.517007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cdfc1-42fc-4c49-ab82-0d02e2370299 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:12.566404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef8473-6096-4a2f-8426-7fa6f45eceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:12.567066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef8473-6096-4a2f-8426-7fa6f45eceb4 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:12.567344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef8473-6096-4a2f-8426-7fa6f45eceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:12.567615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef8473-6096-4a2f-8426-7fa6f45eceb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:12.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef8473-6096-4a2f-8426-7fa6f45eceb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:12.584487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef8473-6096-4a2f-8426-7fa6f45eceb4 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-5fef8473-6096-4a2f-8426-7fa6f45eceb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:12.599246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:12.600205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:12.601687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:12.601687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:12.601687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:12.601687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:12.601687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:12.601687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:12.601687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:12.601687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:12.601687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 397/798] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:12.601687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef8473-6096-4a2f-8426-7fa6f45eceb4 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:12.672405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cdfc1-42fc-4c49-ab82-0d02e2370299 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:12.721758 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774a51c-bda8-4360-bd9d-2e9426ad212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:12.722956 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a51c-bda8-4360-bd9d-2e9426ad212b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:12.723418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a51c-bda8-4360-bd9d-2e9426ad212b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:12.724141 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a51c-bda8-4360-bd9d-2e9426ad212b None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:12.725370 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774a51c-bda8-4360-bd9d-2e9426ad212b None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:12.726120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774a51c-bda8-4360-bd9d-2e9426ad212b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:12.727757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef8473-6096-4a2f-8426-7fa6f45eceb4 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:12.727953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774a51c-bda8-4360-bd9d-2e9426ad212b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:12.745860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 402/799] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:12.747385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774a51c-bda8-4360-bd9d-2e9426ad212b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:12.761613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:12.771542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7cd12-49c1-4da2-a813-0ef3bf34dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:12.772710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7cd12-49c1-4da2-a813-0ef3bf34dc26 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:12.773618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7cd12-49c1-4da2-a813-0ef3bf34dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:12.774075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7cd12-49c1-4da2-a813-0ef3bf34dc26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:12.789083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7cd12-49c1-4da2-a813-0ef3bf34dc26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-aeb7cd12-49c1-4da2-a813-0ef3bf34dc26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:12.795612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:12.797161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:12.798051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:12.798051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:12.798051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:12.798051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:12.798051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:12.798051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:12.798051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:12.798051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:12.798051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:12.798051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:12.798051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:22:12.798051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:12.805176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 398/800] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:22:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:12.806422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7cd12-49c1-4da2-a813-0ef3bf34dc26 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:12.935695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:12.936753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7cd12-49c1-4da2-a813-0ef3bf34dc26 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:12.980443 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dffce-5302-452f-b34a-0876533d1f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:12.981148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dffce-5302-452f-b34a-0876533d1f5b None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:12.981331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dffce-5302-452f-b34a-0876533d1f5b None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:12.981590 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dffce-5302-452f-b34a-0876533d1f5b None admin] PATH_INFO: `/v3/users/nova` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:12.985968 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774a51c-bda8-4360-bd9d-2e9426ad212b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:12.989717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282dffce-5302-452f-b34a-0876533d1f5b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:12.991197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282dffce-5302-452f-b34a-0876533d1f5b None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-282dffce-5302-452f-b34a-0876533d1f5b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:13.002406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:13.003544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:13.004975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:13.004975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:13.004975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:13.004975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:13.004975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:13.004975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:13.004975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:13.004975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:13.004975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:22:13.004975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:13.004975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 399/801] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 05:22:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:13.004975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dffce-5302-452f-b34a-0876533d1f5b None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:13.027205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f8193-b259-4705-8076-dd889ce14c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:13.027802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f8193-b259-4705-8076-dd889ce14c45 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:13.028071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f8193-b259-4705-8076-dd889ce14c45 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:13.028335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f8193-b259-4705-8076-dd889ce14c45 None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:13.029012 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f8193-b259-4705-8076-dd889ce14c45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:13.029308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f8193-b259-4705-8076-dd889ce14c45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:13.031279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f8193-b259-4705-8076-dd889ce14c45 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:13.050327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 403/802] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:13.050327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafb85f-5398-466a-a303-4222b78b9ca6 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:13.050327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafb85f-5398-466a-a303-4222b78b9ca6 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:13.050327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafb85f-5398-466a-a303-4222b78b9ca6 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:13.050327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 404/803] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:13.050783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafb85f-5398-466a-a303-4222b78b9ca6 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:13.059448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:13.115050 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dffce-5302-452f-b34a-0876533d1f5b None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:13.148110 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b626d-f55f-43f7-9a3c-9ae2e7f410a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:13.148705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b626d-f55f-43f7-9a3c-9ae2e7f410a6 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:13.148978 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b626d-f55f-43f7-9a3c-9ae2e7f410a6 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:13.149242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b626d-f55f-43f7-9a3c-9ae2e7f410a6 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:13.149884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b626d-f55f-43f7-9a3c-9ae2e7f410a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:13.150183 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b626d-f55f-43f7-9a3c-9ae2e7f410a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:13.151655 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b626d-f55f-43f7-9a3c-9ae2e7f410a6 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:13.160362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 400/804] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:22:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:13.161102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b626d-f55f-43f7-9a3c-9ae2e7f410a6 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:13.168862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafb85f-5398-466a-a303-4222b78b9ca6 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:13.187819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:13.206959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb2c93-fe9e-427b-9346-8e5853f6a514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:13.207640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb2c93-fe9e-427b-9346-8e5853f6a514 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:13.207912 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb2c93-fe9e-427b-9346-8e5853f6a514 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:13.208175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb2c93-fe9e-427b-9346-8e5853f6a514 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:13.209030 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb2c93-fe9e-427b-9346-8e5853f6a514 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:13.209292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb2c93-fe9e-427b-9346-8e5853f6a514 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:13.210838 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb2c93-fe9e-427b-9346-8e5853f6a514 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:13.235776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 405/805] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 05:22:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:13.235776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0929951-6251-48e8-8888-8c2e730e51f2 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:13.235776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0929951-6251-48e8-8888-8c2e730e51f2 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:13.235776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0929951-6251-48e8-8888-8c2e730e51f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:13.252100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c0929951-6251-48e8-8888-8c2e730e51f2 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:13.253329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c0929951-6251-48e8-8888-8c2e730e51f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:13.275061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b626d-f55f-43f7-9a3c-9ae2e7f410a6 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:13.288662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:13.315862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b61bd-021f-45c9-a7c6-77524c54b87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:13.316521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b61bd-021f-45c9-a7c6-77524c54b87a None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:13.316819 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b61bd-021f-45c9-a7c6-77524c54b87a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:13.317065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b61bd-021f-45c9-a7c6-77524c54b87a None admin] PATH_INFO: `/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/bae43204e3984619b4fdb64f36ef47ea/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:13.318973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b61bd-021f-45c9-a7c6-77524c54b87a None admin] RBAC: Authorizing `identity:create_grant(project_id=74c9d19fb1534f8f8888e957d1007640, user_id=bae43204e3984619b4fdb64f36ef47ea, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:13.320415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b61bd-021f-45c9-a7c6-77524c54b87a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:13.327354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 406/806] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:13.328698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0929951-6251-48e8-8888-8c2e730e51f2 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:13.346752 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 401/807] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:22:13 2022] PUT /identity/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/bae43204e3984619b4fdb64f36ef47ea/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:22:13.347974 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b61bd-021f-45c9-a7c6-77524c54b87a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:13.477750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0929951-6251-48e8-8888-8c2e730e51f2 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:13.482276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:13.518298 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b61bd-021f-45c9-a7c6-77524c54b87a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:13.545322 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeffa2-9a11-4ccc-ac75-bade5e6077ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:13.545962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeffa2-9a11-4ccc-ac75-bade5e6077ff None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:13.546292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeffa2-9a11-4ccc-ac75-bade5e6077ff None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:13.546612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeffa2-9a11-4ccc-ac75-bade5e6077ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:13.568717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbeffa2-9a11-4ccc-ac75-bade5e6077ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:13.570193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbeffa2-9a11-4ccc-ac75-bade5e6077ff None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:13.571304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade8388-08b5-453b-8235-561ec5a7646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:13.572194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade8388-08b5-453b-8235-561ec5a7646f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:13.572664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade8388-08b5-453b-8235-561ec5a7646f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:13.573185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade8388-08b5-453b-8235-561ec5a7646f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-0bbeffa2-9a11-4ccc-ac75-bade5e6077ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:13.595424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:13.596440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:13.597338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:13.597338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:13.597338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:13.597338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 407/808] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:13.602445 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeffa2-9a11-4ccc-ac75-bade5e6077ff None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:13.635554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:13.670976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade8388-08b5-453b-8235-561ec5a7646f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:13.673191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade8388-08b5-453b-8235-561ec5a7646f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:13.761138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeffa2-9a11-4ccc-ac75-bade5e6077ff None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:13.797275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d7faf-3778-4ba0-b51f-96a5510e1c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:13.797920 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d7faf-3778-4ba0-b51f-96a5510e1c78 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:13.798270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d7faf-3778-4ba0-b51f-96a5510e1c78 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:13.798643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d7faf-3778-4ba0-b51f-96a5510e1c78 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:13.799362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d7faf-3778-4ba0-b51f-96a5510e1c78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:13.799739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d7faf-3778-4ba0-b51f-96a5510e1c78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:13.801174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d7faf-3778-4ba0-b51f-96a5510e1c78 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:13.807489 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 402/809] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:22:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:22:13.808654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade8388-08b5-453b-8235-561ec5a7646f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:13.819375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 408/810] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:13.820416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d7faf-3778-4ba0-b51f-96a5510e1c78 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:13.849634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:13.909674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:13.950212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d7faf-3778-4ba0-b51f-96a5510e1c78 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:13.951174 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade8388-08b5-453b-8235-561ec5a7646f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:13.985030 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf55b6-2af2-46d3-bfb6-2adbbaee7892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:13.985811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf55b6-2af2-46d3-bfb6-2adbbaee7892 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:13.986405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf55b6-2af2-46d3-bfb6-2adbbaee7892 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:13.986705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf55b6-2af2-46d3-bfb6-2adbbaee7892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:13.990967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57041821-3fcc-4d91-a6f7-b6be0ed4b2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:13.991588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57041821-3fcc-4d91-a6f7-b6be0ed4b2b2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:13.991866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57041821-3fcc-4d91-a6f7-b6be0ed4b2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:13.992135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57041821-3fcc-4d91-a6f7-b6be0ed4b2b2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:13.992709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57041821-3fcc-4d91-a6f7-b6be0ed4b2b2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:13.994224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57041821-3fcc-4d91-a6f7-b6be0ed4b2b2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:13.997222 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf55b6-2af2-46d3-bfb6-2adbbaee7892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:13.998672 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf55b6-2af2-46d3-bfb6-2adbbaee7892 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-57041821-3fcc-4d91-a6f7-b6be0ed4b2b2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:14.003528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:14.004476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:14.005332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 403/811] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Sep 16 05:22:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:14.006798 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57041821-3fcc-4d91-a6f7-b6be0ed4b2b2 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-bddf55b6-2af2-46d3-bfb6-2adbbaee7892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:14.017900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:14.019149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:14.020236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:14.020236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:14.020236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:14.020236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 409/812] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:14.024510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee16d2-5e59-43d6-9002-8e8ef11e7846 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:14.024907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee16d2-5e59-43d6-9002-8e8ef11e7846 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:14.025183 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee16d2-5e59-43d6-9002-8e8ef11e7846 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:14.031270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 410/813] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:14.031270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee16d2-5e59-43d6-9002-8e8ef11e7846 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:14.105934 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:14.115780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57041821-3fcc-4d91-a6f7-b6be0ed4b2b2 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:14.144568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee16d2-5e59-43d6-9002-8e8ef11e7846 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:14.158985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1d4a6-49c0-4fb9-a082-f06826426666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:14.159906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1d4a6-49c0-4fb9-a082-f06826426666 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:14.160187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1d4a6-49c0-4fb9-a082-f06826426666 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:14.160451 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1d4a6-49c0-4fb9-a082-f06826426666 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:14.163486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:14.169294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1d4a6-49c0-4fb9-a082-f06826426666 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:14.171351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1d4a6-49c0-4fb9-a082-f06826426666 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:14.180935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbb1db-5ae4-498e-81d8-2aa08172471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:14.181605 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbb1db-5ae4-498e-81d8-2aa08172471d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:14.181941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbb1db-5ae4-498e-81d8-2aa08172471d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:14.182274 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbb1db-5ae4-498e-81d8-2aa08172471d None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-a4d1d4a6-49c0-4fb9-a082-f06826426666 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:14.182604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:14.183698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:14.189783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:14.189783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:14.189783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:14.189783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:14.189783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:14.189783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:14.189783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:14.189783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:14.189783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 05:22:14.189783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:14.190439 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbb1db-5ae4-498e-81d8-2aa08172471d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:14.190549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 404/814] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 05:22:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:14.190635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbb1db-5ae4-498e-81d8-2aa08172471d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:14.190727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1d4a6-49c0-4fb9-a082-f06826426666 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:14.190809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbb1db-5ae4-498e-81d8-2aa08172471d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:14.195224 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 411/815] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 16 05:22:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:14.199926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180631-9ca2-4b74-b5f0-cfb90361cdb0 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:14.199926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180631-9ca2-4b74-b5f0-cfb90361cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:14.199926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180631-9ca2-4b74-b5f0-cfb90361cdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:14.215781 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-6e180631-9ca2-4b74-b5f0-cfb90361cdb0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:14.216976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6e180631-9ca2-4b74-b5f0-cfb90361cdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:14.290219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 412/816] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:14.291098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e180631-9ca2-4b74-b5f0-cfb90361cdb0 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:14.311678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1d4a6-49c0-4fb9-a082-f06826426666 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:14.349838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b8a79-0ce1-49fd-8dd8-c9f69be9a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:14.350927 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b8a79-0ce1-49fd-8dd8-c9f69be9a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:14.351209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b8a79-0ce1-49fd-8dd8-c9f69be9a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:14.351475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b8a79-0ce1-49fd-8dd8-c9f69be9a5d8 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:14.352119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b8a79-0ce1-49fd-8dd8-c9f69be9a5d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:14.352416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b8a79-0ce1-49fd-8dd8-c9f69be9a5d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:14.353964 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b8a79-0ce1-49fd-8dd8-c9f69be9a5d8 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:14.371185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 405/817] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:14.371185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b8a79-0ce1-49fd-8dd8-c9f69be9a5d8 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:14.372435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:14.425658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e180631-9ca2-4b74-b5f0-cfb90361cdb0 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:14.436574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:14.469921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870e87f-606e-434f-adb0-1fad64fcd420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:14.470800 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870e87f-606e-434f-adb0-1fad64fcd420 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:14.471224 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870e87f-606e-434f-adb0-1fad64fcd420 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:14.471664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870e87f-606e-434f-adb0-1fad64fcd420 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:14.472582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870e87f-606e-434f-adb0-1fad64fcd420 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:14.473068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870e87f-606e-434f-adb0-1fad64fcd420 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:14.474941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870e87f-606e-434f-adb0-1fad64fcd420 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:14.484663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b8a79-0ce1-49fd-8dd8-c9f69be9a5d8 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:14.499625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 413/818] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 16 05:22:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:14.500127 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870e87f-606e-434f-adb0-1fad64fcd420 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:14.521380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263bca9-f08a-4367-a224-c1e897842559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:14.521951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263bca9-f08a-4367-a224-c1e897842559 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:14.522228 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263bca9-f08a-4367-a224-c1e897842559 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:14.522498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263bca9-f08a-4367-a224-c1e897842559 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:14.523156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263bca9-f08a-4367-a224-c1e897842559 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:14.523511 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263bca9-f08a-4367-a224-c1e897842559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:14.524933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263bca9-f08a-4367-a224-c1e897842559 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:14.535116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 406/819] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 16 05:22:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:14.535946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263bca9-f08a-4367-a224-c1e897842559 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:14.616580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870e87f-606e-434f-adb0-1fad64fcd420 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:14.639357 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263bca9-f08a-4367-a224-c1e897842559 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:14.640212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:14.656577 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78551f01-02ae-4700-a5a4-5ba6cc4e0c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:14.657202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78551f01-02ae-4700-a5a4-5ba6cc4e0c10 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:14.657480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78551f01-02ae-4700-a5a4-5ba6cc4e0c10 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:14.657749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78551f01-02ae-4700-a5a4-5ba6cc4e0c10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:14.661356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:14.664750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78551f01-02ae-4700-a5a4-5ba6cc4e0c10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:14.666287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78551f01-02ae-4700-a5a4-5ba6cc4e0c10 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:14.676861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41aac3-2231-4b3f-9866-b190d4686323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:14.677482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41aac3-2231-4b3f-9866-b190d4686323 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:14.677760 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41aac3-2231-4b3f-9866-b190d4686323 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-78551f01-02ae-4700-a5a4-5ba6cc4e0c10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:14.677994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:14.678969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:14.679844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:14.679844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:14.679844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:14.679844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:14.679844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:14.679844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:14.679844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:14.679844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:14.680616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41aac3-2231-4b3f-9866-b190d4686323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:14.680717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 414/820] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:14.680717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78551f01-02ae-4700-a5a4-5ba6cc4e0c10 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:14.694190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41aac3-2231-4b3f-9866-b190d4686323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:14.695681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41aac3-2231-4b3f-9866-b190d4686323 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-aa41aac3-2231-4b3f-9866-b190d4686323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:14.710158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:14.711347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:14.712247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:14.712247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:14.712247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:14.712247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 407/821] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:14.712492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41aac3-2231-4b3f-9866-b190d4686323 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:14.803370 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78551f01-02ae-4700-a5a4-5ba6cc4e0c10 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:14.820497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41aac3-2231-4b3f-9866-b190d4686323 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:14.839004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be35ee-b926-4190-8145-17e6bef7f624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:14.839902 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be35ee-b926-4190-8145-17e6bef7f624 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:14.840357 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be35ee-b926-4190-8145-17e6bef7f624 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:14.840805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be35ee-b926-4190-8145-17e6bef7f624 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:14.841640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be35ee-b926-4190-8145-17e6bef7f624 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:14.843743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be35ee-b926-4190-8145-17e6bef7f624 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:14.856331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e468b7d-aa04-425e-b049-7c6c9bd4f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:14.857117 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e468b7d-aa04-425e-b049-7c6c9bd4f814 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:14.857482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e468b7d-aa04-425e-b049-7c6c9bd4f814 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:14.857923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e468b7d-aa04-425e-b049-7c6c9bd4f814 None admin] PATH_INFO: `/v3/services/network` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:14.858560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e468b7d-aa04-425e-b049-7c6c9bd4f814 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:14.860079 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e468b7d-aa04-425e-b049-7c6c9bd4f814 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:14.870540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 415/822] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:22:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:22:14.870540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be35ee-b926-4190-8145-17e6bef7f624 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-2e468b7d-aa04-425e-b049-7c6c9bd4f814 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:14.870786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:14.872323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:14.873168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 408/823] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:14 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:14.873954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e468b7d-aa04-425e-b049-7c6c9bd4f814 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:14.931545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:14.935624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:15.026235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e468b7d-aa04-425e-b049-7c6c9bd4f814 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:15.027109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be35ee-b926-4190-8145-17e6bef7f624 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:15.068387 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb193222-2474-47a3-a74e-626977a0ef4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:15.069004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb193222-2474-47a3-a74e-626977a0ef4f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:15.069281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb193222-2474-47a3-a74e-626977a0ef4f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:15.069551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb193222-2474-47a3-a74e-626977a0ef4f None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:15.070190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb193222-2474-47a3-a74e-626977a0ef4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:15.070493 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb193222-2474-47a3-a74e-626977a0ef4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:15.072573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb193222-2474-47a3-a74e-626977a0ef4f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:15.080264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726fe6f-4202-46fc-a764-bc9e93cff245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:15.081262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726fe6f-4202-46fc-a764-bc9e93cff245 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:15.081702 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726fe6f-4202-46fc-a764-bc9e93cff245 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:15.082146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726fe6f-4202-46fc-a764-bc9e93cff245 None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:15.083317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726fe6f-4202-46fc-a764-bc9e93cff245 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:15.084138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726fe6f-4202-46fc-a764-bc9e93cff245 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:15.086087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726fe6f-4202-46fc-a764-bc9e93cff245 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:15.088631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 409/824] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:15.089348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb193222-2474-47a3-a74e-626977a0ef4f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:15.105065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 416/825] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:15.106184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726fe6f-4202-46fc-a764-bc9e93cff245 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:15.212162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:15.220183 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb193222-2474-47a3-a74e-626977a0ef4f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:15.227161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:15.242637 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726fe6f-4202-46fc-a764-bc9e93cff245 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:15.269001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0320f5-7700-429e-bb11-88f56a68bc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:15.269730 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0320f5-7700-429e-bb11-88f56a68bc15 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:15.270080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0320f5-7700-429e-bb11-88f56a68bc15 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:15.270447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0320f5-7700-429e-bb11-88f56a68bc15 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:15.271413 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0320f5-7700-429e-bb11-88f56a68bc15 None admin] RBAC: Adding query filter params (name=network) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:15.272194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0320f5-7700-429e-bb11-88f56a68bc15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:15.273949 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0320f5-7700-429e-bb11-88f56a68bc15 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:15.285716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 410/826] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 05:22:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:15.285716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0320f5-7700-429e-bb11-88f56a68bc15 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:15.289368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacef051-5a1a-49ce-bfc9-41ba6161a4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:15.290278 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacef051-5a1a-49ce-bfc9-41ba6161a4f2 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:15.290789 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacef051-5a1a-49ce-bfc9-41ba6161a4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:15.291254 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacef051-5a1a-49ce-bfc9-41ba6161a4f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:15.299764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacef051-5a1a-49ce-bfc9-41ba6161a4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:15.302159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacef051-5a1a-49ce-bfc9-41ba6161a4f2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-dacef051-5a1a-49ce-bfc9-41ba6161a4f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:15.315261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:15.316169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:15.317074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:15.317074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:15.317074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:15.317074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:15.317074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:15.317074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:15.317074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:15.317074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:15.324008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 417/827] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:15.324008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacef051-5a1a-49ce-bfc9-41ba6161a4f2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:15.403586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0320f5-7700-429e-bb11-88f56a68bc15 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:15.444596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacef051-5a1a-49ce-bfc9-41ba6161a4f2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:15.448971 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa976458-f124-447a-a72e-5b66c6bc9cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:15.449588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa976458-f124-447a-a72e-5b66c6bc9cb7 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:15.449867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa976458-f124-447a-a72e-5b66c6bc9cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:15.450144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa976458-f124-447a-a72e-5b66c6bc9cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:15.450895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa976458-f124-447a-a72e-5b66c6bc9cb7 None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=515e548efd984b87bca742e26eec162a) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:15.451200 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa976458-f124-447a-a72e-5b66c6bc9cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:15.453770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa976458-f124-447a-a72e-5b66c6bc9cb7 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:15.466614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 411/828] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:22:15 2022] GET /identity/v3/role_assignments?user.id=515e548efd984b87bca742e26eec162a&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:15.466614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa976458-f124-447a-a72e-5b66c6bc9cb7 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:15.492888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:15.520973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f562f5c-7b02-443a-873c-71c998caca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:15.522544 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f562f5c-7b02-443a-873c-71c998caca26 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:15.522965 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f562f5c-7b02-443a-873c-71c998caca26 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:15.523376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f562f5c-7b02-443a-873c-71c998caca26 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:15.524141 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f562f5c-7b02-443a-873c-71c998caca26 None admin] RBAC: Adding query filter params (type=network) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:15.524581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f562f5c-7b02-443a-873c-71c998caca26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:15.526208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f562f5c-7b02-443a-873c-71c998caca26 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:15.543441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 418/829] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 05:22:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:15.551578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f562f5c-7b02-443a-873c-71c998caca26 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:15.599059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:15.767155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa976458-f124-447a-a72e-5b66c6bc9cb7 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:15.767491 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f562f5c-7b02-443a-873c-71c998caca26 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:15.806616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb104fff-7f9e-4db0-8ea7-83af895f4c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:15.807422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb104fff-7f9e-4db0-8ea7-83af895f4c7c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:15.807772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb104fff-7f9e-4db0-8ea7-83af895f4c7c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:15.808116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb104fff-7f9e-4db0-8ea7-83af895f4c7c None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:15.809170 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb104fff-7f9e-4db0-8ea7-83af895f4c7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:15.809479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb104fff-7f9e-4db0-8ea7-83af895f4c7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:15.810206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50a29e-7afc-45fc-9b18-8f0ed4ab3838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:15.810835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a29e-7afc-45fc-9b18-8f0ed4ab3838 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:15.811599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a29e-7afc-45fc-9b18-8f0ed4ab3838 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:15.811599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a29e-7afc-45fc-9b18-8f0ed4ab3838 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:15.812251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb104fff-7f9e-4db0-8ea7-83af895f4c7c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:15.812350 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50a29e-7afc-45fc-9b18-8f0ed4ab3838 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:15.813645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50a29e-7afc-45fc-9b18-8f0ed4ab3838 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:15.829072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 412/830] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:15.834124 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a129735-906a-43d6-8f81-959999303edd None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:15.834469 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a129735-906a-43d6-8f81-959999303edd None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:15.834716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a129735-906a-43d6-8f81-959999303edd None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:15.837297 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 419/831] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:22:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:22:15.837766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 413/832] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:15.843740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a129735-906a-43d6-8f81-959999303edd None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:15.844836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9454ed-ce57-4b37-9c3b-e826eba1363a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:15.845380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9454ed-ce57-4b37-9c3b-e826eba1363a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:15.845902 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9454ed-ce57-4b37-9c3b-e826eba1363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:15.867638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-6b9454ed-ce57-4b37-9c3b-e826eba1363a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:15.869307 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6b9454ed-ce57-4b37-9c3b-e826eba1363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:15.955269 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:15.964042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 420/833] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:16.016116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:16.037901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a129735-906a-43d6-8f81-959999303edd None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:16.076011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9abe81-18cd-4efa-8d14-1dac5511e5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:16.076667 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9abe81-18cd-4efa-8d14-1dac5511e5c0 None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:16.076939 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9abe81-18cd-4efa-8d14-1dac5511e5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:16.077205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9abe81-18cd-4efa-8d14-1dac5511e5c0 None admin] PATH_INFO: `/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/10247532345a4f75939950b803202cfa/roles/bed020f3301c4f169f2a6d5795cd26f0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:16.092693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9abe81-18cd-4efa-8d14-1dac5511e5c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=74c9d19fb1534f8f8888e957d1007640, user_id=10247532345a4f75939950b803202cfa, role_id=bed020f3301c4f169f2a6d5795cd26f0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:16.094680 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9abe81-18cd-4efa-8d14-1dac5511e5c0 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:16.114700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 414/834] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:22:15 2022] PUT /identity/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/10247532345a4f75939950b803202cfa/roles/bed020f3301c4f169f2a6d5795cd26f0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:22:16.302894 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9454ed-ce57-4b37-9c3b-e826eba1363a None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:16.408451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9454ed-ce57-4b37-9c3b-e826eba1363a None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:16.447578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8716f-a13f-48b3-b52f-ee2f58e6bf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:16.448594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8716f-a13f-48b3-b52f-ee2f58e6bf9b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:16.449070 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8716f-a13f-48b3-b52f-ee2f58e6bf9b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:16.449535 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8716f-a13f-48b3-b52f-ee2f58e6bf9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:16.460994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8716f-a13f-48b3-b52f-ee2f58e6bf9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-8ca8716f-a13f-48b3-b52f-ee2f58e6bf9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:16.466044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:16.466995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:16.467829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:16.467829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:16.467829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:16.467829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:16.467829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:16.467829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:16.467829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:16.467829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:16.467829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:16.467829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:16.467829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:16.467829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:16.470989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 421/835] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:22:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:16.479184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9abe81-18cd-4efa-8d14-1dac5511e5c0 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:16.582344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9abe81-18cd-4efa-8d14-1dac5511e5c0 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:16.617537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95bd13-54e2-400e-8aee-d9170db69be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:16.618141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95bd13-54e2-400e-8aee-d9170db69be8 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:16.618412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95bd13-54e2-400e-8aee-d9170db69be8 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:16.618708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95bd13-54e2-400e-8aee-d9170db69be8 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:16.619355 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95bd13-54e2-400e-8aee-d9170db69be8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:16.619650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95bd13-54e2-400e-8aee-d9170db69be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:16.621019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95bd13-54e2-400e-8aee-d9170db69be8 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:16.622359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:16.630013 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 415/836] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:22:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:16.635610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8716f-a13f-48b3-b52f-ee2f58e6bf9b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:16.697780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:16.744793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8716f-a13f-48b3-b52f-ee2f58e6bf9b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:16.780707 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a01de4-c0c2-48b3-8843-00dde3ffd5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:16.781327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01de4-c0c2-48b3-8843-00dde3ffd5be None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:16.781602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01de4-c0c2-48b3-8843-00dde3ffd5be None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:16.781869 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01de4-c0c2-48b3-8843-00dde3ffd5be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:16.792237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a01de4-c0c2-48b3-8843-00dde3ffd5be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:16.793662 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a01de4-c0c2-48b3-8843-00dde3ffd5be None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-b7a01de4-c0c2-48b3-8843-00dde3ffd5be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:16.808483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:16.809401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:16.810277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:16.810277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:16.810277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:16.810277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 422/837] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:16.816975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95bd13-54e2-400e-8aee-d9170db69be8 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:16.921982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95bd13-54e2-400e-8aee-d9170db69be8 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:16.958616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dac54-622c-4d2a-9b4f-2cfb6f17e682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:16.959375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dac54-622c-4d2a-9b4f-2cfb6f17e682 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:16.959654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dac54-622c-4d2a-9b4f-2cfb6f17e682 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:16.959917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dac54-622c-4d2a-9b4f-2cfb6f17e682 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:16.960554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dac54-622c-4d2a-9b4f-2cfb6f17e682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:16.960847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dac54-622c-4d2a-9b4f-2cfb6f17e682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:16.962205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dac54-622c-4d2a-9b4f-2cfb6f17e682 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:16.978616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 416/838] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:16.980595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a01de4-c0c2-48b3-8843-00dde3ffd5be None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:17.090472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a01de4-c0c2-48b3-8843-00dde3ffd5be None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:17.103167 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:17.132939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e8a3a-ab3f-4f1b-be15-a22199c26565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:17.133573 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e8a3a-ab3f-4f1b-be15-a22199c26565 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:17.133852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e8a3a-ab3f-4f1b-be15-a22199c26565 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:17.134119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e8a3a-ab3f-4f1b-be15-a22199c26565 None admin] PATH_INFO: `/v3/users/swift` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:17.142332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e8a3a-ab3f-4f1b-be15-a22199c26565 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:17.143789 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e8a3a-ab3f-4f1b-be15-a22199c26565 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-ec7e8a3a-ab3f-4f1b-be15-a22199c26565 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:17.155211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:17.157116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:17.159048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:17.159048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:17.159048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:17.159048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:17.159048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:17.159048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:17.159048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:17.159048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:17.159048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 05:22:17.159048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:17.159048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 423/839] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:22:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:17.162361 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dac54-622c-4d2a-9b4f-2cfb6f17e682 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:17.207164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f9584-14d8-444d-91c9-8aee7ee90355 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:17.207457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f9584-14d8-444d-91c9-8aee7ee90355 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:17.207636 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f9584-14d8-444d-91c9-8aee7ee90355 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:17.209172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 424/840] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:22:17.213988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f427a-adac-4c0b-9785-4986c0af1c30 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:17.214270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f427a-adac-4c0b-9785-4986c0af1c30 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:17.214566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f427a-adac-4c0b-9785-4986c0af1c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:17.228293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:17.241447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-e89f427a-adac-4c0b-9785-4986c0af1c30 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:17.243762 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e89f427a-adac-4c0b-9785-4986c0af1c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:17.275871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dac54-622c-4d2a-9b4f-2cfb6f17e682 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:17.316273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a67829-c692-45b3-9b18-6b6e82b7b07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:17.316871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67829-c692-45b3-9b18-6b6e82b7b07e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:17.317305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67829-c692-45b3-9b18-6b6e82b7b07e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:17.317577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67829-c692-45b3-9b18-6b6e82b7b07e None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:17.318901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a67829-c692-45b3-9b18-6b6e82b7b07e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:17.319211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a67829-c692-45b3-9b18-6b6e82b7b07e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:17.320641 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a67829-c692-45b3-9b18-6b6e82b7b07e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:17.322535 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 425/841] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:17.349726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 417/842] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 16 05:22:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:17.351057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f427a-adac-4c0b-9785-4986c0af1c30 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:17.453600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:17.461808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f427a-adac-4c0b-9785-4986c0af1c30 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:17.502532 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42155-42f9-45cc-be0f-443a091ca20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:17.503146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42155-42f9-45cc-be0f-443a091ca20f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:17.503425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42155-42f9-45cc-be0f-443a091ca20f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:17.503695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42155-42f9-45cc-be0f-443a091ca20f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:17.578006 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c42155-42f9-45cc-be0f-443a091ca20f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:17.579483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c42155-42f9-45cc-be0f-443a091ca20f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:17.606595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a67829-c692-45b3-9b18-6b6e82b7b07e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:17.681840 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:17.685741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 426/843] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:22:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:22:17.694980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42155-42f9-45cc-be0f-443a091ca20f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:17.751581 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a67829-c692-45b3-9b18-6b6e82b7b07e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:17.781149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:17.810430 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42155-42f9-45cc-be0f-443a091ca20f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:17.810832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9d71a-5faa-4b6f-abef-3056c031d2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:17.811463 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9d71a-5faa-4b6f-abef-3056c031d2d3 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:17.811768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9d71a-5faa-4b6f-abef-3056c031d2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:17.812291 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9d71a-5faa-4b6f-abef-3056c031d2d3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:17.813145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9d71a-5faa-4b6f-abef-3056c031d2d3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:17.815475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9d71a-5faa-4b6f-abef-3056c031d2d3 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-41e9d71a-5faa-4b6f-abef-3056c031d2d3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:17.827043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:17.829824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:17.831757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 418/844] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:22:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:17.842535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9d71a-5faa-4b6f-abef-3056c031d2d3 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:17.862168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130a51a-b603-41fa-b63b-6b1754dd2ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:17.862948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130a51a-b603-41fa-b63b-6b1754dd2ab4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:17.863224 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130a51a-b603-41fa-b63b-6b1754dd2ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:17.863495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130a51a-b603-41fa-b63b-6b1754dd2ab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:17.878054 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130a51a-b603-41fa-b63b-6b1754dd2ab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:17.880435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130a51a-b603-41fa-b63b-6b1754dd2ab4 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-1130a51a-b603-41fa-b63b-6b1754dd2ab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:17.901776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:17.903723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:17.905240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:17.905240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:17.905240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:17.905240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 427/845] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:17.910618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130a51a-b603-41fa-b63b-6b1754dd2ab4 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:17.955921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9d71a-5faa-4b6f-abef-3056c031d2d3 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:17.987921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:18.002545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218394ea-ee08-4ef4-bbc5-ea57e4446e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:18.003767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218394ea-ee08-4ef4-bbc5-ea57e4446e79 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:18.004113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218394ea-ee08-4ef4-bbc5-ea57e4446e79 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:18.004448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218394ea-ee08-4ef4-bbc5-ea57e4446e79 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:18.005436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218394ea-ee08-4ef4-bbc5-ea57e4446e79 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:18.005802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218394ea-ee08-4ef4-bbc5-ea57e4446e79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:18.008433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218394ea-ee08-4ef4-bbc5-ea57e4446e79 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:18.018608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 419/846] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:22:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:18.020487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218394ea-ee08-4ef4-bbc5-ea57e4446e79 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:18.044150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130a51a-b603-41fa-b63b-6b1754dd2ab4 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:18.066270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:18.084309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138be00d-af2f-434c-a422-713f1c95df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:18.084906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138be00d-af2f-434c-a422-713f1c95df4a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:18.085181 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138be00d-af2f-434c-a422-713f1c95df4a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:18.085446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138be00d-af2f-434c-a422-713f1c95df4a None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:18.086080 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138be00d-af2f-434c-a422-713f1c95df4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:18.086376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138be00d-af2f-434c-a422-713f1c95df4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:18.087759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138be00d-af2f-434c-a422-713f1c95df4a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:18.105280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 428/847] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:18.105280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b8267-b904-4814-949b-5c9e16b6df98 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:18.105280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b8267-b904-4814-949b-5c9e16b6df98 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:18.105280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b8267-b904-4814-949b-5c9e16b6df98 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:18.107944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 429/848] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:18.108758 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b8267-b904-4814-949b-5c9e16b6df98 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:18.130586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218394ea-ee08-4ef4-bbc5-ea57e4446e79 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:18.173276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfd813-5eeb-4c66-935f-7a12d6b78b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:18.173898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfd813-5eeb-4c66-935f-7a12d6b78b77 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:18.174171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfd813-5eeb-4c66-935f-7a12d6b78b77 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:18.174459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfd813-5eeb-4c66-935f-7a12d6b78b77 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:18.175090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfd813-5eeb-4c66-935f-7a12d6b78b77 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:18.175390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfd813-5eeb-4c66-935f-7a12d6b78b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:18.176800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfd813-5eeb-4c66-935f-7a12d6b78b77 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:18.181540 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 420/849] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:22:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:18.182715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131535e-a3ff-4ab3-966e-d18d1eb5392e None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:18.182965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131535e-a3ff-4ab3-966e-d18d1eb5392e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:18.183234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131535e-a3ff-4ab3-966e-d18d1eb5392e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:18.203250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-8131535e-a3ff-4ab3-966e-d18d1eb5392e None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:18.204567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8131535e-a3ff-4ab3-966e-d18d1eb5392e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:18.254901 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b8267-b904-4814-949b-5c9e16b6df98 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:18.276265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:18.302554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 421/850] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:18.313697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a2ff6-e751-4f73-a356-0d2ea60ef84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:18.314398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a2ff6-e751-4f73-a356-0d2ea60ef84e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:18.314713 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a2ff6-e751-4f73-a356-0d2ea60ef84e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:18.314985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a2ff6-e751-4f73-a356-0d2ea60ef84e None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:18.323217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a2ff6-e751-4f73-a356-0d2ea60ef84e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:18.324790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a2ff6-e751-4f73-a356-0d2ea60ef84e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-9a7a2ff6-e751-4f73-a356-0d2ea60ef84e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:18.338154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:18.339152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:18.340032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:18.340032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:18.340032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:18.340032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:18.340032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:18.340032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:18.340032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:18.340032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:18.340032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 430/851] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:18.345605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131535e-a3ff-4ab3-966e-d18d1eb5392e None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:18.385827 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:18.454907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131535e-a3ff-4ab3-966e-d18d1eb5392e None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:18.492540 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085d404-6b62-45a4-b689-f300583cfae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:18.493503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d404-6b62-45a4-b689-f300583cfae5 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:18.493978 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d404-6b62-45a4-b689-f300583cfae5 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:18.494467 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d404-6b62-45a4-b689-f300583cfae5 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:18.495461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085d404-6b62-45a4-b689-f300583cfae5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:18.496023 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085d404-6b62-45a4-b689-f300583cfae5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:18.497683 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085d404-6b62-45a4-b689-f300583cfae5 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:18.498081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2360cb0-64fa-418e-84fa-46e2210a1edf None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:18.498366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2360cb0-64fa-418e-84fa-46e2210a1edf None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:18.498664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2360cb0-64fa-418e-84fa-46e2210a1edf None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:18.500784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 431/852] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:22:18.507852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29857d-82b1-43b4-b573-416042e7abf4 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:18.508361 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29857d-82b1-43b4-b573-416042e7abf4 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:18.508850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29857d-82b1-43b4-b573-416042e7abf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:18.510338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 422/853] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:18.516589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085d404-6b62-45a4-b689-f300583cfae5 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:18.532362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-1f29857d-82b1-43b4-b573-416042e7abf4 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:18.533723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1f29857d-82b1-43b4-b573-416042e7abf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:18.618799 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 432/854] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:18.623175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29857d-82b1-43b4-b573-416042e7abf4 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:18.633747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:18.642348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085d404-6b62-45a4-b689-f300583cfae5 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:18.690691 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3de95-e339-4f2f-b6a4-bf0a8ed01a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:18.691675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3de95-e339-4f2f-b6a4-bf0a8ed01a8e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:18.692227 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3de95-e339-4f2f-b6a4-bf0a8ed01a8e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:18.692693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3de95-e339-4f2f-b6a4-bf0a8ed01a8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:18.693622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3de95-e339-4f2f-b6a4-bf0a8ed01a8e None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=bae43204e3984619b4fdb64f36ef47ea) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:18.694127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3de95-e339-4f2f-b6a4-bf0a8ed01a8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:18.695815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3de95-e339-4f2f-b6a4-bf0a8ed01a8e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:18.706898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 423/855] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:22:18 2022] GET /identity/v3/role_assignments?user.id=bae43204e3984619b4fdb64f36ef47ea&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:18.737095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29857d-82b1-43b4-b573-416042e7abf4 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:18.738845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:18.777369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1bf8d-af8f-4681-bd2f-45bfe74db507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:18.777922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bf8d-af8f-4681-bd2f-45bfe74db507 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:18.778196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bf8d-af8f-4681-bd2f-45bfe74db507 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:18.778469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bf8d-af8f-4681-bd2f-45bfe74db507 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:18.779213 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1bf8d-af8f-4681-bd2f-45bfe74db507 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:18.781287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1bf8d-af8f-4681-bd2f-45bfe74db507 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-86a1bf8d-af8f-4681-bd2f-45bfe74db507 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:18.791020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:18.792053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:18.792942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 433/856] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Sep 16 05:22:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:18.800327 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3de95-e339-4f2f-b6a4-bf0a8ed01a8e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:18.889407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1bf8d-af8f-4681-bd2f-45bfe74db507 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:18.921751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3de95-e339-4f2f-b6a4-bf0a8ed01a8e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:18.964080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c9ada-b0cf-4005-8157-2d547dca2021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:18.964687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c9ada-b0cf-4005-8157-2d547dca2021 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:18.964962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c9ada-b0cf-4005-8157-2d547dca2021 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:18.965234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c9ada-b0cf-4005-8157-2d547dca2021 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:18.965909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c9ada-b0cf-4005-8157-2d547dca2021 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:18.966192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c9ada-b0cf-4005-8157-2d547dca2021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:18.968491 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c9ada-b0cf-4005-8157-2d547dca2021 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:18.976384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 424/857] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 05:22:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:18.982498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c9ada-b0cf-4005-8157-2d547dca2021 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:19.016170 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:19.028271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1bf8d-af8f-4681-bd2f-45bfe74db507 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:19.067540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7618d-26a2-4f40-8b24-769d149e6e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:19.068173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7618d-26a2-4f40-8b24-769d149e6e59 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:19.068452 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7618d-26a2-4f40-8b24-769d149e6e59 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:19.068720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7618d-26a2-4f40-8b24-769d149e6e59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:19.082868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7618d-26a2-4f40-8b24-769d149e6e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-f6b7618d-26a2-4f40-8b24-769d149e6e59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:19.090427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:19.091438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:19.092516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:19.092516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:19.092516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:19.092516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:19.092516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:19.092516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:19.092516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:19.092516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:19.092516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:19.092516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:19.092516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:22:19.092516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:19.094695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 434/858] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:22:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:19.098456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7618d-26a2-4f40-8b24-769d149e6e59 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:19.115328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c9ada-b0cf-4005-8157-2d547dca2021 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:19.136932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:19.159108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff271c-0746-4fa6-9fd9-c5d98dc34a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:19.159722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff271c-0746-4fa6-9fd9-c5d98dc34a1f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:19.160000 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff271c-0746-4fa6-9fd9-c5d98dc34a1f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:19.160269 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff271c-0746-4fa6-9fd9-c5d98dc34a1f None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:19.160956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff271c-0746-4fa6-9fd9-c5d98dc34a1f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:19.161256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff271c-0746-4fa6-9fd9-c5d98dc34a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:19.163246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff271c-0746-4fa6-9fd9-c5d98dc34a1f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:19.170585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 425/859] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 05:22:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:19.233486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7618d-26a2-4f40-8b24-769d149e6e59 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:19.283372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8331a-e485-4ba2-a854-68711681e0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:19.283925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8331a-e485-4ba2-a854-68711681e0fd None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:19.284201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8331a-e485-4ba2-a854-68711681e0fd None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:19.284521 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8331a-e485-4ba2-a854-68711681e0fd None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:19.285197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8331a-e485-4ba2-a854-68711681e0fd None admin] RBAC: Adding query filter params (name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:19.285498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8331a-e485-4ba2-a854-68711681e0fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:19.286957 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8331a-e485-4ba2-a854-68711681e0fd None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:19.297167 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 435/860] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:22:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:19.303229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff271c-0746-4fa6-9fd9-c5d98dc34a1f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:19.401102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:19.416030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff271c-0746-4fa6-9fd9-c5d98dc34a1f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:19.453562 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e421afd-03dd-47d4-8d6a-8c4108b0704a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:19.454603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e421afd-03dd-47d4-8d6a-8c4108b0704a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:19.455087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e421afd-03dd-47d4-8d6a-8c4108b0704a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:19.455560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e421afd-03dd-47d4-8d6a-8c4108b0704a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:19.467142 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e421afd-03dd-47d4-8d6a-8c4108b0704a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:19.468933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e421afd-03dd-47d4-8d6a-8c4108b0704a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-8e421afd-03dd-47d4-8d6a-8c4108b0704a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:19.484363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:19.485332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:19.486220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:19.486220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:19.486220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:19.488282 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 426/861] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:19.494037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8331a-e485-4ba2-a854-68711681e0fd None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:19.584942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:19.597343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8331a-e485-4ba2-a854-68711681e0fd None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:19.632742 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201e911-35f9-403a-9c24-bcf44b40a719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:19.633343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e911-35f9-403a-9c24-bcf44b40a719 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:19.633620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e911-35f9-403a-9c24-bcf44b40a719 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:19.633888 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e911-35f9-403a-9c24-bcf44b40a719 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:19.634540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201e911-35f9-403a-9c24-bcf44b40a719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:19.634856 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201e911-35f9-403a-9c24-bcf44b40a719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:19.636288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201e911-35f9-403a-9c24-bcf44b40a719 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:19.648338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 436/862] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:19.653768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e421afd-03dd-47d4-8d6a-8c4108b0704a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:19.765367 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e421afd-03dd-47d4-8d6a-8c4108b0704a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:19.800221 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d2d04-8449-41e1-804e-02c3c91e1648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:19.800893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d2d04-8449-41e1-804e-02c3c91e1648 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:19.801178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d2d04-8449-41e1-804e-02c3c91e1648 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:19.801450 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d2d04-8449-41e1-804e-02c3c91e1648 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:19.809102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d2d04-8449-41e1-804e-02c3c91e1648 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:19.810568 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d2d04-8449-41e1-804e-02c3c91e1648 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:19.813872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-d51d2d04-8449-41e1-804e-02c3c91e1648 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:19.823082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:19.824026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:19.824966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:19.824966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:19.824966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:19.824966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:19.824966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:19.824966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:19.824966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:19.824966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:19.824966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 05:22:19.824966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:19.824966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 427/863] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 05:22:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:19.832318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201e911-35f9-403a-9c24-bcf44b40a719 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:19.938879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201e911-35f9-403a-9c24-bcf44b40a719 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:19.974045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a79202-760a-4bd7-bc83-c620583f20b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:19.974680 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a79202-760a-4bd7-bc83-c620583f20b0 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:19.974958 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a79202-760a-4bd7-bc83-c620583f20b0 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:19.975229 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a79202-760a-4bd7-bc83-c620583f20b0 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:19.975965 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a79202-760a-4bd7-bc83-c620583f20b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:19.976268 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a79202-760a-4bd7-bc83-c620583f20b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:19.977707 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a79202-760a-4bd7-bc83-c620583f20b0 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:19.996570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 437/864] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 16 05:22:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:20.003826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d2d04-8449-41e1-804e-02c3c91e1648 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:20.113818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d2d04-8449-41e1-804e-02c3c91e1648 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:20.149202 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cfa8c-d393-4010-9d15-eb956c0f5bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:20.149801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cfa8c-d393-4010-9d15-eb956c0f5bcb None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:20.150078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cfa8c-d393-4010-9d15-eb956c0f5bcb None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:20.150347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cfa8c-d393-4010-9d15-eb956c0f5bcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:20.224581 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:20.225408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cfa8c-d393-4010-9d15-eb956c0f5bcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:20.227027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cfa8c-d393-4010-9d15-eb956c0f5bcb None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:20.333343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 428/865] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:22:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:22:20.338947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a79202-760a-4bd7-bc83-c620583f20b0 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:20.349188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:20.369200 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83858b2-5c52-4f1a-ab97-c7ad168420f6 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:20.369476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83858b2-5c52-4f1a-ab97-c7ad168420f6 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:20.369912 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83858b2-5c52-4f1a-ab97-c7ad168420f6 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:20.371699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 429/866] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:20.376446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69bab9-d9d4-4386-b9f1-2ffc8f14907f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:20.376726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69bab9-d9d4-4386-b9f1-2ffc8f14907f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:20.376991 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69bab9-d9d4-4386-b9f1-2ffc8f14907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:20.395042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-be69bab9-d9d4-4386-b9f1-2ffc8f14907f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:20.396490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-be69bab9-d9d4-4386-b9f1-2ffc8f14907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:20.455988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a79202-760a-4bd7-bc83-c620583f20b0 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:20.482622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 430/867] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:20.500317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4a489-5d93-49a5-835f-367a1255dd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:20.501261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4a489-5d93-49a5-835f-367a1255dd21 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:20.501766 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4a489-5d93-49a5-835f-367a1255dd21 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:20.502236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4a489-5d93-49a5-835f-367a1255dd21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:20.512995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4a489-5d93-49a5-835f-367a1255dd21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:20.515232 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4a489-5d93-49a5-835f-367a1255dd21 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-72a4a489-5d93-49a5-835f-367a1255dd21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:20.530375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:20.531383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:20.532270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:20.532270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:20.532270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:20.534292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 438/868] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:20.540021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69bab9-d9d4-4386-b9f1-2ffc8f14907f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:20.571844 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:20.644276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69bab9-d9d4-4386-b9f1-2ffc8f14907f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:20.682284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cbabe-2498-41ab-b3c7-31c025dd8162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:20.682923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cbabe-2498-41ab-b3c7-31c025dd8162 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:20.683211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cbabe-2498-41ab-b3c7-31c025dd8162 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:20.683451 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cbabe-2498-41ab-b3c7-31c025dd8162 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:20.684107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cbabe-2498-41ab-b3c7-31c025dd8162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:20.684407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cbabe-2498-41ab-b3c7-31c025dd8162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:20.685767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cbabe-2498-41ab-b3c7-31c025dd8162 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:20.698442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 431/869] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:20.704403 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4a489-5d93-49a5-835f-367a1255dd21 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:20.759802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cbabe-2498-41ab-b3c7-31c025dd8162 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:20.768025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:20.810849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4a489-5d93-49a5-835f-367a1255dd21 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:20.845862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9540f-cd86-4ed5-9f91-c99d8495a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:20.847200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9540f-cd86-4ed5-9f91-c99d8495a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:20.847646 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9540f-cd86-4ed5-9f91-c99d8495a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:20.848070 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9540f-cd86-4ed5-9f91-c99d8495a9c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:20.854803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9540f-cd86-4ed5-9f91-c99d8495a9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:20.856102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:20.856922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9540f-cd86-4ed5-9f91-c99d8495a9c0 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:20.867584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cbabe-2498-41ab-b3c7-31c025dd8162 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-53c9540f-cd86-4ed5-9f91-c99d8495a9c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:20.870204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:20.871288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:20.872363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:20.872363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:20.872363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:20.872363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:20.872363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:20.872363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:20.872363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:20.872363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:20.879617 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 439/870] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:20.880909 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9540f-cd86-4ed5-9f91-c99d8495a9c0 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:20.911490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d546d8-b7fe-4f1a-8e8b-5100047df180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:20.912385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d546d8-b7fe-4f1a-8e8b-5100047df180 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:20.912673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d546d8-b7fe-4f1a-8e8b-5100047df180 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:20.912946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d546d8-b7fe-4f1a-8e8b-5100047df180 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:20.913623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d546d8-b7fe-4f1a-8e8b-5100047df180 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:20.915849 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d546d8-b7fe-4f1a-8e8b-5100047df180 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:20.940431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 432/871] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:22:20 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:22:21.006483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21bd88-e6c6-4dae-a082-111c587fb00e None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:21.007197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21bd88-e6c6-4dae-a082-111c587fb00e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:21.007673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21bd88-e6c6-4dae-a082-111c587fb00e None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:21.008175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9540f-cd86-4ed5-9f91-c99d8495a9c0 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:21.014042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 433/872] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:22:21.016171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68672adc-536a-4714-a4c4-1933c4cfcb3c None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:21.016691 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68672adc-536a-4714-a4c4-1933c4cfcb3c None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:21.016956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68672adc-536a-4714-a4c4-1933c4cfcb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:21.040181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-68672adc-536a-4714-a4c4-1933c4cfcb3c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:21.042242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-68672adc-536a-4714-a4c4-1933c4cfcb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:21.045316 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:21.058457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783522a1-023a-437f-8a83-0880bd8d3c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:21.059135 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783522a1-023a-437f-8a83-0880bd8d3c11 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:21.059415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783522a1-023a-437f-8a83-0880bd8d3c11 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:21.059715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783522a1-023a-437f-8a83-0880bd8d3c11 None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:21.060519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783522a1-023a-437f-8a83-0880bd8d3c11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:21.062387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783522a1-023a-437f-8a83-0880bd8d3c11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:21.063855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783522a1-023a-437f-8a83-0880bd8d3c11 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:21.080248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 440/873] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:21.087459 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783522a1-023a-437f-8a83-0880bd8d3c11 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:21.137507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 434/874] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:21.210621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783522a1-023a-437f-8a83-0880bd8d3c11 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:21.259897 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7bb50-b54b-4d70-a900-244804119d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:21.260819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7bb50-b54b-4d70-a900-244804119d9c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:21.261304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7bb50-b54b-4d70-a900-244804119d9c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:21.261778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7bb50-b54b-4d70-a900-244804119d9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:21.262781 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7bb50-b54b-4d70-a900-244804119d9c None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=10247532345a4f75939950b803202cfa) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:21.263309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7bb50-b54b-4d70-a900-244804119d9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:21.265790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7bb50-b54b-4d70-a900-244804119d9c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:21.272440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 441/875] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:22:21 2022] GET /identity/v3/role_assignments?user.id=10247532345a4f75939950b803202cfa&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:21.414363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68672adc-536a-4714-a4c4-1933c4cfcb3c None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:21.509685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:21.530791 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68672adc-536a-4714-a4c4-1933c4cfcb3c None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:21.557222 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4a43-2efe-45d0-8447-a28820db4fcb None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:21.557898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4a43-2efe-45d0-8447-a28820db4fcb None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:21.558168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4a43-2efe-45d0-8447-a28820db4fcb None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:21.559687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 442/876] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:21.566251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5657cbe-820f-4917-a4a3-7275ddbbb490 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:21.566660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5657cbe-820f-4917-a4a3-7275ddbbb490 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:21.567032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5657cbe-820f-4917-a4a3-7275ddbbb490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:21.567946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91e44e-7836-43ec-adb6-36439395f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:21.568584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91e44e-7836-43ec-adb6-36439395f684 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:21.568864 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91e44e-7836-43ec-adb6-36439395f684 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:21.569138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91e44e-7836-43ec-adb6-36439395f684 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:21.569722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91e44e-7836-43ec-adb6-36439395f684 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:21.571140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91e44e-7836-43ec-adb6-36439395f684 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-9e91e44e-7836-43ec-adb6-36439395f684 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:21.581921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:21.582999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:21.583837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 435/877] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 05:22:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:21.589502 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91e44e-7836-43ec-adb6-36439395f684 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:21.594426 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c5657cbe-820f-4917-a4a3-7275ddbbb490 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:21.596360 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c5657cbe-820f-4917-a4a3-7275ddbbb490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:21.631351 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:21.690531 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 443/878] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:21.712167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91e44e-7836-43ec-adb6-36439395f684 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:21.748458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4bd2a-4fe5-46f7-969c-a8ce28878881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:21.749709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4bd2a-4fe5-46f7-969c-a8ce28878881 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:21.749994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4bd2a-4fe5-46f7-969c-a8ce28878881 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:21.750316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4bd2a-4fe5-46f7-969c-a8ce28878881 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:21.751033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4bd2a-4fe5-46f7-969c-a8ce28878881 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:21.751337 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4bd2a-4fe5-46f7-969c-a8ce28878881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:21.752724 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4bd2a-4fe5-46f7-969c-a8ce28878881 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:21.757835 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 436/879] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 05:22:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:21.763326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5657cbe-820f-4917-a4a3-7275ddbbb490 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:21.867991 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5657cbe-820f-4917-a4a3-7275ddbbb490 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:21.910460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a628c04-4815-4823-b3fb-0dbb48218a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:21.911090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a628c04-4815-4823-b3fb-0dbb48218a7a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:21.911363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a628c04-4815-4823-b3fb-0dbb48218a7a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:21.911629 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a628c04-4815-4823-b3fb-0dbb48218a7a None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:21.912262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a628c04-4815-4823-b3fb-0dbb48218a7a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:21.912557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a628c04-4815-4823-b3fb-0dbb48218a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:21.913911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a628c04-4815-4823-b3fb-0dbb48218a7a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:21.918860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 444/880] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 05:22:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:21.990657 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4bd2a-4fe5-46f7-969c-a8ce28878881 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:22.003513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:22.105025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4bd2a-4fe5-46f7-969c-a8ce28878881 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:22.142186 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710113f-0afc-4eab-a73a-d2a6b4ff6b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:22.142750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710113f-0afc-4eab-a73a-d2a6b4ff6b2e None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:22.143029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710113f-0afc-4eab-a73a-d2a6b4ff6b2e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:22.143297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710113f-0afc-4eab-a73a-d2a6b4ff6b2e None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:22.143943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710113f-0afc-4eab-a73a-d2a6b4ff6b2e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:22.145314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710113f-0afc-4eab-a73a-d2a6b4ff6b2e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:22.162323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 437/881] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:22:21 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:22:23.194204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23877716-1317-4f29-b12e-76df01b0a22b None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:23.194761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23877716-1317-4f29-b12e-76df01b0a22b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:23.194761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23877716-1317-4f29-b12e-76df01b0a22b None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:23.196373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 445/882] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:23.201708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208abc1-87c5-4edf-b700-ed7b1233c25d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:23.202803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208abc1-87c5-4edf-b700-ed7b1233c25d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:23.202883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208abc1-87c5-4edf-b700-ed7b1233c25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:23.225465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-f208abc1-87c5-4edf-b700-ed7b1233c25d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:23.226697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f208abc1-87c5-4edf-b700-ed7b1233c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:23.293611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:23.304930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 438/883] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:23.581436 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23877716-1317-4f29-b12e-76df01b0a22b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:23.584382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4e2e9-6c7b-411a-b1bb-9b06b9d2574a None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:23.584669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4e2e9-6c7b-411a-b1bb-9b06b9d2574a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:23.584937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4e2e9-6c7b-411a-b1bb-9b06b9d2574a None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:23.586390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 439/884] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:22:23.591213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a5fa9-48a9-411a-bb4c-d05ab511b418 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:23.591497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a5fa9-48a9-411a-bb4c-d05ab511b418 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:23.591764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a5fa9-48a9-411a-bb4c-d05ab511b418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:23.610609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-8f7a5fa9-48a9-411a-bb4c-d05ab511b418 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:23.611789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8f7a5fa9-48a9-411a-bb4c-d05ab511b418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:23.618575 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:23.699785 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23877716-1317-4f29-b12e-76df01b0a22b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:23.710628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 440/885] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:23.736551 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1a899-a80a-4554-b9f9-97e0716e8a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:23.737471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1a899-a80a-4554-b9f9-97e0716e8a9b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:23.737960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1a899-a80a-4554-b9f9-97e0716e8a9b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:23.738454 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1a899-a80a-4554-b9f9-97e0716e8a9b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:23.739276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1a899-a80a-4554-b9f9-97e0716e8a9b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:23.740848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1a899-a80a-4554-b9f9-97e0716e8a9b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-0fe1a899-a80a-4554-b9f9-97e0716e8a9b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:23.750620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:23.751594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 05:22:23.752420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:23.755056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 446/886] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:22:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:23.761085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a5fa9-48a9-411a-bb4c-d05ab511b418 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:23.870316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a5fa9-48a9-411a-bb4c-d05ab511b418 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:23.895762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:23.907866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa5c58-8a49-4e12-a2cb-2cb93bbe3aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:23.908766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa5c58-8a49-4e12-a2cb-2cb93bbe3aed None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:23.909252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa5c58-8a49-4e12-a2cb-2cb93bbe3aed None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:23.909725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa5c58-8a49-4e12-a2cb-2cb93bbe3aed None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:23.910595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa5c58-8a49-4e12-a2cb-2cb93bbe3aed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:23.911160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa5c58-8a49-4e12-a2cb-2cb93bbe3aed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:23.912730 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa5c58-8a49-4e12-a2cb-2cb93bbe3aed None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:23.918087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 441/887] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:22:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:23.924499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1a899-a80a-4554-b9f9-97e0716e8a9b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:23.991445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa5c58-8a49-4e12-a2cb-2cb93bbe3aed None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:24.043490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:24.052217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1a899-a80a-4554-b9f9-97e0716e8a9b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:24.090405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ab33a-a2c1-4077-8e7d-176ba9fa31fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:24.091422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ab33a-a2c1-4077-8e7d-176ba9fa31fd None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:24.091914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ab33a-a2c1-4077-8e7d-176ba9fa31fd None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:24.092449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ab33a-a2c1-4077-8e7d-176ba9fa31fd None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:24.093361 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ab33a-a2c1-4077-8e7d-176ba9fa31fd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:24.093854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ab33a-a2c1-4077-8e7d-176ba9fa31fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:24.095667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ab33a-a2c1-4077-8e7d-176ba9fa31fd None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:24.101385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 447/888] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:22:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:24.108842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ab33a-a2c1-4077-8e7d-176ba9fa31fd None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:24.119817 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa5c58-8a49-4e12-a2cb-2cb93bbe3aed None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:24.155296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa7e05-e102-4a61-8c61-c1026b4a0a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:24.156165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa7e05-e102-4a61-8c61-c1026b4a0a46 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:24.156445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa7e05-e102-4a61-8c61-c1026b4a0a46 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:24.156706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa7e05-e102-4a61-8c61-c1026b4a0a46 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:24.168201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa7e05-e102-4a61-8c61-c1026b4a0a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-30aa7e05-e102-4a61-8c61-c1026b4a0a46 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:24.173481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:24.174399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:24.175268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:24.175268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:24.175268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:24.175268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:24.175268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:24.175268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:24.175268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:24.175268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:24.175268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:24.175268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:24.175268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 05:22:24.175268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:24.175268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 442/889] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 16 05:22:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:24.176528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ba1f4-8579-48aa-9ab9-6e7fd8efb2ec None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:24.176528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ba1f4-8579-48aa-9ab9-6e7fd8efb2ec None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:24.176704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ba1f4-8579-48aa-9ab9-6e7fd8efb2ec None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:24.178106 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 443/890] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:24.182689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ba1f4-8579-48aa-9ab9-6e7fd8efb2ec None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:24.229004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ab33a-a2c1-4077-8e7d-176ba9fa31fd None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:24.237096 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:24.270417 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dbf1c-0392-4bfa-b2cf-32ba684b3da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:24.271539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dbf1c-0392-4bfa-b2cf-32ba684b3da1 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:24.271967 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dbf1c-0392-4bfa-b2cf-32ba684b3da1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:24.272424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dbf1c-0392-4bfa-b2cf-32ba684b3da1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:24.273132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dbf1c-0392-4bfa-b2cf-32ba684b3da1 None admin] RBAC: Adding query filter params (interface=public, service_id=b0532150f2f949c885e91a05a0f66e24, region_id=RegionOne) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:24.273721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dbf1c-0392-4bfa-b2cf-32ba684b3da1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:24.274984 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dbf1c-0392-4bfa-b2cf-32ba684b3da1 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:24.286944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 448/891] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 05:22:24 2022] GET /identity/v3/endpoints?service_id=b0532150f2f949c885e91a05a0f66e24&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:24.286944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70396b55-6ec8-4dbd-aea3-3e6693a806b5 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:24.286944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70396b55-6ec8-4dbd-aea3-3e6693a806b5 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:24.286944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70396b55-6ec8-4dbd-aea3-3e6693a806b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:24.299924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ba1f4-8579-48aa-9ab9-6e7fd8efb2ec None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:24.305578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-70396b55-6ec8-4dbd-aea3-3e6693a806b5 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:24.306845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-70396b55-6ec8-4dbd-aea3-3e6693a806b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:24.329481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:24.336727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c102b-ab8d-4bd5-bd8e-dfb1ab0f555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:24.337334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c102b-ab8d-4bd5-bd8e-dfb1ab0f555c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:24.337608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c102b-ab8d-4bd5-bd8e-dfb1ab0f555c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:24.337925 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c102b-ab8d-4bd5-bd8e-dfb1ab0f555c None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:24.338633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c102b-ab8d-4bd5-bd8e-dfb1ab0f555c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:24.338934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c102b-ab8d-4bd5-bd8e-dfb1ab0f555c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:24.340305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c102b-ab8d-4bd5-bd8e-dfb1ab0f555c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:24.348534 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 444/892] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 05:22:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:24.349202 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c102b-ab8d-4bd5-bd8e-dfb1ab0f555c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:24.387140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 449/893] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:24.388284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70396b55-6ec8-4dbd-aea3-3e6693a806b5 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:24.473607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c102b-ab8d-4bd5-bd8e-dfb1ab0f555c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:24.484643 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:24.491694 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70396b55-6ec8-4dbd-aea3-3e6693a806b5 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:24.516223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd4c9c-1de6-4dd7-8cba-6a504a7c50d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:24.516830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4c9c-1de6-4dd7-8cba-6a504a7c50d3 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:24.517117 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4c9c-1de6-4dd7-8cba-6a504a7c50d3 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:24.517388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4c9c-1de6-4dd7-8cba-6a504a7c50d3 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:24.517997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd4c9c-1de6-4dd7-8cba-6a504a7c50d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:24.519402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd4c9c-1de6-4dd7-8cba-6a504a7c50d3 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:24.525649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 445/894] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 05:22:24 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:22:24.526982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdad6e-a397-420f-925f-62a558ceff44 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:24.527264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdad6e-a397-420f-925f-62a558ceff44 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:24.527541 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdad6e-a397-420f-925f-62a558ceff44 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:24.528753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 446/895] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:24.534612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4496c7-d758-4a3e-b1d4-adaf873feb80 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:24.534894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4496c7-d758-4a3e-b1d4-adaf873feb80 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:24.535365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4496c7-d758-4a3e-b1d4-adaf873feb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:24.540718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230f479-06e7-4215-9eb0-e093bc0e8ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:24.541727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230f479-06e7-4215-9eb0-e093bc0e8ce2 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:24.542199 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230f479-06e7-4215-9eb0-e093bc0e8ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:24.542720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230f479-06e7-4215-9eb0-e093bc0e8ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:24.555434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-be4496c7-d758-4a3e-b1d4-adaf873feb80 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:24.555666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230f479-06e7-4215-9eb0-e093bc0e8ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:24.556702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-be4496c7-d758-4a3e-b1d4-adaf873feb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:24.557614 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230f479-06e7-4215-9eb0-e093bc0e8ce2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-a230f479-06e7-4215-9eb0-e093bc0e8ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:24.578654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:24.579772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:24.580756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:24.580756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:24.580756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:24.581546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 450/896] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:24.588545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230f479-06e7-4215-9eb0-e093bc0e8ce2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:24.602009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:24.656656 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 447/897] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:24.657951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4496c7-d758-4a3e-b1d4-adaf873feb80 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:24.724542 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230f479-06e7-4215-9eb0-e093bc0e8ce2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:24.768617 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1245af-0570-4b60-b7c0-b0ca31e40805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:24.769588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1245af-0570-4b60-b7c0-b0ca31e40805 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:24.770177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1245af-0570-4b60-b7c0-b0ca31e40805 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:24.770701 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1245af-0570-4b60-b7c0-b0ca31e40805 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:24.771560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1245af-0570-4b60-b7c0-b0ca31e40805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:24.771860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1245af-0570-4b60-b7c0-b0ca31e40805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:24.773228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1245af-0570-4b60-b7c0-b0ca31e40805 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:24.784075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4496c7-d758-4a3e-b1d4-adaf873feb80 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:24.786657 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:24.788835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 451/898] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:24.795489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1245af-0570-4b60-b7c0-b0ca31e40805 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:24.822973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb3390-0827-4b19-bc50-b7c3f1db8992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:24.824369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb3390-0827-4b19-bc50-b7c3f1db8992 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:24.824949 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb3390-0827-4b19-bc50-b7c3f1db8992 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:24.825491 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb3390-0827-4b19-bc50-b7c3f1db8992 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:24.826587 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb3390-0827-4b19-bc50-b7c3f1db8992 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:24.829356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb3390-0827-4b19-bc50-b7c3f1db8992 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:24.851527 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 448/899] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:22:24 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:22:24.880232 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:24.926260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1245af-0570-4b60-b7c0-b0ca31e40805 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:24.933346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb3390-0827-4b19-bc50-b7c3f1db8992 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:24.978828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd26b5-339c-41a5-9218-575fca291266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:24.979408 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd26b5-339c-41a5-9218-575fca291266 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:24.979687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd26b5-339c-41a5-9218-575fca291266 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:24.979958 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd26b5-339c-41a5-9218-575fca291266 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:24.989524 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd26b5-339c-41a5-9218-575fca291266 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:24.991152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd26b5-339c-41a5-9218-575fca291266 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-0bcd26b5-339c-41a5-9218-575fca291266 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:25.006541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:25.007564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:25.008514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:25.008514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:25.008514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:25.008514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:25.008514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:25.008514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:25.008514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:25.008514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:25.008514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 05:22:25.008514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:25.013545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 452/900] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 05:22:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:25.015327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd26b5-339c-41a5-9218-575fca291266 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:25.075873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb3390-0827-4b19-bc50-b7c3f1db8992 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:25.113322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293445f-eccb-4e48-a1c6-a1e119a83f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:25.114064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293445f-eccb-4e48-a1c6-a1e119a83f8c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:25.114407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293445f-eccb-4e48-a1c6-a1e119a83f8c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:25.114838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293445f-eccb-4e48-a1c6-a1e119a83f8c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:25.115664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293445f-eccb-4e48-a1c6-a1e119a83f8c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:25.116922 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293445f-eccb-4e48-a1c6-a1e119a83f8c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-d293445f-eccb-4e48-a1c6-a1e119a83f8c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:25.127344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:25.128369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:25.129613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 449/901] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Sep 16 05:22:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:25.134091 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293445f-eccb-4e48-a1c6-a1e119a83f8c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:25.163757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd26b5-339c-41a5-9218-575fca291266 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:25.173998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:25.189021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:25.209281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c3e90-521d-439c-944e-659482824a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:25.209881 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c3e90-521d-439c-944e-659482824a7f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:25.210158 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c3e90-521d-439c-944e-659482824a7f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:25.210426 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c3e90-521d-439c-944e-659482824a7f None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:25.211197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c3e90-521d-439c-944e-659482824a7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:25.211501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c3e90-521d-439c-944e-659482824a7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:25.212935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c3e90-521d-439c-944e-659482824a7f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:25.234627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 453/902] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 16 05:22:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:25.242784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c3e90-521d-439c-944e-659482824a7f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:25.283308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293445f-eccb-4e48-a1c6-a1e119a83f8c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:25.324575 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff67c3-8055-4594-9f05-03a84ef0ec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:25.325678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff67c3-8055-4594-9f05-03a84ef0ec38 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:25.326305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff67c3-8055-4594-9f05-03a84ef0ec38 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:25.326819 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff67c3-8055-4594-9f05-03a84ef0ec38 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:25.327982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff67c3-8055-4594-9f05-03a84ef0ec38 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:25.328293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff67c3-8055-4594-9f05-03a84ef0ec38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:25.329692 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff67c3-8055-4594-9f05-03a84ef0ec38 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:25.336704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 450/903] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 05:22:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:25.343134 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff67c3-8055-4594-9f05-03a84ef0ec38 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:25.366895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c3e90-521d-439c-944e-659482824a7f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:25.410593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422aebc-8c9e-49cf-ad79-b235296f6c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:25.411280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422aebc-8c9e-49cf-ad79-b235296f6c69 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:25.411589 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422aebc-8c9e-49cf-ad79-b235296f6c69 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:25.411864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422aebc-8c9e-49cf-ad79-b235296f6c69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:25.468559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:25.472043 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:25.484183 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff67c3-8055-4594-9f05-03a84ef0ec38 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:25.500053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422aebc-8c9e-49cf-ad79-b235296f6c69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:25.501862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422aebc-8c9e-49cf-ad79-b235296f6c69 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:25.525275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d541cd-5c10-4309-8bf3-e631d36185ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:25.525965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d541cd-5c10-4309-8bf3-e631d36185ea None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:25.526320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d541cd-5c10-4309-8bf3-e631d36185ea None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:25.526692 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d541cd-5c10-4309-8bf3-e631d36185ea None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:25.527388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d541cd-5c10-4309-8bf3-e631d36185ea None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:25.527761 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d541cd-5c10-4309-8bf3-e631d36185ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:25.529233 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d541cd-5c10-4309-8bf3-e631d36185ea None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:25.539365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 451/904] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 05:22:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:25.540273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d541cd-5c10-4309-8bf3-e631d36185ea None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:25.628219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 454/905] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:22:25 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 05:22:25.633399 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422aebc-8c9e-49cf-ad79-b235296f6c69 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:25.656224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d541cd-5c10-4309-8bf3-e631d36185ea None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:25.692897 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4dff0-2848-4b56-bd3b-bfc67fff182d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:25.693870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4dff0-2848-4b56-bd3b-bfc67fff182d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:25.694358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4dff0-2848-4b56-bd3b-bfc67fff182d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:25.694894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4dff0-2848-4b56-bd3b-bfc67fff182d None admin] PATH_INFO: `/v3/endpoints` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:25.695914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4dff0-2848-4b56-bd3b-bfc67fff182d None admin] RBAC: Adding query filter params (interface=public, service_id=eb4cb9979742414cbb900a72ad1ff129, region_id=RegionOne) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:25.696440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4dff0-2848-4b56-bd3b-bfc67fff182d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:25.698191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4dff0-2848-4b56-bd3b-bfc67fff182d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:25.711846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 452/906] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 05:22:25 2022] GET /identity/v3/endpoints?service_id=eb4cb9979742414cbb900a72ad1ff129&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:25.713123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4dff0-2848-4b56-bd3b-bfc67fff182d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:25.727642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:25.739890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:25.754675 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422aebc-8c9e-49cf-ad79-b235296f6c69 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:25.797778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027c90f-b441-4ce4-b7fc-0f2f2b64a034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:25.798998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027c90f-b441-4ce4-b7fc-0f2f2b64a034 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:25.800287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027c90f-b441-4ce4-b7fc-0f2f2b64a034 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:25.800797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027c90f-b441-4ce4-b7fc-0f2f2b64a034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:25.816238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027c90f-b441-4ce4-b7fc-0f2f2b64a034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:25.818793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027c90f-b441-4ce4-b7fc-0f2f2b64a034 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-0027c90f-b441-4ce4-b7fc-0f2f2b64a034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:25.835552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:25.836580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:25.837475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:25.837475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:25.837475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:25.841656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 455/907] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:25.842565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027c90f-b441-4ce4-b7fc-0f2f2b64a034 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:25.843385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4dff0-2848-4b56-bd3b-bfc67fff182d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:25.894067 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad69bc5-090c-4cd0-842a-db152a0f1769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:25.895329 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad69bc5-090c-4cd0-842a-db152a0f1769 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:25.896117 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad69bc5-090c-4cd0-842a-db152a0f1769 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:25.896614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad69bc5-090c-4cd0-842a-db152a0f1769 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:25.897860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad69bc5-090c-4cd0-842a-db152a0f1769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:25.899491 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad69bc5-090c-4cd0-842a-db152a0f1769 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:25.915204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 453/908] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 05:22:25 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:22:25.960919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027c90f-b441-4ce4-b7fc-0f2f2b64a034 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:25.992773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:25.999578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522205d-12a8-4e64-9c5c-8d1e5190bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:26.000238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522205d-12a8-4e64-9c5c-8d1e5190bc22 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:26.000525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522205d-12a8-4e64-9c5c-8d1e5190bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:26.000800 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522205d-12a8-4e64-9c5c-8d1e5190bc22 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:26.001451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522205d-12a8-4e64-9c5c-8d1e5190bc22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:26.001758 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522205d-12a8-4e64-9c5c-8d1e5190bc22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:26.003232 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522205d-12a8-4e64-9c5c-8d1e5190bc22 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:26.017509 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 456/909] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:26.023697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad69bc5-090c-4cd0-842a-db152a0f1769 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:26.119031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:26.139526 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad69bc5-090c-4cd0-842a-db152a0f1769 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:26.175891 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc2c99-5f01-4c4a-ab0d-1d62aae51c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:26.176523 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc2c99-5f01-4c4a-ab0d-1d62aae51c8a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:26.176803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc2c99-5f01-4c4a-ab0d-1d62aae51c8a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:26.177076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc2c99-5f01-4c4a-ab0d-1d62aae51c8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:26.184287 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc2c99-5f01-4c4a-ab0d-1d62aae51c8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:26.185816 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc2c99-5f01-4c4a-ab0d-1d62aae51c8a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-d1fc2c99-5f01-4c4a-ab0d-1d62aae51c8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:26.198435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:26.199392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:26.200373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:26.200373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:26.200373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:26.200373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:26.200373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:26.200373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:26.200373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:26.200373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:26.200373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 454/910] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:26.206192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522205d-12a8-4e64-9c5c-8d1e5190bc22 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:26.312489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522205d-12a8-4e64-9c5c-8d1e5190bc22 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:26.349384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2aac-03dc-445d-8858-28d276f7476c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:26.349988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2aac-03dc-445d-8858-28d276f7476c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:26.350262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2aac-03dc-445d-8858-28d276f7476c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:26.350549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2aac-03dc-445d-8858-28d276f7476c None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:26.351241 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2aac-03dc-445d-8858-28d276f7476c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:26.351541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2aac-03dc-445d-8858-28d276f7476c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:26.352971 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2aac-03dc-445d-8858-28d276f7476c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:26.365600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 457/911] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:26.371554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc2c99-5f01-4c4a-ab0d-1d62aae51c8a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:26.480467 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc2c99-5f01-4c4a-ab0d-1d62aae51c8a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:26.518219 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc04c83-2ba4-46d1-954c-27b46c8e75dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:26.519255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc04c83-2ba4-46d1-954c-27b46c8e75dc None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:26.519740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc04c83-2ba4-46d1-954c-27b46c8e75dc None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:26.520226 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc04c83-2ba4-46d1-954c-27b46c8e75dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:26.521160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc04c83-2ba4-46d1-954c-27b46c8e75dc None admin] RBAC: Adding query filter params (role.id=11289567b2a34360b50a87f6edc79703, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=10247532345a4f75939950b803202cfa) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:26.521673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc04c83-2ba4-46d1-954c-27b46c8e75dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:26.523496 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc04c83-2ba4-46d1-954c-27b46c8e75dc None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:26.529837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 455/912] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:22:26 2022] GET /identity/v3/role_assignments?user.id=10247532345a4f75939950b803202cfa&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=11289567b2a34360b50a87f6edc79703 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:26.789569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7501-6bee-40d2-92ba-00d3f22c30f1 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:26.789754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7501-6bee-40d2-92ba-00d3f22c30f1 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:26.790041 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7501-6bee-40d2-92ba-00d3f22c30f1 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:26.791710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 458/913] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:26.797680 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dede31f-4bbc-4f18-91b8-4e3b650fef19 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:26.797964 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dede31f-4bbc-4f18-91b8-4e3b650fef19 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:26.798233 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dede31f-4bbc-4f18-91b8-4e3b650fef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:26.816937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-5dede31f-4bbc-4f18-91b8-4e3b650fef19 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:26.818128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5dede31f-4bbc-4f18-91b8-4e3b650fef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:26.820193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:26.891555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 456/914] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:27.107448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d86bb-1f20-4237-8a85-6c717983b6f4 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:27.107748 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d86bb-1f20-4237-8a85-6c717983b6f4 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:27.108748 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d86bb-1f20-4237-8a85-6c717983b6f4 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:27.110101 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 459/915] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:27.115487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207a666-de6e-4e7d-a7ed-c80c44827eea None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:27.115770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207a666-de6e-4e7d-a7ed-c80c44827eea None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:27.116033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207a666-de6e-4e7d-a7ed-c80c44827eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:27.134533 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-8207a666-de6e-4e7d-a7ed-c80c44827eea None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:27.135719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8207a666-de6e-4e7d-a7ed-c80c44827eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:27.169251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d86bb-1f20-4237-8a85-6c717983b6f4 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:27.207327 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 457/916] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:27.228618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:27.281099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d86bb-1f20-4237-8a85-6c717983b6f4 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:27.316387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35270399-1f6c-4e8a-9fe0-3808a437499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:27.317027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35270399-1f6c-4e8a-9fe0-3808a437499b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:27.317287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35270399-1f6c-4e8a-9fe0-3808a437499b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:27.317557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35270399-1f6c-4e8a-9fe0-3808a437499b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:27.318145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35270399-1f6c-4e8a-9fe0-3808a437499b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:27.319549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35270399-1f6c-4e8a-9fe0-3808a437499b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-35270399-1f6c-4e8a-9fe0-3808a437499b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:27.329458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:27.330455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:27.331320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 460/917] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:22:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:27.336677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207a666-de6e-4e7d-a7ed-c80c44827eea None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:27.405595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:27.447879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207a666-de6e-4e7d-a7ed-c80c44827eea None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:27.483165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c511383-006b-42e3-9b13-3c9a59f0c31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:27.484065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c511383-006b-42e3-9b13-3c9a59f0c31d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:27.484584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c511383-006b-42e3-9b13-3c9a59f0c31d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:27.485061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c511383-006b-42e3-9b13-3c9a59f0c31d None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:27.485915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c511383-006b-42e3-9b13-3c9a59f0c31d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:27.486432 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c511383-006b-42e3-9b13-3c9a59f0c31d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:27.488050 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c511383-006b-42e3-9b13-3c9a59f0c31d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:27.492937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35270399-1f6c-4e8a-9fe0-3808a437499b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:27.493525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 458/918] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:22:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:27.500250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c511383-006b-42e3-9b13-3c9a59f0c31d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:27.605962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35270399-1f6c-4e8a-9fe0-3808a437499b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:27.618243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c511383-006b-42e3-9b13-3c9a59f0c31d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:27.626948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:27.648337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22802076-6ba5-4530-8fa6-8344183bab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:27.648973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22802076-6ba5-4530-8fa6-8344183bab58 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:27.649248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22802076-6ba5-4530-8fa6-8344183bab58 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:27.649516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22802076-6ba5-4530-8fa6-8344183bab58 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:27.650099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22802076-6ba5-4530-8fa6-8344183bab58 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:27.651518 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22802076-6ba5-4530-8fa6-8344183bab58 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:27.657345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-22802076-6ba5-4530-8fa6-8344183bab58 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:27.661492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:27.662543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:27.663385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 461/919] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 05:22:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:27.667186 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c8d7c-eee3-474c-bef4-e1d6f6939432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:27.667790 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c8d7c-eee3-474c-bef4-e1d6f6939432 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:27.668069 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c8d7c-eee3-474c-bef4-e1d6f6939432 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:27.668335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c8d7c-eee3-474c-bef4-e1d6f6939432 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:27.674529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c8d7c-eee3-474c-bef4-e1d6f6939432 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:27.674529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c8d7c-eee3-474c-bef4-e1d6f6939432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:27.674752 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22802076-6ba5-4530-8fa6-8344183bab58 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:27.674836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c8d7c-eee3-474c-bef4-e1d6f6939432 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:27.681350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 459/920] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 05:22:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:27.682395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c8d7c-eee3-474c-bef4-e1d6f6939432 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:27.781301 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22802076-6ba5-4530-8fa6-8344183bab58 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:27.800051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c8d7c-eee3-474c-bef4-e1d6f6939432 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:27.820262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2487b-c4a8-4c5a-a4ce-81c9180b692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:27.821380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2487b-c4a8-4c5a-a4ce-81c9180b692a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:27.821809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2487b-c4a8-4c5a-a4ce-81c9180b692a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:27.822492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2487b-c4a8-4c5a-a4ce-81c9180b692a None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:27.823684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2487b-c4a8-4c5a-a4ce-81c9180b692a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:27.824143 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2487b-c4a8-4c5a-a4ce-81c9180b692a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:27.825690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2487b-c4a8-4c5a-a4ce-81c9180b692a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:27.838939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 462/921] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 05:22:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:27.840154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2487b-c4a8-4c5a-a4ce-81c9180b692a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:27.857374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a21c8e-0ae0-4b43-8e35-6ebbbdd154cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:27.858007 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a21c8e-0ae0-4b43-8e35-6ebbbdd154cd None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:27.858280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a21c8e-0ae0-4b43-8e35-6ebbbdd154cd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:27.858584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a21c8e-0ae0-4b43-8e35-6ebbbdd154cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:27.859257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a21c8e-0ae0-4b43-8e35-6ebbbdd154cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:27.860630 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a21c8e-0ae0-4b43-8e35-6ebbbdd154cd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:27.885674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 460/922] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:22:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:22:27.902831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:27.974182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2487b-c4a8-4c5a-a4ce-81c9180b692a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:28.028045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6644118-07c0-406b-b0f1-52756adc2dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:28.029113 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6644118-07c0-406b-b0f1-52756adc2dda None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:28.030177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6644118-07c0-406b-b0f1-52756adc2dda None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:28.030714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6644118-07c0-406b-b0f1-52756adc2dda None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:28.031509 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6644118-07c0-406b-b0f1-52756adc2dda None admin] RBAC: Adding query filter params (type=object-store) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:28.032289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6644118-07c0-406b-b0f1-52756adc2dda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:28.034845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6644118-07c0-406b-b0f1-52756adc2dda None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:28.041227 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 463/923] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 05:22:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:28.048260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a21c8e-0ae0-4b43-8e35-6ebbbdd154cd None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:28.110433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:28.163955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a21c8e-0ae0-4b43-8e35-6ebbbdd154cd None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:28.199905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f0880-dee7-45c0-80f2-c0f61e745615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:28.200765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0880-dee7-45c0-80f2-c0f61e745615 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:28.201201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0880-dee7-45c0-80f2-c0f61e745615 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:28.201740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0880-dee7-45c0-80f2-c0f61e745615 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:28.202611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f0880-dee7-45c0-80f2-c0f61e745615 None admin] RBAC: Adding query filter params (interface=public, service_id=d7c6af7abd1a42bb8a1b441e5faf5e71, region_id=RegionOne) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:28.203083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f0880-dee7-45c0-80f2-c0f61e745615 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:28.204602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f0880-dee7-45c0-80f2-c0f61e745615 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:28.210347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 461/924] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 05:22:28 2022] GET /identity/v3/endpoints?service_id=d7c6af7abd1a42bb8a1b441e5faf5e71&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:28.216320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6644118-07c0-406b-b0f1-52756adc2dda None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:28.331779 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6644118-07c0-406b-b0f1-52756adc2dda None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:28.334186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:28.367632 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0109188-e9d5-4b2d-84fc-50ab95b6ebc5 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:28.368021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0109188-e9d5-4b2d-84fc-50ab95b6ebc5 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:28.368393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0109188-e9d5-4b2d-84fc-50ab95b6ebc5 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:28.368499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed3829-8693-4f4d-bbf0-ee617671ae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:28.369108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed3829-8693-4f4d-bbf0-ee617671ae16 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:28.369400 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed3829-8693-4f4d-bbf0-ee617671ae16 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:28.369681 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed3829-8693-4f4d-bbf0-ee617671ae16 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:28.370056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 462/925] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:22:28.370296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed3829-8693-4f4d-bbf0-ee617671ae16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:28.371703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed3829-8693-4f4d-bbf0-ee617671ae16 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:28.375843 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c050bb-d9c3-4312-a5d8-67bfeeb731a4 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:28.376125 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c050bb-d9c3-4312-a5d8-67bfeeb731a4 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:28.376400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c050bb-d9c3-4312-a5d8-67bfeeb731a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:28.383065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 464/926] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 05:22:28 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:22:28.407591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-d6c050bb-d9c3-4312-a5d8-67bfeeb731a4 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:28.408830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d6c050bb-d9c3-4312-a5d8-67bfeeb731a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:28.499223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 463/927] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:28.722415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa469b3-befd-4c9a-bfef-171d37f7a513 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:28.722775 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa469b3-befd-4c9a-bfef-171d37f7a513 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:28.723086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa469b3-befd-4c9a-bfef-171d37f7a513 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:28.724700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 465/928] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:28.729960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fadd21-4007-4686-8f35-42e5d18cd457 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:28.730501 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fadd21-4007-4686-8f35-42e5d18cd457 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:28.730996 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fadd21-4007-4686-8f35-42e5d18cd457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:28.750005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-f2fadd21-4007-4686-8f35-42e5d18cd457 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:28.751539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f2fadd21-4007-4686-8f35-42e5d18cd457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:28.774655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa469b3-befd-4c9a-bfef-171d37f7a513 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:28.799026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:28.825341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 464/929] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:28.903184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa469b3-befd-4c9a-bfef-171d37f7a513 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:28.938967 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5742a39-1231-4715-95fc-1843032e647e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:28.939591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5742a39-1231-4715-95fc-1843032e647e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:28.939866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5742a39-1231-4715-95fc-1843032e647e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:28.940135 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5742a39-1231-4715-95fc-1843032e647e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:28.940713 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5742a39-1231-4715-95fc-1843032e647e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:28.942065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5742a39-1231-4715-95fc-1843032e647e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-a5742a39-1231-4715-95fc-1843032e647e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:28.950996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:28.951964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 05:22:28.952970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:28.957049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 466/930] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Sep 16 05:22:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:28.958610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fadd21-4007-4686-8f35-42e5d18cd457 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:29.061901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fadd21-4007-4686-8f35-42e5d18cd457 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:29.097421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83586d28-83e7-4e21-87f2-763b7401e702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:29.098028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83586d28-83e7-4e21-87f2-763b7401e702 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:29.098302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83586d28-83e7-4e21-87f2-763b7401e702 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:29.098595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83586d28-83e7-4e21-87f2-763b7401e702 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:29.099220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83586d28-83e7-4e21-87f2-763b7401e702 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:29.099516 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83586d28-83e7-4e21-87f2-763b7401e702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:29.100872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83586d28-83e7-4e21-87f2-763b7401e702 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:29.110446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 465/931] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 05:22:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:29.111516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5742a39-1231-4715-95fc-1843032e647e None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:29.114726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83586d28-83e7-4e21-87f2-763b7401e702 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:29.147589 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:29.176053 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:29.236289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5742a39-1231-4715-95fc-1843032e647e None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:29.242623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83586d28-83e7-4e21-87f2-763b7401e702 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:29.280920 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7e0ee-ff82-4831-a295-b851764a5995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:29.281552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e0ee-ff82-4831-a295-b851764a5995 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:29.281821 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e0ee-ff82-4831-a295-b851764a5995 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:29.282083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e0ee-ff82-4831-a295-b851764a5995 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:29.282651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9eabf-8486-4445-8389-b21f1c5c4392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:29.283538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9eabf-8486-4445-8389-b21f1c5c4392 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:29.284115 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9eabf-8486-4445-8389-b21f1c5c4392 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:29.284623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9eabf-8486-4445-8389-b21f1c5c4392 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:29.285509 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9eabf-8486-4445-8389-b21f1c5c4392 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:29.286014 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9eabf-8486-4445-8389-b21f1c5c4392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:29.287687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9eabf-8486-4445-8389-b21f1c5c4392 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:29.293680 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 466/932] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 05:22:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:29.294670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7e0ee-ff82-4831-a295-b851764a5995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:29.299371 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9eabf-8486-4445-8389-b21f1c5c4392 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-c9a7e0ee-ff82-4831-a295-b851764a5995 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:29.300469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:29.301406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:29.302279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:29.302279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:29.302279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:29.302279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:29.302279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:29.302279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:29.302279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:29.302279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:29.302279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:29.302279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:29.302279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 05:22:29.302279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:29.305153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 467/933] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 16 05:22:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:29.314660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7e0ee-ff82-4831-a295-b851764a5995 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:29.402944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:29.414170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7e0ee-ff82-4831-a295-b851764a5995 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:29.428404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9eabf-8486-4445-8389-b21f1c5c4392 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:29.432197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:29.450944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf202e9-bcb3-45da-909b-13b66cca4608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:29.452918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf202e9-bcb3-45da-909b-13b66cca4608 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:29.453713 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf202e9-bcb3-45da-909b-13b66cca4608 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:29.454416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf202e9-bcb3-45da-909b-13b66cca4608 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:29.455538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf202e9-bcb3-45da-909b-13b66cca4608 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:29.456188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf202e9-bcb3-45da-909b-13b66cca4608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:29.458132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf202e9-bcb3-45da-909b-13b66cca4608 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:29.473284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 468/934] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 05:22:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:29.474532 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf202e9-bcb3-45da-909b-13b66cca4608 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:29.477219 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067df15c-2dad-4499-a3a0-01ebe472e98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:29.478091 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067df15c-2dad-4499-a3a0-01ebe472e98c None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:29.478366 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067df15c-2dad-4499-a3a0-01ebe472e98c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:29.478662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067df15c-2dad-4499-a3a0-01ebe472e98c None admin] PATH_INFO: `/v3/endpoints` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:29.480226 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067df15c-2dad-4499-a3a0-01ebe472e98c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:29.481605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067df15c-2dad-4499-a3a0-01ebe472e98c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:29.510613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 467/935] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:22:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:22:29.601735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf202e9-bcb3-45da-909b-13b66cca4608 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:29.653144 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee1800-e3c0-45e4-9a06-2e67f7ee65b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:29.653777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee1800-e3c0-45e4-9a06-2e67f7ee65b2 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:29.654049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee1800-e3c0-45e4-9a06-2e67f7ee65b2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:29.654313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee1800-e3c0-45e4-9a06-2e67f7ee65b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:29.667373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee1800-e3c0-45e4-9a06-2e67f7ee65b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:29.668850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee1800-e3c0-45e4-9a06-2e67f7ee65b2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-4bee1800-e3c0-45e4-9a06-2e67f7ee65b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:29.685625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:29.686942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:29.687854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:29.687854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:29.687854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:29.687854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 469/936] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:29.694260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067df15c-2dad-4499-a3a0-01ebe472e98c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:29.805463 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067df15c-2dad-4499-a3a0-01ebe472e98c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:29.841066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6420c7-4720-44ba-9dc1-b961ecf54da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:29.842046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6420c7-4720-44ba-9dc1-b961ecf54da9 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:29.843116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6420c7-4720-44ba-9dc1-b961ecf54da9 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:29.843602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6420c7-4720-44ba-9dc1-b961ecf54da9 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:29.844431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6420c7-4720-44ba-9dc1-b961ecf54da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:29.844925 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6420c7-4720-44ba-9dc1-b961ecf54da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:29.846498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6420c7-4720-44ba-9dc1-b961ecf54da9 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:29.859208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 468/937] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:29.864968 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee1800-e3c0-45e4-9a06-2e67f7ee65b2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:29.868359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:29.974862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee1800-e3c0-45e4-9a06-2e67f7ee65b2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:30.011039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d1b09-dbee-4904-8390-84aaa1b87395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:30.012028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d1b09-dbee-4904-8390-84aaa1b87395 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:30.012535 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d1b09-dbee-4904-8390-84aaa1b87395 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:30.013008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d1b09-dbee-4904-8390-84aaa1b87395 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:30.021213 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d1b09-dbee-4904-8390-84aaa1b87395 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:30.022988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d1b09-dbee-4904-8390-84aaa1b87395 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-396d1b09-dbee-4904-8390-84aaa1b87395 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:30.034743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:30.035721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:30.036643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:30.036643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:30.036643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:30.036643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:30.036643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:30.036643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:30.036643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:30.036643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:30.036643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 05:22:30.036643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:30.039215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 470/938] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 05:22:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:30.048258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6420c7-4720-44ba-9dc1-b961ecf54da9 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:30.072376 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:30.158108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6420c7-4720-44ba-9dc1-b961ecf54da9 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:30.171080 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186cb7-f5c4-411a-bf5c-7f0e0194abff None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:30.171394 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186cb7-f5c4-411a-bf5c-7f0e0194abff None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:30.171618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186cb7-f5c4-411a-bf5c-7f0e0194abff None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:30.173836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 471/939] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:22:30.180052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0642-2f64-4c5d-b286-9a1c09362393 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:30.180600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0642-2f64-4c5d-b286-9a1c09362393 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:30.181382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0642-2f64-4c5d-b286-9a1c09362393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:30.194936 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a73fa-995c-4130-a386-b2b33693116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:30.195582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a73fa-995c-4130-a386-b2b33693116d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:30.195863 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a73fa-995c-4130-a386-b2b33693116d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:30.196128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a73fa-995c-4130-a386-b2b33693116d None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:30.196911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a73fa-995c-4130-a386-b2b33693116d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:30.197368 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a73fa-995c-4130-a386-b2b33693116d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:30.198829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a73fa-995c-4130-a386-b2b33693116d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:30.207862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-6d8d0642-2f64-4c5d-b286-9a1c09362393 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:30.209507 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6d8d0642-2f64-4c5d-b286-9a1c09362393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:30.221261 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 469/940] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 16 05:22:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:30.227436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a73fa-995c-4130-a386-b2b33693116d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:30.294807 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:30.311767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 472/941] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:30.323894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:30.350076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a73fa-995c-4130-a386-b2b33693116d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:30.386227 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef41427-1e8d-4683-9b3f-05060d83db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:30.387247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef41427-1e8d-4683-9b3f-05060d83db7b None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:30.387724 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef41427-1e8d-4683-9b3f-05060d83db7b None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:30.388191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef41427-1e8d-4683-9b3f-05060d83db7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:30.399558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef41427-1e8d-4683-9b3f-05060d83db7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:30.401309 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef41427-1e8d-4683-9b3f-05060d83db7b None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-bef41427-1e8d-4683-9b3f-05060d83db7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:30.417156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:30.418084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:30.418988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:30.418988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:30.418988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:30.421697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 470/942] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:30.427414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d0642-2f64-4c5d-b286-9a1c09362393 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:30.539916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d0642-2f64-4c5d-b286-9a1c09362393 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:30.580952 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5a4ac-719f-4e50-b609-4fb04dd9e211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:30.581575 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5a4ac-719f-4e50-b609-4fb04dd9e211 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:30.581849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5a4ac-719f-4e50-b609-4fb04dd9e211 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:30.582116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5a4ac-719f-4e50-b609-4fb04dd9e211 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:30.582797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5a4ac-719f-4e50-b609-4fb04dd9e211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:30.583095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5a4ac-719f-4e50-b609-4fb04dd9e211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:30.584473 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5a4ac-719f-4e50-b609-4fb04dd9e211 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:30.587308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef41427-1e8d-4683-9b3f-05060d83db7b None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:30.597520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 473/943] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:30.603044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5a4ac-719f-4e50-b609-4fb04dd9e211 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:30.666294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:30.697908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef41427-1e8d-4683-9b3f-05060d83db7b None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:30.718579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5a4ac-719f-4e50-b609-4fb04dd9e211 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:30.727472 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:30.733970 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6343d-f969-4a99-b3b5-ba8a837999ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:30.735323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6343d-f969-4a99-b3b5-ba8a837999ce None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:30.735620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6343d-f969-4a99-b3b5-ba8a837999ce None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:30.735902 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6343d-f969-4a99-b3b5-ba8a837999ce None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:30.736503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6343d-f969-4a99-b3b5-ba8a837999ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:30.738046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6343d-f969-4a99-b3b5-ba8a837999ce None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:30.740543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: WARNING keystone.server.flask.common [None req-c7b6343d-f969-4a99-b3b5-ba8a837999ce None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 16 05:22:30.755817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e87caa-9090-42d5-a459-e70a367544a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:30.756469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e87caa-9090-42d5-a459-e70a367544a6 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:30.756777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e87caa-9090-42d5-a459-e70a367544a6 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:30.757125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e87caa-9090-42d5-a459-e70a367544a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:30.758472 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.sql.core [None req-c7b6343d-f969-4a99-b3b5-ba8a837999ce None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 05:22:30.758472 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 16 05:22:30.758472 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [parameters: {'id': 'f1c82f66c0d94f5db0f727933d809351', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 16 05:22:30.758472 dv-cinder-857528-3-smb devstack@keystone.service[104772]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104772) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 05:22:30.765271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e87caa-9090-42d5-a459-e70a367544a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:30.766731 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e87caa-9090-42d5-a459-e70a367544a6 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:30.774747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-c7b6343d-f969-4a99-b3b5-ba8a837999ce None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f1c82f66c0d94f5db0f727933d809351.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f1c82f66c0d94f5db0f727933d809351. Sep 16 05:22:30.774747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:30.774747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 05:22:30.774747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 05:22:30.774747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 05:22:30.774747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 05:22:30.774747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 05:22:30.774747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 05:22:30.774747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 05:22:30.774747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application conn.query(q) Sep 16 05:22:30.774747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 05:22:30.774747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 05:22:30.774747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application result.read() Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 16 05:22:30.775609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application next(self.gen) Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application yield resource Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application next(self.gen) Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise self.value Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application session.commit() Sep 16 05:22:30.782394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self.session.flush() Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application compat.raise_( Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 05:22:30.783573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 05:22:30.785132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application conn.query(q) Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application result.read() Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 05:22:30.786869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [parameters: {'id': 'f1c82f66c0d94f5db0f727933d809351', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:30.790364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:30.792383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:30.795167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:30.795167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 16 05:22:30.795167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 16 05:22:30.795167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:30.795167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:30.795167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 16 05:22:30.795167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 16 05:22:30.795167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f1c82f66c0d94f5db0f727933d809351. Sep 16 05:22:30.795167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:30.795167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 471/944] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Sep 16 05:22:30 2022] POST /identity/v3/projects => generated 262 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:30.795167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaccfe0-9358-41f4-8233-23693b8fc76b None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-a3e87caa-9090-42d5-a459-e70a367544a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:30.795976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:30.797945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:30.800684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:30.800684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:30.800684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:30.800684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:30.800684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:30.800684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:30.800684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:30.800684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:30.801744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaccfe0-9358-41f4-8233-23693b8fc76b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:30.801744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaccfe0-9358-41f4-8233-23693b8fc76b None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:30.802249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 474/945] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:30.802249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e87caa-9090-42d5-a459-e70a367544a6 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:30.802703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 472/946] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:30.802703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaccfe0-9358-41f4-8233-23693b8fc76b None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:30.898126 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaccfe0-9358-41f4-8233-23693b8fc76b None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:30.900831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e87caa-9090-42d5-a459-e70a367544a6 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:30.915869 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:30.932747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8316b-13c5-4dc9-8178-af2983c10f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:30.933368 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8316b-13c5-4dc9-8178-af2983c10f49 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:30.933638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8316b-13c5-4dc9-8178-af2983c10f49 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:30.933908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8316b-13c5-4dc9-8178-af2983c10f49 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:30.934612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8316b-13c5-4dc9-8178-af2983c10f49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:30.934918 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8316b-13c5-4dc9-8178-af2983c10f49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:30.936770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8316b-13c5-4dc9-8178-af2983c10f49 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:30.938942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df25732-2200-4f4d-8efa-14eb9e293952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:30.939597 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df25732-2200-4f4d-8efa-14eb9e293952 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:30.939893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df25732-2200-4f4d-8efa-14eb9e293952 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:30.940098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df25732-2200-4f4d-8efa-14eb9e293952 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:30.947009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df25732-2200-4f4d-8efa-14eb9e293952 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:30.948493 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df25732-2200-4f4d-8efa-14eb9e293952 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:30.954846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 473/947] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:30.954846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106f462-4c38-4817-9ae7-f055d46db759 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:30.954846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106f462-4c38-4817-9ae7-f055d46db759 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:30.954846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106f462-4c38-4817-9ae7-f055d46db759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-0df25732-2200-4f4d-8efa-14eb9e293952 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:30.965719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:30.966663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:30.968152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:30.968152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:30.968152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:30.968152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:30.968152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:30.968152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:30.968152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:30.968152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:30.968152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 475/948] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:30.968648 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df25732-2200-4f4d-8efa-14eb9e293952 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:30.976394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-2106f462-4c38-4817-9ae7-f055d46db759 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:30.977938 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2106f462-4c38-4817-9ae7-f055d46db759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:31.020514 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:31.055082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 474/949] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:31.055082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106f462-4c38-4817-9ae7-f055d46db759 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:31.071432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df25732-2200-4f4d-8efa-14eb9e293952 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:31.104683 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ad22f-894a-46a6-9fd0-1d42deede4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:31.105349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ad22f-894a-46a6-9fd0-1d42deede4ff None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:31.105627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ad22f-894a-46a6-9fd0-1d42deede4ff None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:31.105897 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ad22f-894a-46a6-9fd0-1d42deede4ff None admin] PATH_INFO: `/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/10247532345a4f75939950b803202cfa/roles/11289567b2a34360b50a87f6edc79703` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:31.108148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ad22f-894a-46a6-9fd0-1d42deede4ff None admin] RBAC: Authorizing `identity:create_grant(project_id=74c9d19fb1534f8f8888e957d1007640, user_id=10247532345a4f75939950b803202cfa, role_id=11289567b2a34360b50a87f6edc79703)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:31.109579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ad22f-894a-46a6-9fd0-1d42deede4ff None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:31.127211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 476/950] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:22:30 2022] PUT /identity/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/10247532345a4f75939950b803202cfa/roles/11289567b2a34360b50a87f6edc79703 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:22:31.177729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106f462-4c38-4817-9ae7-f055d46db759 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:31.218122 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34592b-3561-4002-913b-630e65ea78c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:31.218715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34592b-3561-4002-913b-630e65ea78c9 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:31.218996 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34592b-3561-4002-913b-630e65ea78c9 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:31.219311 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34592b-3561-4002-913b-630e65ea78c9 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:31.220042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34592b-3561-4002-913b-630e65ea78c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:31.220339 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34592b-3561-4002-913b-630e65ea78c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:31.225280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34592b-3561-4002-913b-630e65ea78c9 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:31.245696 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 475/951] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 05:22:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:31.352157 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ad22f-894a-46a6-9fd0-1d42deede4ff None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:31.387953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:31.471806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ad22f-894a-46a6-9fd0-1d42deede4ff None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:31.506798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7b4f2-3d75-48c9-8926-f11538b34a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:31.507424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7b4f2-3d75-48c9-8926-f11538b34a4c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:31.507699 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7b4f2-3d75-48c9-8926-f11538b34a4c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:31.507967 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7b4f2-3d75-48c9-8926-f11538b34a4c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:31.508546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7b4f2-3d75-48c9-8926-f11538b34a4c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:31.509897 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7b4f2-3d75-48c9-8926-f11538b34a4c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-8ac7b4f2-3d75-48c9-8926-f11538b34a4c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:31.519571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:31.520835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:31.521719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 477/952] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 05:22:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:31.527278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34592b-3561-4002-913b-630e65ea78c9 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:31.565674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:31.635245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34592b-3561-4002-913b-630e65ea78c9 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:31.677159 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d90a7-c68b-4fdb-b148-8e4524486599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:31.677768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d90a7-c68b-4fdb-b148-8e4524486599 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:31.678041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d90a7-c68b-4fdb-b148-8e4524486599 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:31.678306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d90a7-c68b-4fdb-b148-8e4524486599 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:31.678969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d90a7-c68b-4fdb-b148-8e4524486599 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:31.679270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d90a7-c68b-4fdb-b148-8e4524486599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:31.680642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d90a7-c68b-4fdb-b148-8e4524486599 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:31.685918 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 476/953] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 05:22:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:31.691548 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7b4f2-3d75-48c9-8926-f11538b34a4c None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:31.805794 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7b4f2-3d75-48c9-8926-f11538b34a4c None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:31.824031 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:31.843508 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702cd87-a290-4efb-9996-8595d5769d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:31.844596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702cd87-a290-4efb-9996-8595d5769d0d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:31.845093 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702cd87-a290-4efb-9996-8595d5769d0d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:31.845699 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702cd87-a290-4efb-9996-8595d5769d0d None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:31.846481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702cd87-a290-4efb-9996-8595d5769d0d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:31.847253 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702cd87-a290-4efb-9996-8595d5769d0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:31.848941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702cd87-a290-4efb-9996-8595d5769d0d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:31.859134 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 478/954] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 05:22:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:31.861390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d90a7-c68b-4fdb-b148-8e4524486599 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:31.897865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e4d3a-4aba-4bdf-9ffb-9d5b9aa0b256 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:31.898147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e4d3a-4aba-4bdf-9ffb-9d5b9aa0b256 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:31.898425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e4d3a-4aba-4bdf-9ffb-9d5b9aa0b256 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:31.899913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 479/955] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:22:31.905988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99dcbb-dc2d-4a5c-919d-d3c88b3a4499 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:31.906570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99dcbb-dc2d-4a5c-919d-d3c88b3a4499 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:31.907196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99dcbb-dc2d-4a5c-919d-d3c88b3a4499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:31.927144 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-ae99dcbb-dc2d-4a5c-919d-d3c88b3a4499 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:31.928694 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ae99dcbb-dc2d-4a5c-919d-d3c88b3a4499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:31.965006 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:31.970045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d90a7-c68b-4fdb-b148-8e4524486599 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:32.010851 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 480/956] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:32.011320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09af5e-9ac4-4561-b023-98e932150bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:32.012213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09af5e-9ac4-4561-b023-98e932150bca None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:32.012651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09af5e-9ac4-4561-b023-98e932150bca None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:32.013056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09af5e-9ac4-4561-b023-98e932150bca None admin] PATH_INFO: `/v3/endpoints` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:32.013881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09af5e-9ac4-4561-b023-98e932150bca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:32.015425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09af5e-9ac4-4561-b023-98e932150bca None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:32.036733 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 477/957] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:22:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:22:32.281020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99dcbb-dc2d-4a5c-919d-d3c88b3a4499 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:32.379365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:32.390332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99dcbb-dc2d-4a5c-919d-d3c88b3a4499 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:32.432410 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e204e30-f29b-44f1-8064-394953efbd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:32.433033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e204e30-f29b-44f1-8064-394953efbd4c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:32.433310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e204e30-f29b-44f1-8064-394953efbd4c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:32.433578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e204e30-f29b-44f1-8064-394953efbd4c None admin] PATH_INFO: `/v3/services/compute` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:32.434156 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e204e30-f29b-44f1-8064-394953efbd4c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:32.435691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e204e30-f29b-44f1-8064-394953efbd4c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-0e204e30-f29b-44f1-8064-394953efbd4c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:32.445556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:32.446625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:32.447468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 481/958] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:32.452956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09af5e-9ac4-4561-b023-98e932150bca None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:32.562734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09af5e-9ac4-4561-b023-98e932150bca None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:32.598805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d94c1-5203-4a0e-921c-b7a0b2473cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:32.599411 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d94c1-5203-4a0e-921c-b7a0b2473cd8 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:32.599688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d94c1-5203-4a0e-921c-b7a0b2473cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:32.599958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d94c1-5203-4a0e-921c-b7a0b2473cd8 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:32.600584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d94c1-5203-4a0e-921c-b7a0b2473cd8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:32.600881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d94c1-5203-4a0e-921c-b7a0b2473cd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:32.602246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d94c1-5203-4a0e-921c-b7a0b2473cd8 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:32.608142 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 478/959] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 05:22:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:32.613417 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e204e30-f29b-44f1-8064-394953efbd4c None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:32.718499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e204e30-f29b-44f1-8064-394953efbd4c None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:32.753244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe63b3b-cac3-42b2-90f8-61bd4dc58bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:32.753944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe63b3b-cac3-42b2-90f8-61bd4dc58bbe None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:32.754290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe63b3b-cac3-42b2-90f8-61bd4dc58bbe None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:32.754661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe63b3b-cac3-42b2-90f8-61bd4dc58bbe None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:32.755352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe63b3b-cac3-42b2-90f8-61bd4dc58bbe None admin] RBAC: Adding query filter params (type=compute) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:32.755722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe63b3b-cac3-42b2-90f8-61bd4dc58bbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:32.757151 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe63b3b-cac3-42b2-90f8-61bd4dc58bbe None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:32.762153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 482/960] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 05:22:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:33.482473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848ed7-e09d-41cb-9756-a3350cdd75b1 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:33.483046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848ed7-e09d-41cb-9756-a3350cdd75b1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:33.483335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848ed7-e09d-41cb-9756-a3350cdd75b1 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:33.485081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 479/961] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:33.490401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677ac5c-a0fd-46d5-a621-30c0c78f4f1f None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:33.490829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677ac5c-a0fd-46d5-a621-30c0c78f4f1f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:33.491202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677ac5c-a0fd-46d5-a621-30c0c78f4f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:33.510349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-6677ac5c-a0fd-46d5-a621-30c0c78f4f1f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:33.511632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6677ac5c-a0fd-46d5-a621-30c0c78f4f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:33.522982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:33.595914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 483/962] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:33.654893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df0ec8-6603-4ccb-b9ed-d5733866af7a None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:33.655697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df0ec8-6603-4ccb-b9ed-d5733866af7a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:33.656205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df0ec8-6603-4ccb-b9ed-d5733866af7a None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:33.658073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 480/963] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:33.663881 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177b6d6-fab9-47c4-94a4-8b38732b582d None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:33.664339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177b6d6-fab9-47c4-94a4-8b38732b582d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:33.664441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177b6d6-fab9-47c4-94a4-8b38732b582d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:33.683122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8177b6d6-fab9-47c4-94a4-8b38732b582d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:33.684295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8177b6d6-fab9-47c4-94a4-8b38732b582d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:33.752629 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 484/964] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:33.876725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df0ec8-6603-4ccb-b9ed-d5733866af7a None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:33.901278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:33.984300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df0ec8-6603-4ccb-b9ed-d5733866af7a None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:34.019130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4ce1c-52e1-4861-a0ee-429c19bbf37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:34.019759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4ce1c-52e1-4861-a0ee-429c19bbf37d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:34.020079 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4ce1c-52e1-4861-a0ee-429c19bbf37d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:34.020354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4ce1c-52e1-4861-a0ee-429c19bbf37d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:34.026683 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177b6d6-fab9-47c4-94a4-8b38732b582d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:34.032840 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4ce1c-52e1-4861-a0ee-429c19bbf37d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-41f4ce1c-52e1-4861-a0ee-429c19bbf37d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:34.039135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:34.040062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:34.040903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:34.040903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:34.040903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:34.040903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:34.040903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:34.040903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:34.040903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:34.040903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:34.040903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:34.040903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:34.040903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 05:22:34.040903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:34.042591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 481/965] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 16 05:22:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:34.047142 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4ce1c-52e1-4861-a0ee-429c19bbf37d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:34.109764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:34.149613 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177b6d6-fab9-47c4-94a4-8b38732b582d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:34.150654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:34.172318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4ce1c-52e1-4861-a0ee-429c19bbf37d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:34.196891 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342a438-b1af-40b5-b61c-1a5468208a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:34.197495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342a438-b1af-40b5-b61c-1a5468208a98 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:34.198202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342a438-b1af-40b5-b61c-1a5468208a98 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:34.198474 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342a438-b1af-40b5-b61c-1a5468208a98 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:34.199410 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342a438-b1af-40b5-b61c-1a5468208a98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:34.202062 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342a438-b1af-40b5-b61c-1a5468208a98 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:34.205781 dv-cinder-857528-3-smb devstack@keystone.service[104774]: WARNING keystone.server.flask.common [None req-8342a438-b1af-40b5-b61c-1a5468208a98 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 16 05:22:34.209717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2ef40-8de5-469b-802d-548fd98cd53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:34.210425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2ef40-8de5-469b-802d-548fd98cd53d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:34.210860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2ef40-8de5-469b-802d-548fd98cd53d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:34.211281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2ef40-8de5-469b-802d-548fd98cd53d None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:34.212029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2ef40-8de5-469b-802d-548fd98cd53d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:34.212451 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2ef40-8de5-469b-802d-548fd98cd53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:34.214159 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2ef40-8de5-469b-802d-548fd98cd53d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:34.219131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.sql.core [None req-8342a438-b1af-40b5-b61c-1a5468208a98 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 05:22:34.219131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 16 05:22:34.219131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [parameters: {'user_id': '0800887e01e44770bdb304a27c7ad4f7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 16 05:22:34.219131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=104774) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-8342a438-b1af-40b5-b61c-1a5468208a98 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application conn.query(q) Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application result.read() Sep 16 05:22:34.227197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 05:22:34.228916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application next(self.gen) Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application yield resource Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application next(self.gen) Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise self.value Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application session.commit() Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 05:22:34.230142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self.session.flush() Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application compat.raise_( Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 05:22:34.231295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 05:22:34.232363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application conn.query(q) Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application result.read() Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 05:22:34.233230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [parameters: {'user_id': '0800887e01e44770bdb304a27c7ad4f7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:34.234153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 16 05:22:34.235015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 16 05:22:34.236110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 16 05:22:34.236110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 16 05:22:34.236110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 05:22:34.236110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 05:22:34.236110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 16 05:22:34.236110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:34.236110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 485/966] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 16 05:22:34 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:34.236592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 482/967] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 05:22:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:34.241440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342a438-b1af-40b5-b61c-1a5468208a98 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:34.245208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2ef40-8de5-469b-802d-548fd98cd53d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:34.342314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342a438-b1af-40b5-b61c-1a5468208a98 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:34.347831 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2ef40-8de5-469b-802d-548fd98cd53d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:34.378852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0a13c-2650-4cee-852a-6500f34d216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:34.379478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0a13c-2650-4cee-852a-6500f34d216b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:34.379766 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0a13c-2650-4cee-852a-6500f34d216b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:34.380027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0a13c-2650-4cee-852a-6500f34d216b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:34.382787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:34.384160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99338f90-5f30-455c-8c9b-8bdb0a6ef07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:34.384777 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99338f90-5f30-455c-8c9b-8bdb0a6ef07c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:34.385078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99338f90-5f30-455c-8c9b-8bdb0a6ef07c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:34.385357 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99338f90-5f30-455c-8c9b-8bdb0a6ef07c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:34.392320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0a13c-2650-4cee-852a-6500f34d216b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:34.393562 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99338f90-5f30-455c-8c9b-8bdb0a6ef07c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:34.393999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0a13c-2650-4cee-852a-6500f34d216b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:34.395038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99338f90-5f30-455c-8c9b-8bdb0a6ef07c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-99338f90-5f30-455c-8c9b-8bdb0a6ef07c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:34.407109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:34.408084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:34.409030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:34.409030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:34.409030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:34.409030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:34.409030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:34.409030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:34.409030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:34.409030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:34.409030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 05:22:34.409030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-a3e0a13c-2650-4cee-852a-6500f34d216b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:34.410069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:34.416315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:34.417212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:34.417212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:34.417212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:34.417212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 486/968] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:34.417212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0d60-3803-469f-a46f-1a8272065c5b None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:34.417212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0d60-3803-469f-a46f-1a8272065c5b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:34.417212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0d60-3803-469f-a46f-1a8272065c5b None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:34.420573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 483/969] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:22:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:34.420573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99338f90-5f30-455c-8c9b-8bdb0a6ef07c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:34.420774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 487/970] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:34.420774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce0d60-3803-469f-a46f-1a8272065c5b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:34.420923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:34.524563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99338f90-5f30-455c-8c9b-8bdb0a6ef07c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:34.533741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce0d60-3803-469f-a46f-1a8272065c5b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:34.565243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3bcdd-6a71-4c43-8cdc-10711e85d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:34.565846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3bcdd-6a71-4c43-8cdc-10711e85d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:34.566172 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3bcdd-6a71-4c43-8cdc-10711e85d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:34.566453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3bcdd-6a71-4c43-8cdc-10711e85d9f4 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:34.567108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3bcdd-6a71-4c43-8cdc-10711e85d9f4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:34.567412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3bcdd-6a71-4c43-8cdc-10711e85d9f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:34.568852 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3bcdd-6a71-4c43-8cdc-10711e85d9f4 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:34.570206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf4fe8-9e5a-47fc-be98-52a7bee675c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:34.570834 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf4fe8-9e5a-47fc-be98-52a7bee675c1 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:34.571111 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf4fe8-9e5a-47fc-be98-52a7bee675c1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:34.571379 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf4fe8-9e5a-47fc-be98-52a7bee675c1 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:34.572005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf4fe8-9e5a-47fc-be98-52a7bee675c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:34.572301 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf4fe8-9e5a-47fc-be98-52a7bee675c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:34.573633 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf4fe8-9e5a-47fc-be98-52a7bee675c1 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:34.590382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 488/971] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:34.590382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8683-8c46-4ecc-b496-c29e7079630a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:34.590382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8683-8c46-4ecc-b496-c29e7079630a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:34.590382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8683-8c46-4ecc-b496-c29e7079630a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:34.605713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 484/972] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 05:22:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:34.606643 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3bcdd-6a71-4c43-8cdc-10711e85d9f4 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:34.615436 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-a8cb8683-8c46-4ecc-b496-c29e7079630a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:34.618225 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-a8cb8683-8c46-4ecc-b496-c29e7079630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:34.678988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:34.687762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:34.715085 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 489/973] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:34.737948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3bcdd-6a71-4c43-8cdc-10711e85d9f4 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:34.775566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2a1a0-78c0-4a47-893c-6922a5aad084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:34.776534 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a1a0-78c0-4a47-893c-6922a5aad084 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:34.776958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a1a0-78c0-4a47-893c-6922a5aad084 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:34.777407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a1a0-78c0-4a47-893c-6922a5aad084 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:34.786267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2a1a0-78c0-4a47-893c-6922a5aad084 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:34.788038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2a1a0-78c0-4a47-893c-6922a5aad084 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-2eb2a1a0-78c0-4a47-893c-6922a5aad084 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:34.801021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:34.802182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:34.803356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:34.803356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:34.803356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:34.803356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:34.803356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:34.803356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:34.803356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:34.803356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:34.803356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 05:22:34.803356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:34.805460 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 485/974] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 05:22:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:34.812073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb8683-8c46-4ecc-b496-c29e7079630a None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:34.926349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb8683-8c46-4ecc-b496-c29e7079630a None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:34.962186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107f1c7-0e78-43d5-a8c5-3e2afb88fdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:34.962737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107f1c7-0e78-43d5-a8c5-3e2afb88fdf9 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:34.963012 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107f1c7-0e78-43d5-a8c5-3e2afb88fdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:34.963286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107f1c7-0e78-43d5-a8c5-3e2afb88fdf9 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:34.964002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107f1c7-0e78-43d5-a8c5-3e2afb88fdf9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:34.964303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107f1c7-0e78-43d5-a8c5-3e2afb88fdf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:34.965725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107f1c7-0e78-43d5-a8c5-3e2afb88fdf9 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:34.968663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e01f0-8f19-4bdf-8645-33eff50ebedc None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:34.969695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e01f0-8f19-4bdf-8645-33eff50ebedc None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:34.969695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e01f0-8f19-4bdf-8645-33eff50ebedc None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:34.970704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 486/975] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:34.975406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6bc08-118e-4b10-8a35-01d638d15d50 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:34.976366 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6bc08-118e-4b10-8a35-01d638d15d50 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:34.976366 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6bc08-118e-4b10-8a35-01d638d15d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:34.984980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 490/976] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 16 05:22:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:34.988440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107f1c7-0e78-43d5-a8c5-3e2afb88fdf9 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:34.994629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-d2d6bc08-118e-4b10-8a35-01d638d15d50 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:34.995834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d2d6bc08-118e-4b10-8a35-01d638d15d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:35.021614 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:35.062744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 487/977] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:35.063567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6bc08-118e-4b10-8a35-01d638d15d50 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:35.087800 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107f1c7-0e78-43d5-a8c5-3e2afb88fdf9 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:35.114008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:35.123890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e5c9d-7132-45e5-9e70-03abdab11b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:35.124512 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e5c9d-7132-45e5-9e70-03abdab11b87 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:35.124792 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e5c9d-7132-45e5-9e70-03abdab11b87 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:35.125061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e5c9d-7132-45e5-9e70-03abdab11b87 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:35.125636 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e5c9d-7132-45e5-9e70-03abdab11b87 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:35.127022 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e5c9d-7132-45e5-9e70-03abdab11b87 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-783e5c9d-7132-45e5-9e70-03abdab11b87 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:35.135867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:35.136844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:35.137786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:35.141878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 491/978] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 05:22:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:35.142717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e5c9d-7132-45e5-9e70-03abdab11b87 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:35.170890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6bc08-118e-4b10-8a35-01d638d15d50 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:35.208210 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4b8ce-ee69-430c-a499-286a049d629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:35.208814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4b8ce-ee69-430c-a499-286a049d629a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:35.209089 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4b8ce-ee69-430c-a499-286a049d629a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:35.209357 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4b8ce-ee69-430c-a499-286a049d629a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:35.246878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:35.251098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e5c9d-7132-45e5-9e70-03abdab11b87 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:35.286324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4b8ce-ee69-430c-a499-286a049d629a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:35.287817 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4b8ce-ee69-430c-a499-286a049d629a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:35.289215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0797a-59a1-40f9-a39c-b4ecce345323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:35.289950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0797a-59a1-40f9-a39c-b4ecce345323 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:35.290941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0797a-59a1-40f9-a39c-b4ecce345323 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:35.290941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0797a-59a1-40f9-a39c-b4ecce345323 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:35.291217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0797a-59a1-40f9-a39c-b4ecce345323 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:35.291521 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0797a-59a1-40f9-a39c-b4ecce345323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:35.292870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0797a-59a1-40f9-a39c-b4ecce345323 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:35.298825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 492/979] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 05:22:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:35.304135 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0797a-59a1-40f9-a39c-b4ecce345323 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:35.343122 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:35.393354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 488/980] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:22:35 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:22:35.394168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4b8ce-ee69-430c-a499-286a049d629a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:35.405814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0797a-59a1-40f9-a39c-b4ecce345323 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:35.440083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962fe6c-0ffe-445a-a2b4-bd3689cf4b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:35.440802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962fe6c-0ffe-445a-a2b4-bd3689cf4b6e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:35.441073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962fe6c-0ffe-445a-a2b4-bd3689cf4b6e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:35.441360 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962fe6c-0ffe-445a-a2b4-bd3689cf4b6e None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:35.441996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962fe6c-0ffe-445a-a2b4-bd3689cf4b6e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:35.442291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962fe6c-0ffe-445a-a2b4-bd3689cf4b6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:35.444070 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962fe6c-0ffe-445a-a2b4-bd3689cf4b6e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:35.448964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 493/981] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 05:22:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:35.449726 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962fe6c-0ffe-445a-a2b4-bd3689cf4b6e None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:35.482607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:35.496458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4b8ce-ee69-430c-a499-286a049d629a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:35.531344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5db7a8-b7a4-48e6-aed5-9800cc5a533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:35.532000 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5db7a8-b7a4-48e6-aed5-9800cc5a533b None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:35.532252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5db7a8-b7a4-48e6-aed5-9800cc5a533b None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:35.532523 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5db7a8-b7a4-48e6-aed5-9800cc5a533b None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:35.533161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5db7a8-b7a4-48e6-aed5-9800cc5a533b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:35.534559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5db7a8-b7a4-48e6-aed5-9800cc5a533b None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:35.548603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 489/982] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:22:35 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:22:35.549389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5db7a8-b7a4-48e6-aed5-9800cc5a533b None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:35.557718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962fe6c-0ffe-445a-a2b4-bd3689cf4b6e None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:35.566939 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:35.606269 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885884-b6da-436e-88ef-652812f117f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:35.606947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885884-b6da-436e-88ef-652812f117f2 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:35.607224 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885884-b6da-436e-88ef-652812f117f2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:35.608075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885884-b6da-436e-88ef-652812f117f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:35.621621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd885884-b6da-436e-88ef-652812f117f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:35.623200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd885884-b6da-436e-88ef-652812f117f2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-dd885884-b6da-436e-88ef-652812f117f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:35.639333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:35.640362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:35.641334 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:35.641334 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:35.641334 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:35.645477 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 494/983] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:35.646440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885884-b6da-436e-88ef-652812f117f2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:35.679719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5db7a8-b7a4-48e6-aed5-9800cc5a533b None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:35.720337 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a99227-ac71-4bda-9642-5e67d617646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:35.720972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a99227-ac71-4bda-9642-5e67d617646f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:35.721256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a99227-ac71-4bda-9642-5e67d617646f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:35.721531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a99227-ac71-4bda-9642-5e67d617646f None admin] PATH_INFO: `/v3/endpoints` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:35.722233 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a99227-ac71-4bda-9642-5e67d617646f None admin] RBAC: Adding query filter params (interface=admin, service_id=d7c6af7abd1a42bb8a1b441e5faf5e71, region_id=RegionOne) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:35.722576 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a99227-ac71-4bda-9642-5e67d617646f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:35.724759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a99227-ac71-4bda-9642-5e67d617646f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:35.729558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 490/984] 10.222.0.20 () {56 vars in 1249 bytes} [Fri Sep 16 05:22:35 2022] GET /identity/v3/endpoints?service_id=d7c6af7abd1a42bb8a1b441e5faf5e71&interface=admin®ion_id=RegionOne => generated 193 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:35.735678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a99227-ac71-4bda-9642-5e67d617646f None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:35.737776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:35.764570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885884-b6da-436e-88ef-652812f117f2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:35.799737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b2679-7ff7-4fd8-b90c-07eff6875065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:35.800343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b2679-7ff7-4fd8-b90c-07eff6875065 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:35.800619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b2679-7ff7-4fd8-b90c-07eff6875065 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:35.800884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b2679-7ff7-4fd8-b90c-07eff6875065 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:35.801517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b2679-7ff7-4fd8-b90c-07eff6875065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:35.801819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b2679-7ff7-4fd8-b90c-07eff6875065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:35.803207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b2679-7ff7-4fd8-b90c-07eff6875065 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:35.815322 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 495/985] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:35.815951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:35.820731 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b2679-7ff7-4fd8-b90c-07eff6875065 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:35.844365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a99227-ac71-4bda-9642-5e67d617646f None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:35.880899 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d79f96-8093-4b87-b4ab-e4dd697c73fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:35.881505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d79f96-8093-4b87-b4ab-e4dd697c73fd None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:35.881787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d79f96-8093-4b87-b4ab-e4dd697c73fd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:35.882062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d79f96-8093-4b87-b4ab-e4dd697c73fd None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:35.882697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d79f96-8093-4b87-b4ab-e4dd697c73fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:35.884116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d79f96-8093-4b87-b4ab-e4dd697c73fd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:35.892020 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 491/986] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 05:22:35 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:22:35.925064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b2679-7ff7-4fd8-b90c-07eff6875065 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:35.963015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e99169-657a-4d7d-b0c5-96a2c4ca4336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:35.963655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e99169-657a-4d7d-b0c5-96a2c4ca4336 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:35.963931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e99169-657a-4d7d-b0c5-96a2c4ca4336 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:35.964199 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e99169-657a-4d7d-b0c5-96a2c4ca4336 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:35.967380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:35.973750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e99169-657a-4d7d-b0c5-96a2c4ca4336 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:35.975247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e99169-657a-4d7d-b0c5-96a2c4ca4336 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-70e99169-657a-4d7d-b0c5-96a2c4ca4336 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:35.988004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:35.988972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:35.989880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:35.989880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:35.989880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:35.989880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:35.989880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:35.989880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:35.989880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:35.989880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:35.994174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 496/987] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:35.995446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d79f96-8093-4b87-b4ab-e4dd697c73fd None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:36.105656 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d79f96-8093-4b87-b4ab-e4dd697c73fd None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:36.139873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e784a8-d222-4cc2-b4a6-08d4f8769814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:36.140475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e784a8-d222-4cc2-b4a6-08d4f8769814 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:36.140750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e784a8-d222-4cc2-b4a6-08d4f8769814 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:36.141016 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e784a8-d222-4cc2-b4a6-08d4f8769814 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:36.141695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e784a8-d222-4cc2-b4a6-08d4f8769814 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:36.141995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e784a8-d222-4cc2-b4a6-08d4f8769814 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:36.143466 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e784a8-d222-4cc2-b4a6-08d4f8769814 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:36.150719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:36.161713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 492/988] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:36.163021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e99169-657a-4d7d-b0c5-96a2c4ca4336 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:36.276031 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e99169-657a-4d7d-b0c5-96a2c4ca4336 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:36.308989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034f1f6-2fff-43c0-a3a8-d9a4acf8353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:36.309591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f1f6-2fff-43c0-a3a8-d9a4acf8353b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:36.309868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f1f6-2fff-43c0-a3a8-d9a4acf8353b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:36.310138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f1f6-2fff-43c0-a3a8-d9a4acf8353b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:36.311661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034f1f6-2fff-43c0-a3a8-d9a4acf8353b None admin] RBAC: Adding query filter params (role.id=11289567b2a34360b50a87f6edc79703, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=10247532345a4f75939950b803202cfa) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:36.311966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034f1f6-2fff-43c0-a3a8-d9a4acf8353b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:36.313382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034f1f6-2fff-43c0-a3a8-d9a4acf8353b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:36.326720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 497/989] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:22:36 2022] GET /identity/v3/role_assignments?user.id=10247532345a4f75939950b803202cfa&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=11289567b2a34360b50a87f6edc79703 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:37.727075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a913b-c570-48ee-bcbf-eb5e88816d76 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:37.727624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a913b-c570-48ee-bcbf-eb5e88816d76 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:37.727624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a913b-c570-48ee-bcbf-eb5e88816d76 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:37.728970 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 493/990] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:37.734022 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3eae25-752c-4b5e-928c-c66ad635594e None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:37.734399 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3eae25-752c-4b5e-928c-c66ad635594e None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:37.734609 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3eae25-752c-4b5e-928c-c66ad635594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:37.752934 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8a3eae25-752c-4b5e-928c-c66ad635594e None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:37.754101 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8a3eae25-752c-4b5e-928c-c66ad635594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:37.808277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:37.821292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 498/991] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:38.059764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3349fe5-22d4-4f9e-8290-38d4b661b807 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:38.060094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3349fe5-22d4-4f9e-8290-38d4b661b807 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:38.060841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3349fe5-22d4-4f9e-8290-38d4b661b807 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:38.062640 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 494/992] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:38.067628 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0de60-4e67-4ecb-a6c4-6671d8b9f695 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:38.067919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0de60-4e67-4ecb-a6c4-6671d8b9f695 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:38.068194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0de60-4e67-4ecb-a6c4-6671d8b9f695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:38.084586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3349fe5-22d4-4f9e-8290-38d4b661b807 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:38.086780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-2fd0de60-4e67-4ecb-a6c4-6671d8b9f695 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:38.089032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-2fd0de60-4e67-4ecb-a6c4-6671d8b9f695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:38.166583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 499/993] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:38.191207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3349fe5-22d4-4f9e-8290-38d4b661b807 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:38.228935 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505d289-2d65-4beb-b938-0bd8de042a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:38.229567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505d289-2d65-4beb-b938-0bd8de042a51 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:38.229842 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505d289-2d65-4beb-b938-0bd8de042a51 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:38.230110 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505d289-2d65-4beb-b938-0bd8de042a51 None admin] PATH_INFO: `/v3/services/compute` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:38.230739 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505d289-2d65-4beb-b938-0bd8de042a51 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:38.232231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505d289-2d65-4beb-b938-0bd8de042a51 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-f505d289-2d65-4beb-b938-0bd8de042a51 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:38.241321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:38.242333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 05:22:38.243755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:38.247354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 495/994] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:38.248478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0de60-4e67-4ecb-a6c4-6671d8b9f695 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:38.350784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0de60-4e67-4ecb-a6c4-6671d8b9f695 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:38.371433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:38.387138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ad4ce-1476-47ba-8e3c-dff3247af317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:38.387772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ad4ce-1476-47ba-8e3c-dff3247af317 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:38.388051 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ad4ce-1476-47ba-8e3c-dff3247af317 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:38.388838 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ad4ce-1476-47ba-8e3c-dff3247af317 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:38.389500 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ad4ce-1476-47ba-8e3c-dff3247af317 None admin] RBAC: Adding query filter params (name=compute) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:38.389805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ad4ce-1476-47ba-8e3c-dff3247af317 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:38.391386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ad4ce-1476-47ba-8e3c-dff3247af317 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:38.401915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 500/995] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 05:22:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:38.402971 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505d289-2d65-4beb-b938-0bd8de042a51 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:38.435973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ad4ce-1476-47ba-8e3c-dff3247af317 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:38.469905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:38.514811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505d289-2d65-4beb-b938-0bd8de042a51 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:38.544179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ad4ce-1476-47ba-8e3c-dff3247af317 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:38.547143 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd32c9-e5dc-4ece-88d9-ee382b37b28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:38.547738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd32c9-e5dc-4ece-88d9-ee382b37b28c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:38.548016 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd32c9-e5dc-4ece-88d9-ee382b37b28c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:38.548285 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd32c9-e5dc-4ece-88d9-ee382b37b28c None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:38.548904 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd32c9-e5dc-4ece-88d9-ee382b37b28c None admin] RBAC: Adding query filter params (type=compute) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:38.549203 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd32c9-e5dc-4ece-88d9-ee382b37b28c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:38.550592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd32c9-e5dc-4ece-88d9-ee382b37b28c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:38.555371 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 496/996] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 05:22:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:38.556803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6d2f3-31e8-45db-adac-23012cd6e989 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:38.557093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6d2f3-31e8-45db-adac-23012cd6e989 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:38.557366 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6d2f3-31e8-45db-adac-23012cd6e989 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:38.558799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 497/997] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:38.563645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6d2f3-31e8-45db-adac-23012cd6e989 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:38.580826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1fca9-af5e-4c24-9b14-2315122613d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:38.581451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1fca9-af5e-4c24-9b14-2315122613d8 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:38.581723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1fca9-af5e-4c24-9b14-2315122613d8 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:38.581987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1fca9-af5e-4c24-9b14-2315122613d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:38.582620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1fca9-af5e-4c24-9b14-2315122613d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:38.584002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1fca9-af5e-4c24-9b14-2315122613d8 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-69a1fca9-af5e-4c24-9b14-2315122613d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:38.592696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:38.593892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:38.594935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 501/998] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 05:22:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:38.595929 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff452f6d-345a-499b-9ac5-7c38d9771c62 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:38.595929 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff452f6d-345a-499b-9ac5-7c38d9771c62 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:38.595929 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff452f6d-345a-499b-9ac5-7c38d9771c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:38.612591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-ff452f6d-345a-499b-9ac5-7c38d9771c62 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:38.613680 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ff452f6d-345a-499b-9ac5-7c38d9771c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:38.656251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:38.678185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6d2f3-31e8-45db-adac-23012cd6e989 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:38.679374 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 502/999] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:38.680187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff452f6d-345a-499b-9ac5-7c38d9771c62 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:38.704992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:38.714199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2c330-93d3-496d-b1c3-28e0c4dc5f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:38.714826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2c330-93d3-496d-b1c3-28e0c4dc5f98 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:38.715119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2c330-93d3-496d-b1c3-28e0c4dc5f98 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:38.715370 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2c330-93d3-496d-b1c3-28e0c4dc5f98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:38.716057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2c330-93d3-496d-b1c3-28e0c4dc5f98 None admin] RBAC: Adding query filter params (interface=public, service_id=fc993ad28a474fb9b3a2ba618d0e6dc2, region_id=RegionOne) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:38.716360 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2c330-93d3-496d-b1c3-28e0c4dc5f98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:38.717768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2c330-93d3-496d-b1c3-28e0c4dc5f98 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:38.723836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 498/1000] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 05:22:38 2022] GET /identity/v3/endpoints?service_id=fc993ad28a474fb9b3a2ba618d0e6dc2&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:38.730812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2c330-93d3-496d-b1c3-28e0c4dc5f98 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:38.793829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff452f6d-345a-499b-9ac5-7c38d9771c62 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:38.831882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f04ec6-3d42-4ef3-b6dc-ae3ec7d4ad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:38.832740 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f04ec6-3d42-4ef3-b6dc-ae3ec7d4ad89 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:38.833017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f04ec6-3d42-4ef3-b6dc-ae3ec7d4ad89 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:38.833291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f04ec6-3d42-4ef3-b6dc-ae3ec7d4ad89 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:38.834147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f04ec6-3d42-4ef3-b6dc-ae3ec7d4ad89 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:38.834280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f04ec6-3d42-4ef3-b6dc-ae3ec7d4ad89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:38.835549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f04ec6-3d42-4ef3-b6dc-ae3ec7d4ad89 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:38.837301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2c330-93d3-496d-b1c3-28e0c4dc5f98 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:38.840110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 503/1001] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 05:22:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:38.846196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f04ec6-3d42-4ef3-b6dc-ae3ec7d4ad89 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:38.871405 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74143f31-76d8-4eed-b4c5-18930c95d957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:38.871940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74143f31-76d8-4eed-b4c5-18930c95d957 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:38.872217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74143f31-76d8-4eed-b4c5-18930c95d957 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:38.872487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74143f31-76d8-4eed-b4c5-18930c95d957 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:38.873106 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74143f31-76d8-4eed-b4c5-18930c95d957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:38.874471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74143f31-76d8-4eed-b4c5-18930c95d957 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:38.890549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 499/1002] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 05:22:38 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:22:38.895143 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:38.955838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74143f31-76d8-4eed-b4c5-18930c95d957 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:38.960030 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f04ec6-3d42-4ef3-b6dc-ae3ec7d4ad89 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:38.997753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9493eb-cb9d-43e6-b235-fe2518ec4c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:38.998377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9493eb-cb9d-43e6-b235-fe2518ec4c8d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:38.998691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9493eb-cb9d-43e6-b235-fe2518ec4c8d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:38.998966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9493eb-cb9d-43e6-b235-fe2518ec4c8d None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:39.000092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9493eb-cb9d-43e6-b235-fe2518ec4c8d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:39.000092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9493eb-cb9d-43e6-b235-fe2518ec4c8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:39.001305 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9493eb-cb9d-43e6-b235-fe2518ec4c8d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:39.006682 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 504/1003] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 05:22:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:39.012744 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9493eb-cb9d-43e6-b235-fe2518ec4c8d None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:39.025258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:39.081082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74143f31-76d8-4eed-b4c5-18930c95d957 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:39.115722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ec6d0-9e82-49ab-8715-b6fd42dc26ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:39.116346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ec6d0-9e82-49ab-8715-b6fd42dc26ca None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:39.116622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ec6d0-9e82-49ab-8715-b6fd42dc26ca None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:39.116887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ec6d0-9e82-49ab-8715-b6fd42dc26ca None admin] PATH_INFO: `/v3/services/image` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:39.117455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ec6d0-9e82-49ab-8715-b6fd42dc26ca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:39.118851 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ec6d0-9e82-49ab-8715-b6fd42dc26ca None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-9e9ec6d0-9e82-49ab-8715-b6fd42dc26ca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:39.128119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:39.129301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:39.130336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 500/1004] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Sep 16 05:22:38 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:39.134169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9493eb-cb9d-43e6-b235-fe2518ec4c8d None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:39.134943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ec6d0-9e82-49ab-8715-b6fd42dc26ca None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:39.143865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:39.177731 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed2b03-711e-477f-89af-d76c34bd3c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:39.178488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed2b03-711e-477f-89af-d76c34bd3c70 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:39.178622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed2b03-711e-477f-89af-d76c34bd3c70 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:39.178885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed2b03-711e-477f-89af-d76c34bd3c70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:39.179560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed2b03-711e-477f-89af-d76c34bd3c70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:39.180923 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed2b03-711e-477f-89af-d76c34bd3c70 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:39.206159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 505/1005] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:22:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:22:39.251398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ec6d0-9e82-49ab-8715-b6fd42dc26ca None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:39.272682 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:39.298698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45756a7e-bfbc-4c23-b25a-9443caad408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:39.299310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45756a7e-bfbc-4c23-b25a-9443caad408d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:39.299583 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45756a7e-bfbc-4c23-b25a-9443caad408d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:39.299848 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45756a7e-bfbc-4c23-b25a-9443caad408d None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:39.300477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45756a7e-bfbc-4c23-b25a-9443caad408d None admin] RBAC: Adding query filter params (name=image) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:39.300778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45756a7e-bfbc-4c23-b25a-9443caad408d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:39.302284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45756a7e-bfbc-4c23-b25a-9443caad408d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:39.313227 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 501/1006] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:39.314977 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed2b03-711e-477f-89af-d76c34bd3c70 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:39.425936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed2b03-711e-477f-89af-d76c34bd3c70 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:39.461321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685a5ab-8ada-4660-8c3a-50fea982ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:39.462262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685a5ab-8ada-4660-8c3a-50fea982ef6b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:39.462743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685a5ab-8ada-4660-8c3a-50fea982ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:39.463200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685a5ab-8ada-4660-8c3a-50fea982ef6b None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:39.463995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685a5ab-8ada-4660-8c3a-50fea982ef6b None admin] RBAC: Adding query filter params (type=image) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:39.464468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685a5ab-8ada-4660-8c3a-50fea982ef6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:39.466023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685a5ab-8ada-4660-8c3a-50fea982ef6b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:39.471477 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 506/1007] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:41.048950 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13937621-6eab-4865-af4c-e875e08fae74 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:41.049474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13937621-6eab-4865-af4c-e875e08fae74 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:41.049474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13937621-6eab-4865-af4c-e875e08fae74 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:41.051001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 502/1008] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:41.056120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f73f-7d52-4f35-b252-c71798dc4b5b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:41.056579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f73f-7d52-4f35-b252-c71798dc4b5b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:41.056660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f73f-7d52-4f35-b252-c71798dc4b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:41.076467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-df99f73f-7d52-4f35-b252-c71798dc4b5b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:41.077642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-df99f73f-7d52-4f35-b252-c71798dc4b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:41.102072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:41.150551 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 507/1009] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:41.398068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a213e-a4be-4c6b-991d-2866c346f9bd None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:41.398355 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a213e-a4be-4c6b-991d-2866c346f9bd None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:41.398824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a213e-a4be-4c6b-991d-2866c346f9bd None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:41.400367 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 503/1010] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:41.406248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf5aca-cfa7-4c9e-8d82-7ba9b0599343 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:41.406539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf5aca-cfa7-4c9e-8d82-7ba9b0599343 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:41.406834 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf5aca-cfa7-4c9e-8d82-7ba9b0599343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:41.418152 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a213e-a4be-4c6b-991d-2866c346f9bd None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:41.426277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-aaaf5aca-cfa7-4c9e-8d82-7ba9b0599343 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:41.427508 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-aaaf5aca-cfa7-4c9e-8d82-7ba9b0599343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:41.496847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 508/1011] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:41.535572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a213e-a4be-4c6b-991d-2866c346f9bd None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:41.570630 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839a684-1607-4804-a0cf-9db8eaebde8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:41.571256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a684-1607-4804-a0cf-9db8eaebde8c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:41.571535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a684-1607-4804-a0cf-9db8eaebde8c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:41.571809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a684-1607-4804-a0cf-9db8eaebde8c None admin] PATH_INFO: `/v3/services/compute` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:41.572384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a684-1607-4804-a0cf-9db8eaebde8c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:41.573758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a684-1607-4804-a0cf-9db8eaebde8c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-e839a684-1607-4804-a0cf-9db8eaebde8c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:41.582740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:41.583751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 05:22:41.584677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:41.586837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 504/1012] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:41.589704 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf5aca-cfa7-4c9e-8d82-7ba9b0599343 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:41.620792 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb9793-4381-4d5d-8ba6-42a9435245da None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:41.621105 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb9793-4381-4d5d-8ba6-42a9435245da None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:41.621353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb9793-4381-4d5d-8ba6-42a9435245da None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:41.622749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 505/1013] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:22:41.628473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1ae73-b7cd-4721-8cc7-f68101a7b6d3 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:41.628753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1ae73-b7cd-4721-8cc7-f68101a7b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:41.629021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1ae73-b7cd-4721-8cc7-f68101a7b6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:41.649287 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-02c1ae73-b7cd-4721-8cc7-f68101a7b6d3 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:41.650400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-02c1ae73-b7cd-4721-8cc7-f68101a7b6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:41.689259 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:41.695155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:41.706152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf5aca-cfa7-4c9e-8d82-7ba9b0599343 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:41.722034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 506/1014] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:41.741953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15721dab-9e45-4028-8ee5-9bc16c5f23d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:41.742585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15721dab-9e45-4028-8ee5-9bc16c5f23d0 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:41.742865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15721dab-9e45-4028-8ee5-9bc16c5f23d0 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:41.743137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15721dab-9e45-4028-8ee5-9bc16c5f23d0 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:41.743764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15721dab-9e45-4028-8ee5-9bc16c5f23d0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:41.744066 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15721dab-9e45-4028-8ee5-9bc16c5f23d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:41.745432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15721dab-9e45-4028-8ee5-9bc16c5f23d0 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:41.754976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 509/1015] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 05:22:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:41.755951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1ae73-b7cd-4721-8cc7-f68101a7b6d3 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:41.770563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15721dab-9e45-4028-8ee5-9bc16c5f23d0 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:41.855921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1ae73-b7cd-4721-8cc7-f68101a7b6d3 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:41.876335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15721dab-9e45-4028-8ee5-9bc16c5f23d0 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:41.891732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6b76d-ef39-4a49-9eaf-be69c2f55bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:41.892538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6b76d-ef39-4a49-9eaf-be69c2f55bb2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:41.892823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6b76d-ef39-4a49-9eaf-be69c2f55bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:41.893334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6b76d-ef39-4a49-9eaf-be69c2f55bb2 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:41.893848 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6b76d-ef39-4a49-9eaf-be69c2f55bb2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:41.894196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6b76d-ef39-4a49-9eaf-be69c2f55bb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:41.895699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6b76d-ef39-4a49-9eaf-be69c2f55bb2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:41.901210 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 507/1016] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 05:22:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:41.907352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6b76d-ef39-4a49-9eaf-be69c2f55bb2 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:41.914965 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4115ed2-fa66-46bc-a09f-7020ed0ca9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:41.915583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4115ed2-fa66-46bc-a09f-7020ed0ca9c7 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:41.915857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4115ed2-fa66-46bc-a09f-7020ed0ca9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:41.916122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4115ed2-fa66-46bc-a09f-7020ed0ca9c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:41.917217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4115ed2-fa66-46bc-a09f-7020ed0ca9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:41.918665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4115ed2-fa66-46bc-a09f-7020ed0ca9c7 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:41.920729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 510/1017] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:41.926106 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4115ed2-fa66-46bc-a09f-7020ed0ca9c7 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:41.946890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:41.951157 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:42.018971 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6b76d-ef39-4a49-9eaf-be69c2f55bb2 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:42.028528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4115ed2-fa66-46bc-a09f-7020ed0ca9c7 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:42.052104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71e03d-a1ae-4cce-bde0-4cd2587d6947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:42.052709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e03d-a1ae-4cce-bde0-4cd2587d6947 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:42.052987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e03d-a1ae-4cce-bde0-4cd2587d6947 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:42.053262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e03d-a1ae-4cce-bde0-4cd2587d6947 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:42.053921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71e03d-a1ae-4cce-bde0-4cd2587d6947 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:42.055324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71e03d-a1ae-4cce-bde0-4cd2587d6947 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:42.065259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3061d-1136-4fca-be11-091c9cb35ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:42.065860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3061d-1136-4fca-be11-091c9cb35ffc None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:42.066168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3061d-1136-4fca-be11-091c9cb35ffc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:42.066471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3061d-1136-4fca-be11-091c9cb35ffc None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:42.067263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3061d-1136-4fca-be11-091c9cb35ffc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:42.068830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3061d-1136-4fca-be11-091c9cb35ffc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:42.075082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 508/1018] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:22:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:22:42.079442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71e03d-a1ae-4cce-bde0-4cd2587d6947 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:42.097383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 511/1019] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:22:41 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:22:42.200348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:42.222446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71e03d-a1ae-4cce-bde0-4cd2587d6947 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:42.271792 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f62bd-3e87-4bc5-9ded-f740a270522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:42.272419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f62bd-3e87-4bc5-9ded-f740a270522d None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:42.272699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f62bd-3e87-4bc5-9ded-f740a270522d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:42.272970 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f62bd-3e87-4bc5-9ded-f740a270522d None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:42.273633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f62bd-3e87-4bc5-9ded-f740a270522d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:42.275089 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f62bd-3e87-4bc5-9ded-f740a270522d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:42.294997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 509/1020] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:22:42 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:22:44.369850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbad2e-7842-4996-b155-d463264d890f None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:44.370387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbad2e-7842-4996-b155-d463264d890f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:44.370387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbad2e-7842-4996-b155-d463264d890f None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:44.371833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 512/1021] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:44.378082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a93ec-956c-4887-9555-bf32de9b6876 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:44.378742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a93ec-956c-4887-9555-bf32de9b6876 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:44.378742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a93ec-956c-4887-9555-bf32de9b6876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:44.398748 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-e11a93ec-956c-4887-9555-bf32de9b6876 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:44.399979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e11a93ec-956c-4887-9555-bf32de9b6876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:44.460698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71055ea3-a337-4f42-8155-b6bb35ffee7c None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:44.460982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71055ea3-a337-4f42-8155-b6bb35ffee7c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:44.461260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71055ea3-a337-4f42-8155-b6bb35ffee7c None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:44.462619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 513/1022] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:44.468383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301af94-7ec8-4df4-9960-98021691b7ba None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:44.468987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301af94-7ec8-4df4-9960-98021691b7ba None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:44.469272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301af94-7ec8-4df4-9960-98021691b7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:44.479196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 510/1023] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:44.488871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-b301af94-7ec8-4df4-9960-98021691b7ba None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:44.490081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b301af94-7ec8-4df4-9960-98021691b7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:44.491201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a6208-0bd1-4df4-8ef0-3d694fefcd82 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:44.491498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a6208-0bd1-4df4-8ef0-3d694fefcd82 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:44.491824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a6208-0bd1-4df4-8ef0-3d694fefcd82 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:44.494199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 511/1024] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:22:44.499982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c94344-49e0-4431-99c3-3d5e4ae1ba4c None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:44.500265 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c94344-49e0-4431-99c3-3d5e4ae1ba4c None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:44.500540 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c94344-49e0-4431-99c3-3d5e4ae1ba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:44.518927 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-51c94344-49e0-4431-99c3-3d5e4ae1ba4c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:44.520124 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-51c94344-49e0-4431-99c3-3d5e4ae1ba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:44.562996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 514/1025] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:44.590548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 512/1026] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:44.747597 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301af94-7ec8-4df4-9960-98021691b7ba None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:44.751091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:44.833652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c94344-49e0-4431-99c3-3d5e4ae1ba4c None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:44.837948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:44.861265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301af94-7ec8-4df4-9960-98021691b7ba None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:44.900074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b52a77-fd4e-4848-a646-083d9bfba5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:44.900705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b52a77-fd4e-4848-a646-083d9bfba5b4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:44.900980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b52a77-fd4e-4848-a646-083d9bfba5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:44.901257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b52a77-fd4e-4848-a646-083d9bfba5b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:44.902371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b52a77-fd4e-4848-a646-083d9bfba5b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:44.904490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b52a77-fd4e-4848-a646-083d9bfba5b4 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:44.906101 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 515/1027] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:44.909174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b52a77-fd4e-4848-a646-083d9bfba5b4 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:44.940408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c94344-49e0-4431-99c3-3d5e4ae1ba4c None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:44.975143 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2d032-93c6-4f1c-94f5-78bf2cefd804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:44.975777 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2d032-93c6-4f1c-94f5-78bf2cefd804 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:44.976056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2d032-93c6-4f1c-94f5-78bf2cefd804 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:44.976334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2d032-93c6-4f1c-94f5-78bf2cefd804 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:44.978592 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:44.986894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2d032-93c6-4f1c-94f5-78bf2cefd804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-2ab2d032-93c6-4f1c-94f5-78bf2cefd804 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:44.991699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:44.992662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 513/1028] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 16 05:22:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:44.993521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2d032-93c6-4f1c-94f5-78bf2cefd804 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:45.014205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b52a77-fd4e-4848-a646-083d9bfba5b4 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:45.047947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4260243-0ff6-4163-843e-af63b3fbc567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:45.048559 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4260243-0ff6-4163-843e-af63b3fbc567 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:45.048833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4260243-0ff6-4163-843e-af63b3fbc567 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:45.049096 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4260243-0ff6-4163-843e-af63b3fbc567 None admin] PATH_INFO: `/v3/services/image` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:45.049673 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4260243-0ff6-4163-843e-af63b3fbc567 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:45.051067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4260243-0ff6-4163-843e-af63b3fbc567 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:45.053378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-d4260243-0ff6-4163-843e-af63b3fbc567 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:45.059907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:45.060916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:45.062025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 516/1029] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Sep 16 05:22:44 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:45.062885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4260243-0ff6-4163-843e-af63b3fbc567 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:45.096117 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2d032-93c6-4f1c-94f5-78bf2cefd804 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:45.130834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984917e-3acb-4dfa-9ae7-d6f8a321519c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:45.131434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984917e-3acb-4dfa-9ae7-d6f8a321519c None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:45.131714 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984917e-3acb-4dfa-9ae7-d6f8a321519c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:45.131984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984917e-3acb-4dfa-9ae7-d6f8a321519c None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:45.132623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984917e-3acb-4dfa-9ae7-d6f8a321519c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:45.134059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984917e-3acb-4dfa-9ae7-d6f8a321519c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:45.156816 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 514/1030] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:22:44 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:22:45.157616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984917e-3acb-4dfa-9ae7-d6f8a321519c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:45.163815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4260243-0ff6-4163-843e-af63b3fbc567 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:45.208092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef991b-8daf-4e8d-b8a7-3afb68c8058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:45.208893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef991b-8daf-4e8d-b8a7-3afb68c8058e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:45.209172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef991b-8daf-4e8d-b8a7-3afb68c8058e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:45.209556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef991b-8daf-4e8d-b8a7-3afb68c8058e None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:45.210568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef991b-8daf-4e8d-b8a7-3afb68c8058e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:45.210861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef991b-8daf-4e8d-b8a7-3afb68c8058e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:45.213718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef991b-8daf-4e8d-b8a7-3afb68c8058e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:45.217915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:45.226916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 517/1031] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 05:22:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:45.232874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef991b-8daf-4e8d-b8a7-3afb68c8058e None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:45.291379 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984917e-3acb-4dfa-9ae7-d6f8a321519c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:45.314140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:45.333242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e908666-58b6-40bc-a617-443b8faec364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:45.333865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e908666-58b6-40bc-a617-443b8faec364 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:45.334146 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e908666-58b6-40bc-a617-443b8faec364 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:45.334417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e908666-58b6-40bc-a617-443b8faec364 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:45.335085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e908666-58b6-40bc-a617-443b8faec364 None admin] RBAC: Adding query filter params (name=image) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:45.335468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e908666-58b6-40bc-a617-443b8faec364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:45.336863 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e908666-58b6-40bc-a617-443b8faec364 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:45.342068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 515/1032] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:45.348891 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e908666-58b6-40bc-a617-443b8faec364 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:45.356205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef991b-8daf-4e8d-b8a7-3afb68c8058e None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:45.400436 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62650d9c-c005-489f-925c-8f3f5e930678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:45.401082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62650d9c-c005-489f-925c-8f3f5e930678 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:45.401340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62650d9c-c005-489f-925c-8f3f5e930678 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:45.401615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62650d9c-c005-489f-925c-8f3f5e930678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:45.415812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62650d9c-c005-489f-925c-8f3f5e930678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:45.417266 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62650d9c-c005-489f-925c-8f3f5e930678 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-62650d9c-c005-489f-925c-8f3f5e930678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:45.434150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:45.435864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:45.437047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:45.437047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:45.437047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:45.437047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 518/1033] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:45.442906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62650d9c-c005-489f-925c-8f3f5e930678 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:45.460740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e908666-58b6-40bc-a617-443b8faec364 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:45.499156 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:45.499598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ac4d0-c803-4c8b-8608-a2e0f019c7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:45.500206 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ac4d0-c803-4c8b-8608-a2e0f019c7fb None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:45.500685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ac4d0-c803-4c8b-8608-a2e0f019c7fb None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:45.500951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ac4d0-c803-4c8b-8608-a2e0f019c7fb None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:45.501571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ac4d0-c803-4c8b-8608-a2e0f019c7fb None admin] RBAC: Adding query filter params (type=image) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:45.501867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ac4d0-c803-4c8b-8608-a2e0f019c7fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:45.503548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ac4d0-c803-4c8b-8608-a2e0f019c7fb None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:45.509592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 516/1034] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:45.516520 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ac4d0-c803-4c8b-8608-a2e0f019c7fb None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:45.558354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62650d9c-c005-489f-925c-8f3f5e930678 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:45.568478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:45.596895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9989a5-b0aa-4f7e-916b-dd4b06d2e1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:45.597601 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9989a5-b0aa-4f7e-916b-dd4b06d2e1fc None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:45.597882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9989a5-b0aa-4f7e-916b-dd4b06d2e1fc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:45.598182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9989a5-b0aa-4f7e-916b-dd4b06d2e1fc None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:45.598833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9989a5-b0aa-4f7e-916b-dd4b06d2e1fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:45.599135 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9989a5-b0aa-4f7e-916b-dd4b06d2e1fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:45.600591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9989a5-b0aa-4f7e-916b-dd4b06d2e1fc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:45.613329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 519/1035] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:45.618655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9989a5-b0aa-4f7e-916b-dd4b06d2e1fc None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:45.624073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ac4d0-c803-4c8b-8608-a2e0f019c7fb None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:45.658940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396ac3a-25b1-4f7c-bf76-b41f710d82fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:45.659551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396ac3a-25b1-4f7c-bf76-b41f710d82fb None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:45.659832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396ac3a-25b1-4f7c-bf76-b41f710d82fb None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:45.660104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396ac3a-25b1-4f7c-bf76-b41f710d82fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:45.660805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396ac3a-25b1-4f7c-bf76-b41f710d82fb None admin] RBAC: Adding query filter params (interface=public, service_id=e8e85aab79684349a73e3ce7f589cc5d, region_id=RegionOne) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:45.661113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396ac3a-25b1-4f7c-bf76-b41f710d82fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:45.662486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396ac3a-25b1-4f7c-bf76-b41f710d82fb None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:45.672572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 517/1036] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 05:22:45 2022] GET /identity/v3/endpoints?service_id=e8e85aab79684349a73e3ce7f589cc5d&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:45.674236 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396ac3a-25b1-4f7c-bf76-b41f710d82fb None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:45.725046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9989a5-b0aa-4f7e-916b-dd4b06d2e1fc None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:45.737493 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:45.763790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba14fa-8a0f-45ed-97c3-982d1bcd56dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:45.764422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba14fa-8a0f-45ed-97c3-982d1bcd56dc None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:45.764701 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba14fa-8a0f-45ed-97c3-982d1bcd56dc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:45.764974 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba14fa-8a0f-45ed-97c3-982d1bcd56dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:45.772513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba14fa-8a0f-45ed-97c3-982d1bcd56dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:45.773987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba14fa-8a0f-45ed-97c3-982d1bcd56dc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:45.784073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396ac3a-25b1-4f7c-bf76-b41f710d82fb None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-4aba14fa-8a0f-45ed-97c3-982d1bcd56dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:45.786907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:45.787889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:45.788842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:45.788842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:45.788842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:45.788842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:45.788842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:45.788842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:45.788842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:45.788842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:45.788842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:22:45.788842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:45.788842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 520/1037] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 05:22:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:45.793808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba14fa-8a0f-45ed-97c3-982d1bcd56dc None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:45.800335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:45.829547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801f7c-ad38-48eb-b09f-1af3a747a2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:45.830404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801f7c-ad38-48eb-b09f-1af3a747a2b3 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:45.830867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801f7c-ad38-48eb-b09f-1af3a747a2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:45.831140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801f7c-ad38-48eb-b09f-1af3a747a2b3 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:45.831811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11801f7c-ad38-48eb-b09f-1af3a747a2b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:45.833186 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11801f7c-ad38-48eb-b09f-1af3a747a2b3 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:45.840001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 518/1038] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 05:22:45 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:22:45.908976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba14fa-8a0f-45ed-97c3-982d1bcd56dc None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:45.945072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34409c39-3eb1-47b6-942d-9701ffa83d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:45.945689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409c39-3eb1-47b6-942d-9701ffa83d9d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:45.945970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409c39-3eb1-47b6-942d-9701ffa83d9d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:45.946228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409c39-3eb1-47b6-942d-9701ffa83d9d None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:45.946994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34409c39-3eb1-47b6-942d-9701ffa83d9d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:45.947298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34409c39-3eb1-47b6-942d-9701ffa83d9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:45.948751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34409c39-3eb1-47b6-942d-9701ffa83d9d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:45.973810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 521/1039] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 05:22:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:45.975326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801f7c-ad38-48eb-b09f-1af3a747a2b3 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:46.078173 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801f7c-ad38-48eb-b09f-1af3a747a2b3 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:46.116006 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f505-6a5a-428c-b573-bc139308aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:46.116500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f505-6a5a-428c-b573-bc139308aa00 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:46.116767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f505-6a5a-428c-b573-bc139308aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:46.117035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f505-6a5a-428c-b573-bc139308aa00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:46.165381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:46.190418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305f505-6a5a-428c-b573-bc139308aa00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:46.191898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305f505-6a5a-428c-b573-bc139308aa00 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:46.299939 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 519/1040] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:22:45 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:22:46.301149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34409c39-3eb1-47b6-942d-9701ffa83d9d None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:46.331528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:46.403016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34409c39-3eb1-47b6-942d-9701ffa83d9d None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:46.441741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519f320-79ab-4a4c-b442-f7121ddb164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:46.442354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519f320-79ab-4a4c-b442-f7121ddb164a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:46.442818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519f320-79ab-4a4c-b442-f7121ddb164a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:46.443092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519f320-79ab-4a4c-b442-f7121ddb164a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:46.452927 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519f320-79ab-4a4c-b442-f7121ddb164a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:46.454345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519f320-79ab-4a4c-b442-f7121ddb164a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-0519f320-79ab-4a4c-b442-f7121ddb164a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:46.468665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:46.469607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:46.475174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:46.475174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:46.475174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:46.475174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 522/1041] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:46.475678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f505-6a5a-428c-b573-bc139308aa00 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:46.551168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:46.575982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f505-6a5a-428c-b573-bc139308aa00 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:46.610166 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f18e28-6fa3-4939-ab3a-618c30ad9c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:46.610865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18e28-6fa3-4939-ab3a-618c30ad9c71 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:46.611142 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18e28-6fa3-4939-ab3a-618c30ad9c71 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:46.611408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18e28-6fa3-4939-ab3a-618c30ad9c71 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:46.612028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f18e28-6fa3-4939-ab3a-618c30ad9c71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:46.612321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f18e28-6fa3-4939-ab3a-618c30ad9c71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:46.613689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f18e28-6fa3-4939-ab3a-618c30ad9c71 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:46.629815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 520/1042] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:46.631095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519f320-79ab-4a4c-b442-f7121ddb164a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:46.713746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:46.736772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519f320-79ab-4a4c-b442-f7121ddb164a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:46.772478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e1cf1-7b18-4e9f-97d4-74e1463b2195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:46.773308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1cf1-7b18-4e9f-97d4-74e1463b2195 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:46.773737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1cf1-7b18-4e9f-97d4-74e1463b2195 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:46.774184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1cf1-7b18-4e9f-97d4-74e1463b2195 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:46.781343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e1cf1-7b18-4e9f-97d4-74e1463b2195 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:46.782957 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e1cf1-7b18-4e9f-97d4-74e1463b2195 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-300e1cf1-7b18-4e9f-97d4-74e1463b2195 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:46.794643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:46.795709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:46.796798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:46.796798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:46.796798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:46.796798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:46.796798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:46.796798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:46.796798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:46.796798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:46.802831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 523/1043] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:46.804540 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f18e28-6fa3-4939-ab3a-618c30ad9c71 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:46.904812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f18e28-6fa3-4939-ab3a-618c30ad9c71 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:46.937628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4295598-d291-4d1d-a2b3-a6f591e889bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:46.938224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4295598-d291-4d1d-a2b3-a6f591e889bd None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:46.938515 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4295598-d291-4d1d-a2b3-a6f591e889bd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:46.938793 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4295598-d291-4d1d-a2b3-a6f591e889bd None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:46.939470 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4295598-d291-4d1d-a2b3-a6f591e889bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:46.939770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4295598-d291-4d1d-a2b3-a6f591e889bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:46.941191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4295598-d291-4d1d-a2b3-a6f591e889bd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:46.943668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:46.958556 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 521/1044] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:46.961990 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e1cf1-7b18-4e9f-97d4-74e1463b2195 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:47.064883 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e1cf1-7b18-4e9f-97d4-74e1463b2195 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:47.098654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ce0d2-a2a8-4212-9f41-02ab1732d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:47.099253 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ce0d2-a2a8-4212-9f41-02ab1732d842 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:47.099528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ce0d2-a2a8-4212-9f41-02ab1732d842 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:47.099795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ce0d2-a2a8-4212-9f41-02ab1732d842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:47.100508 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ce0d2-a2a8-4212-9f41-02ab1732d842 None admin] RBAC: Adding query filter params (role.id=11289567b2a34360b50a87f6edc79703, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=515e548efd984b87bca742e26eec162a) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:47.100810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ce0d2-a2a8-4212-9f41-02ab1732d842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:47.102222 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ce0d2-a2a8-4212-9f41-02ab1732d842 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:47.108329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 524/1045] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:22:46 2022] GET /identity/v3/role_assignments?user.id=515e548efd984b87bca742e26eec162a&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=11289567b2a34360b50a87f6edc79703 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:47.440309 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565410ae-a93c-4304-9cf0-4265cb40154e None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:47.440606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565410ae-a93c-4304-9cf0-4265cb40154e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:47.440770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565410ae-a93c-4304-9cf0-4265cb40154e None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:47.442253 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 522/1046] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:47.447458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf80699-3199-40bb-8bf3-6d3404a0d89d None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:47.447918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf80699-3199-40bb-8bf3-6d3404a0d89d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:47.447995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf80699-3199-40bb-8bf3-6d3404a0d89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:47.455863 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:47.468434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-7cf80699-3199-40bb-8bf3-6d3404a0d89d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:47.469620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7cf80699-3199-40bb-8bf3-6d3404a0d89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:47.542557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 525/1047] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:47.818807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565410ae-a93c-4304-9cf0-4265cb40154e None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:47.927627 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565410ae-a93c-4304-9cf0-4265cb40154e None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:47.963297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcd46d-22e4-498a-a5dc-d357cff44a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:47.963919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcd46d-22e4-498a-a5dc-d357cff44a1a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:47.964199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcd46d-22e4-498a-a5dc-d357cff44a1a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:47.964465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcd46d-22e4-498a-a5dc-d357cff44a1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:47.975808 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbcd46d-22e4-498a-a5dc-d357cff44a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-fbbcd46d-22e4-498a-a5dc-d357cff44a1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:47.980893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:47.981945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:47.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:47.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:47.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:47.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:47.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:47.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:47.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:47.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:47.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:47.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:47.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:47.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:47.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 523/1048] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:22:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:47.988240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf80699-3199-40bb-8bf3-6d3404a0d89d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:48.008266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef3afb-fcfc-4ab9-beae-bd5ab9a24ea8 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:48.008567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef3afb-fcfc-4ab9-beae-bd5ab9a24ea8 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:48.008841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef3afb-fcfc-4ab9-beae-bd5ab9a24ea8 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:48.010443 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 524/1049] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:22:48.016277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba92af-42d6-4d0b-b9ec-dd3089366879 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:48.016554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba92af-42d6-4d0b-b9ec-dd3089366879 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:48.016822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba92af-42d6-4d0b-b9ec-dd3089366879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:48.035763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-cbba92af-42d6-4d0b-b9ec-dd3089366879 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:48.037196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-cbba92af-42d6-4d0b-b9ec-dd3089366879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:48.089232 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:48.090039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf80699-3199-40bb-8bf3-6d3404a0d89d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:48.110693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 525/1050] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:48.128082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8d099-4ccb-49be-be56-714222aa4ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:48.128686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8d099-4ccb-49be-be56-714222aa4ae3 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:48.128966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8d099-4ccb-49be-be56-714222aa4ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:48.129227 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8d099-4ccb-49be-be56-714222aa4ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:48.129881 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8d099-4ccb-49be-be56-714222aa4ae3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:48.130181 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8d099-4ccb-49be-be56-714222aa4ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:48.131566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8d099-4ccb-49be-be56-714222aa4ae3 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:48.132981 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:48.145934 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 526/1051] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:22:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:48.147176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba92af-42d6-4d0b-b9ec-dd3089366879 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:48.250318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba92af-42d6-4d0b-b9ec-dd3089366879 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:48.283841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff74da2-450b-41d8-bdad-a30985f798d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:48.284463 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff74da2-450b-41d8-bdad-a30985f798d2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:48.284734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff74da2-450b-41d8-bdad-a30985f798d2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:48.284999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff74da2-450b-41d8-bdad-a30985f798d2 None admin] PATH_INFO: `/v3/users/f2ca5335431841178417d23c8906cdb8` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:48.297872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff74da2-450b-41d8-bdad-a30985f798d2 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ca5335431841178417d23c8906cdb8)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:48.299334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff74da2-450b-41d8-bdad-a30985f798d2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:48.305858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 526/1052] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:22:48 2022] GET /identity/v3/users/f2ca5335431841178417d23c8906cdb8 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:48.307029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8d099-4ccb-49be-be56-714222aa4ae3 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:48.398470 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff74da2-450b-41d8-bdad-a30985f798d2 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:48.409733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8d099-4ccb-49be-be56-714222aa4ae3 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:48.444978 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:48.453053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fc19e-4082-45d3-a76a-c6716aad3951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:48.454016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fc19e-4082-45d3-a76a-c6716aad3951 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:48.454016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fc19e-4082-45d3-a76a-c6716aad3951 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:48.454189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fc19e-4082-45d3-a76a-c6716aad3951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:48.503984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff74da2-450b-41d8-bdad-a30985f798d2 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:48.520766 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:48.529339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fc19e-4082-45d3-a76a-c6716aad3951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:48.531107 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fc19e-4082-45d3-a76a-c6716aad3951 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:48.540857 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ca82e-85b9-49fa-89ca-d179b3cb9411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:48.541482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ca82e-85b9-49fa-89ca-d179b3cb9411 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:48.541755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ca82e-85b9-49fa-89ca-d179b3cb9411 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:48.542022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ca82e-85b9-49fa-89ca-d179b3cb9411 None admin] PATH_INFO: `/v3/services/image` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:48.542623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ca82e-85b9-49fa-89ca-d179b3cb9411 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:48.543999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ca82e-85b9-49fa-89ca-d179b3cb9411 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-258ca82e-85b9-49fa-89ca-d179b3cb9411 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:48.553349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:48.554347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:48.555286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 527/1053] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Sep 16 05:22:48 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:48.560830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ca82e-85b9-49fa-89ca-d179b3cb9411 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:48.641097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 527/1054] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:22:48 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 05:22:48.646838 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fc19e-4082-45d3-a76a-c6716aad3951 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:48.663736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ca82e-85b9-49fa-89ca-d179b3cb9411 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:48.674322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:48.701609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e52075-22af-436e-8e45-fbb12ba7db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:48.702207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e52075-22af-436e-8e45-fbb12ba7db00 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:48.702617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e52075-22af-436e-8e45-fbb12ba7db00 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:48.702884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e52075-22af-436e-8e45-fbb12ba7db00 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:48.703606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e52075-22af-436e-8e45-fbb12ba7db00 None admin] RBAC: Adding query filter params (name=image) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:48.703902 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e52075-22af-436e-8e45-fbb12ba7db00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:48.705492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e52075-22af-436e-8e45-fbb12ba7db00 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:48.710875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 528/1055] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:48.717004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e52075-22af-436e-8e45-fbb12ba7db00 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:48.742257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:48.749382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fc19e-4082-45d3-a76a-c6716aad3951 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:48.791330 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf6310-bc30-4d8e-97ee-5542cdf67665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:48.791964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf6310-bc30-4d8e-97ee-5542cdf67665 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:48.792243 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf6310-bc30-4d8e-97ee-5542cdf67665 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:48.792515 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf6310-bc30-4d8e-97ee-5542cdf67665 None admin] PATH_INFO: `/v3/projects/b276ce53b5674c0ab665917c43e4c984` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:48.793644 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf6310-bc30-4d8e-97ee-5542cdf67665 None admin] RBAC: Authorizing `identity:get_project(project_id=b276ce53b5674c0ab665917c43e4c984)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:48.795198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf6310-bc30-4d8e-97ee-5542cdf67665 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:48.797005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 528/1056] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:22:48 2022] GET /identity/v3/projects/b276ce53b5674c0ab665917c43e4c984 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:48.802879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf6310-bc30-4d8e-97ee-5542cdf67665 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:48.826243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e52075-22af-436e-8e45-fbb12ba7db00 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:48.861700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef9045-6820-449e-95b7-c0e73654cbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:48.862410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef9045-6820-449e-95b7-c0e73654cbf8 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:48.862710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef9045-6820-449e-95b7-c0e73654cbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:48.863098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef9045-6820-449e-95b7-c0e73654cbf8 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:48.863717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef9045-6820-449e-95b7-c0e73654cbf8 None admin] RBAC: Adding query filter params (type=image) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:48.864032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef9045-6820-449e-95b7-c0e73654cbf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:48.865483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef9045-6820-449e-95b7-c0e73654cbf8 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:48.875426 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 529/1057] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:48.876273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef9045-6820-449e-95b7-c0e73654cbf8 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:48.905358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf6310-bc30-4d8e-97ee-5542cdf67665 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:48.911621 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:48.940560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12d65a-8ca5-4196-9317-baf985381a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:48.941085 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12d65a-8ca5-4196-9317-baf985381a5b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:48.941369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12d65a-8ca5-4196-9317-baf985381a5b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:48.941635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12d65a-8ca5-4196-9317-baf985381a5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:48.942385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12d65a-8ca5-4196-9317-baf985381a5b None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=b276ce53b5674c0ab665917c43e4c984, user.id=f2ca5335431841178417d23c8906cdb8) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:48.942715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12d65a-8ca5-4196-9317-baf985381a5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:48.944134 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12d65a-8ca5-4196-9317-baf985381a5b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:48.958545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 529/1058] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:22:48 2022] GET /identity/v3/role_assignments?user.id=f2ca5335431841178417d23c8906cdb8&scope.project.id=b276ce53b5674c0ab665917c43e4c984&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:48.987551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef9045-6820-449e-95b7-c0e73654cbf8 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:49.025481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f539027-73b8-46ae-81d9-d3169454acb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:49.026186 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f539027-73b8-46ae-81d9-d3169454acb5 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:49.026464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f539027-73b8-46ae-81d9-d3169454acb5 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:49.026758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f539027-73b8-46ae-81d9-d3169454acb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:49.027430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f539027-73b8-46ae-81d9-d3169454acb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:49.028854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f539027-73b8-46ae-81d9-d3169454acb5 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:49.050143 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 530/1059] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:22:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:22:49.284689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084de53e-2938-44ea-b78d-bdac94b82b6b None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:49.284966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084de53e-2938-44ea-b78d-bdac94b82b6b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:49.285236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084de53e-2938-44ea-b78d-bdac94b82b6b None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:49.286597 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 530/1060] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:49.292085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842bc55-0eb1-45af-8138-07b2ebdb9518 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:49.292371 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842bc55-0eb1-45af-8138-07b2ebdb9518 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:49.292638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842bc55-0eb1-45af-8138-07b2ebdb9518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:49.311814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-2842bc55-0eb1-45af-8138-07b2ebdb9518 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:49.313000 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2842bc55-0eb1-45af-8138-07b2ebdb9518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:49.387688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 531/1061] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:49.659885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084de53e-2938-44ea-b78d-bdac94b82b6b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:49.688764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:49.763199 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084de53e-2938-44ea-b78d-bdac94b82b6b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:49.796732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b736a-dbc3-402c-a39c-4c94f9bf8b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:49.797351 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b736a-dbc3-402c-a39c-4c94f9bf8b99 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:49.797680 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b736a-dbc3-402c-a39c-4c94f9bf8b99 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:49.797952 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b736a-dbc3-402c-a39c-4c94f9bf8b99 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:49.807938 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b736a-dbc3-402c-a39c-4c94f9bf8b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-e75b736a-dbc3-402c-a39c-4c94f9bf8b99 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:49.813002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:49.813928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:49.814826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:49.814826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:49.814826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:49.814826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:49.814826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:49.814826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:49.814826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:49.814826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:49.814826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:49.814826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:49.814826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 05:22:49.814826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:49.814826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 531/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 16 05:22:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:49.821740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842bc55-0eb1-45af-8138-07b2ebdb9518 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:49.841507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:49.926395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842bc55-0eb1-45af-8138-07b2ebdb9518 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:49.960247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dc645-292a-4b52-a72a-3c0cc50a559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:49.960870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dc645-292a-4b52-a72a-3c0cc50a559a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:49.961147 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dc645-292a-4b52-a72a-3c0cc50a559a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:49.961410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dc645-292a-4b52-a72a-3c0cc50a559a None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:49.962078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dc645-292a-4b52-a72a-3c0cc50a559a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:49.962377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dc645-292a-4b52-a72a-3c0cc50a559a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:49.963821 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dc645-292a-4b52-a72a-3c0cc50a559a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:49.973180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 532/1063] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 05:22:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:49.978803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b736a-dbc3-402c-a39c-4c94f9bf8b99 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:50.065531 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:50.079164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b736a-dbc3-402c-a39c-4c94f9bf8b99 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:50.112828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54284d7-e145-40d5-b141-a10ea65e318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:50.113442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54284d7-e145-40d5-b141-a10ea65e318d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:50.113715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54284d7-e145-40d5-b141-a10ea65e318d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:50.113979 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54284d7-e145-40d5-b141-a10ea65e318d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:50.123852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54284d7-e145-40d5-b141-a10ea65e318d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:50.125276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54284d7-e145-40d5-b141-a10ea65e318d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-c54284d7-e145-40d5-b141-a10ea65e318d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:50.139860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:50.140809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:50.141710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:50.141710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:50.141710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:50.142813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 532/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:50.146723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dc645-292a-4b52-a72a-3c0cc50a559a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:50.230531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:50.253485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dc645-292a-4b52-a72a-3c0cc50a559a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:50.287396 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44b934-09af-42b8-a4ce-a4bb81aa97ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:50.287994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44b934-09af-42b8-a4ce-a4bb81aa97ce None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:50.288270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44b934-09af-42b8-a4ce-a4bb81aa97ce None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:50.288537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44b934-09af-42b8-a4ce-a4bb81aa97ce None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:50.289162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44b934-09af-42b8-a4ce-a4bb81aa97ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:50.289459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44b934-09af-42b8-a4ce-a4bb81aa97ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:50.290867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44b934-09af-42b8-a4ce-a4bb81aa97ce None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:50.302567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 533/1065] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:50.308190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54284d7-e145-40d5-b141-a10ea65e318d None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:50.410991 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54284d7-e145-40d5-b141-a10ea65e318d None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:50.443932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c741d2-949e-456f-abfd-18901747c0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:50.444550 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c741d2-949e-456f-abfd-18901747c0ff None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:50.444826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c741d2-949e-456f-abfd-18901747c0ff None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:50.445094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c741d2-949e-456f-abfd-18901747c0ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:50.452922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c741d2-949e-456f-abfd-18901747c0ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:50.454346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c741d2-949e-456f-abfd-18901747c0ff None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:50.456873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-c8c741d2-949e-456f-abfd-18901747c0ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:50.467585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:50.468528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:50.474298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:50.474298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:50.474298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:50.474298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:50.474298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:50.474298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:50.474298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:50.474298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:50.474298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:22:50.474298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:50.474298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 533/1066] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 05:22:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:50.476348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44b934-09af-42b8-a4ce-a4bb81aa97ce None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:50.574798 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44b934-09af-42b8-a4ce-a4bb81aa97ce None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:50.608592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07582f4-3437-4f6f-a016-775097ea7544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:50.609202 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07582f4-3437-4f6f-a016-775097ea7544 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:50.609477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07582f4-3437-4f6f-a016-775097ea7544 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:50.609744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07582f4-3437-4f6f-a016-775097ea7544 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:50.610460 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07582f4-3437-4f6f-a016-775097ea7544 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:50.610803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07582f4-3437-4f6f-a016-775097ea7544 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:50.612239 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07582f4-3437-4f6f-a016-775097ea7544 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:50.621203 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:50.636212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 534/1067] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 05:22:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:50.638613 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c741d2-949e-456f-abfd-18901747c0ff None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:50.736827 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c741d2-949e-456f-abfd-18901747c0ff None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:50.773116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae587-ce63-401a-88f9-33f591794588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:50.773739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae587-ce63-401a-88f9-33f591794588 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:50.774017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae587-ce63-401a-88f9-33f591794588 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:50.774288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae587-ce63-401a-88f9-33f591794588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:50.785077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ae587-ce63-401a-88f9-33f591794588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:50.786534 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ae587-ce63-401a-88f9-33f591794588 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-233ae587-ce63-401a-88f9-33f591794588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:50.800514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:50.801450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:50.807099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:50.807099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:50.807099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:50.807099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 534/1068] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:50.808832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07582f4-3437-4f6f-a016-775097ea7544 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:50.909494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07582f4-3437-4f6f-a016-775097ea7544 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:50.943828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672ab91-7ca7-47a0-b0d2-6539d491319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:50.944431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672ab91-7ca7-47a0-b0d2-6539d491319a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:50.944708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672ab91-7ca7-47a0-b0d2-6539d491319a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:50.944977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672ab91-7ca7-47a0-b0d2-6539d491319a None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:50.945608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672ab91-7ca7-47a0-b0d2-6539d491319a None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:50.945905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672ab91-7ca7-47a0-b0d2-6539d491319a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:50.947306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672ab91-7ca7-47a0-b0d2-6539d491319a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:50.963027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 535/1069] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:50.964906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae587-ce63-401a-88f9-33f591794588 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:51.024128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:51.073942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae587-ce63-401a-88f9-33f591794588 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:51.109366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d670ee-e44a-4288-9caa-4f08dc2a7c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:51.110026 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d670ee-e44a-4288-9caa-4f08dc2a7c31 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:51.110300 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d670ee-e44a-4288-9caa-4f08dc2a7c31 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:51.110818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d670ee-e44a-4288-9caa-4f08dc2a7c31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:51.112343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42af49-18d6-4527-af18-1fa68690b24e None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:51.112626 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42af49-18d6-4527-af18-1fa68690b24e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:51.112908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42af49-18d6-4527-af18-1fa68690b24e None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:51.114301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 536/1070] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:51.119598 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d670ee-e44a-4288-9caa-4f08dc2a7c31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:51.120031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c6aa-730f-45ba-9259-56df7643518d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:51.120319 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c6aa-730f-45ba-9259-56df7643518d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:51.120592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c6aa-730f-45ba-9259-56df7643518d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:51.121088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d670ee-e44a-4288-9caa-4f08dc2a7c31 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-c9d670ee-e44a-4288-9caa-4f08dc2a7c31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:51.135048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:51.136058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:51.136950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:51.136950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:51.136950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:51.136950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:51.136950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:51.136950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:51.136950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:51.136950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:51.136950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 535/1071] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:51.141913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d670ee-e44a-4288-9caa-4f08dc2a7c31 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:51.144245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-7971c6aa-730f-45ba-9259-56df7643518d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:51.146780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-7971c6aa-730f-45ba-9259-56df7643518d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:51.213431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:51.229753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 537/1072] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:51.231758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da959679-cf18-45a4-9ef7-e172e45699df None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:51.232043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da959679-cf18-45a4-9ef7-e172e45699df None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:51.232311 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da959679-cf18-45a4-9ef7-e172e45699df None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:51.234024 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 538/1073] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:51.239386 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa320f-19e1-49d6-ab69-0118c9409263 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:51.239667 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa320f-19e1-49d6-ab69-0118c9409263 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:51.239933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa320f-19e1-49d6-ab69-0118c9409263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:51.263336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-f4aa320f-19e1-49d6-ab69-0118c9409263 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:51.264407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d670ee-e44a-4288-9caa-4f08dc2a7c31 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:51.264536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f4aa320f-19e1-49d6-ab69-0118c9409263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:51.277919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:51.299120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfb67c-3385-421d-9b40-797761105e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:51.299718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfb67c-3385-421d-9b40-797761105e5f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:51.299993 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfb67c-3385-421d-9b40-797761105e5f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:51.300260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfb67c-3385-421d-9b40-797761105e5f None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:51.300941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfb67c-3385-421d-9b40-797761105e5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:51.301242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfb67c-3385-421d-9b40-797761105e5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:51.302687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfb67c-3385-421d-9b40-797761105e5f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:51.315136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 536/1074] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:51.320777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfb67c-3385-421d-9b40-797761105e5f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:51.338645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 539/1075] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:51.416325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfb67c-3385-421d-9b40-797761105e5f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:51.449935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5cfed-bd5a-44f5-b7a8-64be2675c606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:51.451137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5cfed-bd5a-44f5-b7a8-64be2675c606 None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:51.451407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5cfed-bd5a-44f5-b7a8-64be2675c606 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:51.451669 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5cfed-bd5a-44f5-b7a8-64be2675c606 None admin] PATH_INFO: `/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/515e548efd984b87bca742e26eec162a/roles/11289567b2a34360b50a87f6edc79703` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:51.453787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5cfed-bd5a-44f5-b7a8-64be2675c606 None admin] RBAC: Authorizing `identity:create_grant(project_id=74c9d19fb1534f8f8888e957d1007640, user_id=515e548efd984b87bca742e26eec162a, role_id=11289567b2a34360b50a87f6edc79703)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:51.455225 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5cfed-bd5a-44f5-b7a8-64be2675c606 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:51.469077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 537/1076] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:22:51 2022] PUT /identity/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/515e548efd984b87bca742e26eec162a/roles/11289567b2a34360b50a87f6edc79703 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:22:51.497368 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa320f-19e1-49d6-ab69-0118c9409263 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:51.610117 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa320f-19e1-49d6-ab69-0118c9409263 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:51.611643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5cfed-bd5a-44f5-b7a8-64be2675c606 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:51.630384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:51.651572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:51.654022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3991a-1e9f-475b-b3b6-b674be40a181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:51.654843 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3991a-1e9f-475b-b3b6-b674be40a181 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:51.655120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3991a-1e9f-475b-b3b6-b674be40a181 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:51.655383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3991a-1e9f-475b-b3b6-b674be40a181 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:51.668194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3991a-1e9f-475b-b3b6-b674be40a181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-46a3991a-1e9f-475b-b3b6-b674be40a181 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:51.673572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:51.674742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:51.675789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:51.675789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:51.675789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:51.675789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:51.675789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:51.675789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:51.675789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:51.675789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:51.675789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:51.675789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:51.675789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:51.675789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:51.675789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 540/1077] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:22:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:51.684327 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3991a-1e9f-475b-b3b6-b674be40a181 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:51.732387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5cfed-bd5a-44f5-b7a8-64be2675c606 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:51.771138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9a3e0-ea13-4cfa-bf36-9188041ac4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:51.771805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9a3e0-ea13-4cfa-bf36-9188041ac4de None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:51.772105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9a3e0-ea13-4cfa-bf36-9188041ac4de None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:51.772378 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9a3e0-ea13-4cfa-bf36-9188041ac4de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:51.793192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3991a-1e9f-475b-b3b6-b674be40a181 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:51.829389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52b27b-463e-4a28-98f8-cda6ef55ec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:51.829989 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52b27b-463e-4a28-98f8-cda6ef55ec4d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:51.830271 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52b27b-463e-4a28-98f8-cda6ef55ec4d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:51.830581 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52b27b-463e-4a28-98f8-cda6ef55ec4d None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:51.831210 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52b27b-463e-4a28-98f8-cda6ef55ec4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:51.831509 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52b27b-463e-4a28-98f8-cda6ef55ec4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:51.833121 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52b27b-463e-4a28-98f8-cda6ef55ec4d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:51.842500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 541/1078] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:22:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:51.845858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9a3e0-ea13-4cfa-bf36-9188041ac4de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:51.847347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9a3e0-ea13-4cfa-bf36-9188041ac4de None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:51.848107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52b27b-463e-4a28-98f8-cda6ef55ec4d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:51.881164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:51.893139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:51.957115 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 538/1079] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:22:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 05:22:51.958754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52b27b-463e-4a28-98f8-cda6ef55ec4d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:51.963494 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9a3e0-ea13-4cfa-bf36-9188041ac4de None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:51.996616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e6da9-6db1-45c2-b00c-6f774545623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:51.997560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e6da9-6db1-45c2-b00c-6f774545623a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:51.998026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e6da9-6db1-45c2-b00c-6f774545623a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:51.998296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e6da9-6db1-45c2-b00c-6f774545623a None admin] PATH_INFO: `/v3/users/f2ca5335431841178417d23c8906cdb8` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:51.999462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e6da9-6db1-45c2-b00c-6f774545623a None admin] RBAC: Authorizing `identity:get_user(user_id=f2ca5335431841178417d23c8906cdb8)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:52.000903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e6da9-6db1-45c2-b00c-6f774545623a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:52.006991 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 542/1080] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:22:51 2022] GET /identity/v3/users/f2ca5335431841178417d23c8906cdb8 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:52.007940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e6da9-6db1-45c2-b00c-6f774545623a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:52.073766 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9a3e0-ea13-4cfa-bf36-9188041ac4de None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:52.109977 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:52.116095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c327d-3956-4cc2-8ba2-5042dfdce60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:52.116887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c327d-3956-4cc2-8ba2-5042dfdce60b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:52.117341 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c327d-3956-4cc2-8ba2-5042dfdce60b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:52.117611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c327d-3956-4cc2-8ba2-5042dfdce60b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:52.120695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e6da9-6db1-45c2-b00c-6f774545623a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:52.127787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c327d-3956-4cc2-8ba2-5042dfdce60b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:52.129222 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c327d-3956-4cc2-8ba2-5042dfdce60b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:52.131157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-7e9c327d-3956-4cc2-8ba2-5042dfdce60b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:52.144425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:52.145606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:52.146543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:52.146543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:52.146543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:52.146543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 539/1081] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:52.151646 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c327d-3956-4cc2-8ba2-5042dfdce60b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:52.163107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9396b3d-e049-4859-8f0a-350edee709c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:52.163738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9396b3d-e049-4859-8f0a-350edee709c3 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:52.164019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9396b3d-e049-4859-8f0a-350edee709c3 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:52.164641 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9396b3d-e049-4859-8f0a-350edee709c3 None admin] PATH_INFO: `/v3/projects/b276ce53b5674c0ab665917c43e4c984` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:52.166134 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9396b3d-e049-4859-8f0a-350edee709c3 None admin] RBAC: Authorizing `identity:get_project(project_id=b276ce53b5674c0ab665917c43e4c984)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:52.167636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9396b3d-e049-4859-8f0a-350edee709c3 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:52.169817 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 543/1082] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:22:52 2022] GET /identity/v3/projects/b276ce53b5674c0ab665917c43e4c984 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:52.175504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9396b3d-e049-4859-8f0a-350edee709c3 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:52.265560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c327d-3956-4cc2-8ba2-5042dfdce60b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:52.288504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9396b3d-e049-4859-8f0a-350edee709c3 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:52.303523 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc85a34-f396-495a-a245-71994c8d61cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:52.304207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc85a34-f396-495a-a245-71994c8d61cc None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:52.304547 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc85a34-f396-495a-a245-71994c8d61cc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:52.304820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc85a34-f396-495a-a245-71994c8d61cc None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:52.305456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc85a34-f396-495a-a245-71994c8d61cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:52.305762 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc85a34-f396-495a-a245-71994c8d61cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:52.307143 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc85a34-f396-495a-a245-71994c8d61cc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:52.330540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 540/1083] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:52.330782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0af56-8365-491a-98fb-57a22d415518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:52.330782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0af56-8365-491a-98fb-57a22d415518 None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:52.330782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0af56-8365-491a-98fb-57a22d415518 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:52.330782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0af56-8365-491a-98fb-57a22d415518 None admin] PATH_INFO: `/v3/projects/b276ce53b5674c0ab665917c43e4c984/users/f2ca5335431841178417d23c8906cdb8/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:52.331346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0af56-8365-491a-98fb-57a22d415518 None admin] RBAC: Authorizing `identity:create_grant(project_id=b276ce53b5674c0ab665917c43e4c984, user_id=f2ca5335431841178417d23c8906cdb8, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:52.332915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0af56-8365-491a-98fb-57a22d415518 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:52.358539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 544/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:22:52 2022] PUT /identity/v3/projects/b276ce53b5674c0ab665917c43e4c984/users/f2ca5335431841178417d23c8906cdb8/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:22:53.629670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3325f-0b0c-4449-96c5-7c36af563ea1 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:53.630201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3325f-0b0c-4449-96c5-7c36af563ea1 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:53.630201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3325f-0b0c-4449-96c5-7c36af563ea1 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:53.631589 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 541/1085] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:53.636903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da27e52-cb85-4cf6-91bb-a9be2a5b30bb None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:53.637328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da27e52-cb85-4cf6-91bb-a9be2a5b30bb None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:53.637484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da27e52-cb85-4cf6-91bb-a9be2a5b30bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:53.655598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-7da27e52-cb85-4cf6-91bb-a9be2a5b30bb None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:53.656764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-7da27e52-cb85-4cf6-91bb-a9be2a5b30bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:53.684588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:53.723175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 545/1086] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:53.994384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3325f-0b0c-4449-96c5-7c36af563ea1 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:54.041577 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:54.096124 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3325f-0b0c-4449-96c5-7c36af563ea1 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:54.128633 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f3cf7-34e9-438b-9acc-70b7f90b790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:54.129253 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f3cf7-34e9-438b-9acc-70b7f90b790f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:54.129530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f3cf7-34e9-438b-9acc-70b7f90b790f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:54.129829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f3cf7-34e9-438b-9acc-70b7f90b790f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:54.140171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f3cf7-34e9-438b-9acc-70b7f90b790f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-d77f3cf7-34e9-438b-9acc-70b7f90b790f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:54.145007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:54.146114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:54.147197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:54.147197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:54.147197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:54.147197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:54.147197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:54.147197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:54.147197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:54.147197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:54.147197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:54.147197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:54.147197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 05:22:54.147197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:54.150651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 542/1087] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 16 05:22:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:54.152140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da27e52-cb85-4cf6-91bb-a9be2a5b30bb None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:54.252275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da27e52-cb85-4cf6-91bb-a9be2a5b30bb None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:54.284714 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94000ed8-ac78-4e90-a46e-f418378e11f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:54.285311 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94000ed8-ac78-4e90-a46e-f418378e11f2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:54.285584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94000ed8-ac78-4e90-a46e-f418378e11f2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:54.285848 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94000ed8-ac78-4e90-a46e-f418378e11f2 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:54.286494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94000ed8-ac78-4e90-a46e-f418378e11f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:54.286816 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94000ed8-ac78-4e90-a46e-f418378e11f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:54.288174 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94000ed8-ac78-4e90-a46e-f418378e11f2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:54.295782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 546/1088] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 05:22:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:54.301600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f3cf7-34e9-438b-9acc-70b7f90b790f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:54.404557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f3cf7-34e9-438b-9acc-70b7f90b790f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:54.406891 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:54.439244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810b45c-c039-4809-bd03-579cb789ba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:54.439860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b45c-c039-4809-bd03-579cb789ba22 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:54.440132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b45c-c039-4809-bd03-579cb789ba22 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:54.440398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b45c-c039-4809-bd03-579cb789ba22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:54.450745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810b45c-c039-4809-bd03-579cb789ba22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:54.452165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810b45c-c039-4809-bd03-579cb789ba22 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-c810b45c-c039-4809-bd03-579cb789ba22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:54.466407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:54.467456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:54.468382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:54.468382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:54.468382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:54.468382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 543/1089] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:54.473360 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94000ed8-ac78-4e90-a46e-f418378e11f2 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:54.485449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd757-8998-4dc1-811f-90d6be0459dc None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:54.485730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd757-8998-4dc1-811f-90d6be0459dc None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:54.486002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd757-8998-4dc1-811f-90d6be0459dc None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:54.487361 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 544/1090] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:22:54.492422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8b754-63e2-495d-9c97-a7bede86b1ae None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:54.492705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8b754-63e2-495d-9c97-a7bede86b1ae None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:54.492975 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8b754-63e2-495d-9c97-a7bede86b1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:54.502398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:54.511459 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-63a8b754-63e2-495d-9c97-a7bede86b1ae None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:54.513253 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-63a8b754-63e2-495d-9c97-a7bede86b1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:54.572064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94000ed8-ac78-4e90-a46e-f418378e11f2 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:54.579044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 545/1091] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:22:54.604788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f5283-f3c3-4866-9c8f-e89048e27bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:54.605376 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f5283-f3c3-4866-9c8f-e89048e27bdc None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:54.605651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f5283-f3c3-4866-9c8f-e89048e27bdc None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:54.605918 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f5283-f3c3-4866-9c8f-e89048e27bdc None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:54.607084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f5283-f3c3-4866-9c8f-e89048e27bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:54.607383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f5283-f3c3-4866-9c8f-e89048e27bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:54.608744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f5283-f3c3-4866-9c8f-e89048e27bdc None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:54.620371 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 547/1092] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:54.626583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8b754-63e2-495d-9c97-a7bede86b1ae None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:54.706671 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:54.721218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8b754-63e2-495d-9c97-a7bede86b1ae None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:54.754565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18d193-a40a-4866-9f40-9f35cedf4a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:54.755121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18d193-a40a-4866-9f40-9f35cedf4a37 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:54.755395 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18d193-a40a-4866-9f40-9f35cedf4a37 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:54.755660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18d193-a40a-4866-9f40-9f35cedf4a37 None admin] PATH_INFO: `/v3/users/nova` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:54.762500 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18d193-a40a-4866-9f40-9f35cedf4a37 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:54.763935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18d193-a40a-4866-9f40-9f35cedf4a37 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-9a18d193-a40a-4866-9f40-9f35cedf4a37 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:22:54.775148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:54.776209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:54.777159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:54.777159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:54.777159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:22:54.777159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:22:54.777159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:22:54.777159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:22:54.777159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:22:54.777159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:22:54.777159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 05:22:54.777159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:54.778655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 546/1093] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 05:22:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:22:54.781951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f5283-f3c3-4866-9c8f-e89048e27bdc None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:54.845550 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18d193-a40a-4866-9f40-9f35cedf4a37 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:54.870217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:54.882497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f5283-f3c3-4866-9c8f-e89048e27bdc None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:54.915034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df34ff-6ea1-4066-b209-ef1bc33bbde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:54.915634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df34ff-6ea1-4066-b209-ef1bc33bbde4 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:54.915923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df34ff-6ea1-4066-b209-ef1bc33bbde4 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:54.916190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df34ff-6ea1-4066-b209-ef1bc33bbde4 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:54.916899 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df34ff-6ea1-4066-b209-ef1bc33bbde4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:54.917196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df34ff-6ea1-4066-b209-ef1bc33bbde4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:54.919156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df34ff-6ea1-4066-b209-ef1bc33bbde4 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:54.936522 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 548/1094] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 05:22:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:54.942135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df34ff-6ea1-4066-b209-ef1bc33bbde4 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:54.945827 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18d193-a40a-4866-9f40-9f35cedf4a37 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:54.978626 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c31ec-fc33-456e-9a1f-90b736732af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:54.979239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c31ec-fc33-456e-9a1f-90b736732af3 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:54.979510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c31ec-fc33-456e-9a1f-90b736732af3 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:54.979776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c31ec-fc33-456e-9a1f-90b736732af3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:54.990086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c31ec-fc33-456e-9a1f-90b736732af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-ba3c31ec-fc33-456e-9a1f-90b736732af3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:22:54.995259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:54.996204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:54.997068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:54.997068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:54.997068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:54.997068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:54.997068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:22:54.997068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:22:54.997068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:22:54.997068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:22:54.997068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:22:54.997068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:22:54.997068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:22:54.997068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:22:54.997068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 547/1095] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:22:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:55.003900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c31ec-fc33-456e-9a1f-90b736732af3 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:55.012587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:55.039190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df34ff-6ea1-4066-b209-ef1bc33bbde4 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:55.072961 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181622c9-9181-4cc0-879e-eff0e27a83ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:55.073557 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181622c9-9181-4cc0-879e-eff0e27a83ee None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:55.073831 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181622c9-9181-4cc0-879e-eff0e27a83ee None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:55.074094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181622c9-9181-4cc0-879e-eff0e27a83ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:55.088453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:55.103405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c31ec-fc33-456e-9a1f-90b736732af3 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:55.135879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cca94-f9b0-44a1-b58d-720570f2f559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:55.136466 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cca94-f9b0-44a1-b58d-720570f2f559 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:55.136746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cca94-f9b0-44a1-b58d-720570f2f559 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:55.137009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cca94-f9b0-44a1-b58d-720570f2f559 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:55.137658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cca94-f9b0-44a1-b58d-720570f2f559 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:55.137956 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cca94-f9b0-44a1-b58d-720570f2f559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:55.139333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cca94-f9b0-44a1-b58d-720570f2f559 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:55.139771 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181622c9-9181-4cc0-879e-eff0e27a83ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:55.141206 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181622c9-9181-4cc0-879e-eff0e27a83ee None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:55.152549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 548/1096] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:22:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:55.154155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cca94-f9b0-44a1-b58d-720570f2f559 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:55.227376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:55.246565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 549/1097] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:22:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 05:22:55.252322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181622c9-9181-4cc0-879e-eff0e27a83ee None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:55.262878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cca94-f9b0-44a1-b58d-720570f2f559 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:55.296809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a02ea-d169-4275-9b82-e7725ec79b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:55.297240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:55.298049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a02ea-d169-4275-9b82-e7725ec79b00 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:55.298341 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a02ea-d169-4275-9b82-e7725ec79b00 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:55.298697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a02ea-d169-4275-9b82-e7725ec79b00 None admin] PATH_INFO: `/v3/users/f2ca5335431841178417d23c8906cdb8` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:55.299876 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a02ea-d169-4275-9b82-e7725ec79b00 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ca5335431841178417d23c8906cdb8)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:55.301300 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a02ea-d169-4275-9b82-e7725ec79b00 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:55.302935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 549/1098] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:22:55 2022] GET /identity/v3/users/f2ca5335431841178417d23c8906cdb8 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:55.308552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a02ea-d169-4275-9b82-e7725ec79b00 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:55.350153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181622c9-9181-4cc0-879e-eff0e27a83ee None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:55.382636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2551df7-5cb8-42a8-9162-db6e8677c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:55.383257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2551df7-5cb8-42a8-9162-db6e8677c722 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:55.383532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2551df7-5cb8-42a8-9162-db6e8677c722 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:55.383800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2551df7-5cb8-42a8-9162-db6e8677c722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:55.394028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2551df7-5cb8-42a8-9162-db6e8677c722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:55.395485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2551df7-5cb8-42a8-9162-db6e8677c722 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:55.406081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a02ea-d169-4275-9b82-e7725ec79b00 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-d2551df7-5cb8-42a8-9162-db6e8677c722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:22:55.410213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:55.411457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:22:55.412645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:22:55.412645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:22:55.412645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:55.416150 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 550/1099] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:55.417007 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2551df7-5cb8-42a8-9162-db6e8677c722 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:55.439296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631d69f-3588-4c14-8709-e1f606ee9586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:55.439919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631d69f-3588-4c14-8709-e1f606ee9586 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:55.440196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631d69f-3588-4c14-8709-e1f606ee9586 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:55.440472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631d69f-3588-4c14-8709-e1f606ee9586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:55.443826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:55.508398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631d69f-3588-4c14-8709-e1f606ee9586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:55.509845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631d69f-3588-4c14-8709-e1f606ee9586 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:55.510065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:55.515703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2551df7-5cb8-42a8-9162-db6e8677c722 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:55.550594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a1183-99fb-41a9-984b-65b4698fb869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:55.551485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a1183-99fb-41a9-984b-65b4698fb869 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:55.551773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a1183-99fb-41a9-984b-65b4698fb869 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:55.552040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a1183-99fb-41a9-984b-65b4698fb869 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:55.552663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a1183-99fb-41a9-984b-65b4698fb869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:55.552959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a1183-99fb-41a9-984b-65b4698fb869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:55.554345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a1183-99fb-41a9-984b-65b4698fb869 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:55.567204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 551/1100] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:55.572664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a1183-99fb-41a9-984b-65b4698fb869 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:55.609634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 550/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:22:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 05:22:55.615702 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631d69f-3588-4c14-8709-e1f606ee9586 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:55.649893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:55.670717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a1183-99fb-41a9-984b-65b4698fb869 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:55.705086 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589697c-2803-41d6-b35f-7978483ce1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:55.705706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589697c-2803-41d6-b35f-7978483ce1f0 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:55.705991 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589697c-2803-41d6-b35f-7978483ce1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:55.706257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589697c-2803-41d6-b35f-7978483ce1f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:55.712709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589697c-2803-41d6-b35f-7978483ce1f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:55.714155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589697c-2803-41d6-b35f-7978483ce1f0 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:55.715087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631d69f-3588-4c14-8709-e1f606ee9586 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-e589697c-2803-41d6-b35f-7978483ce1f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:22:55.725158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:22:55.726114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:22:55.727565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:22:55.727565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:22:55.727565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:22:55.727565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:22:55.727565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:22:55.727565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:22:55.727565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:22:55.727565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:22:55.727565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 552/1102] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:22:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:22:55.731976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589697c-2803-41d6-b35f-7978483ce1f0 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:55.749314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededf668-fb6e-4d0f-aafa-2b33aef0eefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:55.749937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededf668-fb6e-4d0f-aafa-2b33aef0eefd None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:55.750213 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededf668-fb6e-4d0f-aafa-2b33aef0eefd None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:55.750490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededf668-fb6e-4d0f-aafa-2b33aef0eefd None admin] PATH_INFO: `/v3/projects/b276ce53b5674c0ab665917c43e4c984` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:55.750658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:55.751691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededf668-fb6e-4d0f-aafa-2b33aef0eefd None admin] RBAC: Authorizing `identity:get_project(project_id=b276ce53b5674c0ab665917c43e4c984)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:55.753218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededf668-fb6e-4d0f-aafa-2b33aef0eefd None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:55.754904 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 551/1103] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:22:55 2022] GET /identity/v3/projects/b276ce53b5674c0ab665917c43e4c984 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:55.760812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededf668-fb6e-4d0f-aafa-2b33aef0eefd None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:55.831174 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589697c-2803-41d6-b35f-7978483ce1f0 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:55.858075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededf668-fb6e-4d0f-aafa-2b33aef0eefd None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:55.860363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:55.863751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f8fa5-2942-4268-94db-094512e86da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:55.864350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f8fa5-2942-4268-94db-094512e86da5 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:55.864627 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f8fa5-2942-4268-94db-094512e86da5 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:55.864894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f8fa5-2942-4268-94db-094512e86da5 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:55.865571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f8fa5-2942-4268-94db-094512e86da5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:55.865873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f8fa5-2942-4268-94db-094512e86da5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:55.867335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f8fa5-2942-4268-94db-094512e86da5 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:55.879434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 553/1104] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:22:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:55.885352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f8fa5-2942-4268-94db-094512e86da5 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:55.893951 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1b937-bccb-4b4f-9b51-5a4cb4dae0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:55.894573 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1b937-bccb-4b4f-9b51-5a4cb4dae0de None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:55.894849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1b937-bccb-4b4f-9b51-5a4cb4dae0de None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:55.895115 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1b937-bccb-4b4f-9b51-5a4cb4dae0de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:55.895826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1b937-bccb-4b4f-9b51-5a4cb4dae0de None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=b276ce53b5674c0ab665917c43e4c984, user.id=f2ca5335431841178417d23c8906cdb8) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:55.896477 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1b937-bccb-4b4f-9b51-5a4cb4dae0de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:55.897795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1b937-bccb-4b4f-9b51-5a4cb4dae0de None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:55.903125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 552/1105] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:22:55 2022] GET /identity/v3/role_assignments?user.id=f2ca5335431841178417d23c8906cdb8&scope.project.id=b276ce53b5674c0ab665917c43e4c984&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:55.970014 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:55.992349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f8fa5-2942-4268-94db-094512e86da5 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:56.028338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2127d31-a769-4a28-b1e7-adc2f444f491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:56.028958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2127d31-a769-4a28-b1e7-adc2f444f491 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:56.029234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2127d31-a769-4a28-b1e7-adc2f444f491 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:56.029502 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2127d31-a769-4a28-b1e7-adc2f444f491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:56.030234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2127d31-a769-4a28-b1e7-adc2f444f491 None admin] RBAC: Adding query filter params (role.id=11289567b2a34360b50a87f6edc79703, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=515e548efd984b87bca742e26eec162a) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:22:56.030575 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2127d31-a769-4a28-b1e7-adc2f444f491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:56.032034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2127d31-a769-4a28-b1e7-adc2f444f491 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:56.038456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 554/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:22:55 2022] GET /identity/v3/role_assignments?user.id=515e548efd984b87bca742e26eec162a&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=11289567b2a34360b50a87f6edc79703 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:22:58.082988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4fa44-31bc-480b-92fc-5c569c9a963d None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:58.083522 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4fa44-31bc-480b-92fc-5c569c9a963d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:58.083522 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4fa44-31bc-480b-92fc-5c569c9a963d None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:58.084876 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 553/1107] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:22:58.090111 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63841a-1481-4cb0-b14a-6abfa1126547 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:58.090474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63841a-1481-4cb0-b14a-6abfa1126547 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:58.090688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63841a-1481-4cb0-b14a-6abfa1126547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:58.108346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-6c63841a-1481-4cb0-b14a-6abfa1126547 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:22:58.109534 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6c63841a-1481-4cb0-b14a-6abfa1126547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:22:58.172951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 555/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:22:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:22:58.440432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4fa44-31bc-480b-92fc-5c569c9a963d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:58.554078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4fa44-31bc-480b-92fc-5c569c9a963d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:58.594280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67babb1-1a7f-4e6e-a216-9351a345502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:58.594921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67babb1-1a7f-4e6e-a216-9351a345502c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:58.595198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67babb1-1a7f-4e6e-a216-9351a345502c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:58.595463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67babb1-1a7f-4e6e-a216-9351a345502c None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:58.596566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67babb1-1a7f-4e6e-a216-9351a345502c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:58.597981 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67babb1-1a7f-4e6e-a216-9351a345502c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:58.599559 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 554/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:22:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:22:58.605277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63841a-1481-4cb0-b14a-6abfa1126547 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:22:58.672271 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:22:58.700723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63841a-1481-4cb0-b14a-6abfa1126547 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:22:58.733275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07225a4b-f280-4c00-8057-363483635d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:22:58.733859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07225a4b-f280-4c00-8057-363483635d0d None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:22:58.734135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07225a4b-f280-4c00-8057-363483635d0d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:22:58.734402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07225a4b-f280-4c00-8057-363483635d0d None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:22:58.735075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07225a4b-f280-4c00-8057-363483635d0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:22:58.736501 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07225a4b-f280-4c00-8057-363483635d0d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:22:58.756142 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 556/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:22:58 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:23:00.967917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d5539-d72d-4339-bdf5-6167e1219f06 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:00.968444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d5539-d72d-4339-bdf5-6167e1219f06 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:00.968444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d5539-d72d-4339-bdf5-6167e1219f06 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:00.969791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 555/1111] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:00.975009 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cb9e6-d171-4f5b-808e-ad1e5262efae None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:00.975374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cb9e6-d171-4f5b-808e-ad1e5262efae None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:00.975560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cb9e6-d171-4f5b-808e-ad1e5262efae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:00.993241 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-789cb9e6-d171-4f5b-808e-ad1e5262efae None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:00.994424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-789cb9e6-d171-4f5b-808e-ad1e5262efae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:01.057631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 557/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:01.334249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d5539-d72d-4339-bdf5-6167e1219f06 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:01.369741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:01.434257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d5539-d72d-4339-bdf5-6167e1219f06 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:01.466666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6c03a-6f63-42f7-b763-7601a4665763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:01.467272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6c03a-6f63-42f7-b763-7601a4665763 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:01.467548 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6c03a-6f63-42f7-b763-7601a4665763 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:01.467818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6c03a-6f63-42f7-b763-7601a4665763 None admin] PATH_INFO: `/v3/roles/49763e40fa024aaa9522c00cea577eca` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:01.469183 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6c03a-6f63-42f7-b763-7601a4665763 None admin] RBAC: Authorizing `identity:get_role(role_id=49763e40fa024aaa9522c00cea577eca)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:01.470555 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6c03a-6f63-42f7-b763-7601a4665763 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:01.471842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 556/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:23:01 2022] GET /identity/v3/roles/49763e40fa024aaa9522c00cea577eca => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:01.477502 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cb9e6-d171-4f5b-808e-ad1e5262efae None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:01.540000 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:01.583859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cb9e6-d171-4f5b-808e-ad1e5262efae None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:01.615937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74821d3a-016b-4d6a-b629-389f8f657d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:01.616550 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74821d3a-016b-4d6a-b629-389f8f657d6a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:01.616824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74821d3a-016b-4d6a-b629-389f8f657d6a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:01.617090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74821d3a-016b-4d6a-b629-389f8f657d6a None admin] PATH_INFO: `/v3/users/c79d6f4325c5474cb37c9b43054abbfd` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:01.629987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74821d3a-016b-4d6a-b629-389f8f657d6a None admin] RBAC: Authorizing `identity:get_user(user_id=c79d6f4325c5474cb37c9b43054abbfd)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:01.631452 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74821d3a-016b-4d6a-b629-389f8f657d6a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:01.633015 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 558/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:23:01 2022] GET /identity/v3/users/c79d6f4325c5474cb37c9b43054abbfd => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:01.638874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6c03a-6f63-42f7-b763-7601a4665763 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:01.734231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6c03a-6f63-42f7-b763-7601a4665763 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:01.736497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:01.766261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbed44-4da7-47d3-972e-d9f693f712c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:01.766883 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbed44-4da7-47d3-972e-d9f693f712c1 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:01.767160 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbed44-4da7-47d3-972e-d9f693f712c1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:01.767428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbed44-4da7-47d3-972e-d9f693f712c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:01.836348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbed44-4da7-47d3-972e-d9f693f712c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:01.837785 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbed44-4da7-47d3-972e-d9f693f712c1 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:01.931609 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 557/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:23:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:23:01.937821 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74821d3a-016b-4d6a-b629-389f8f657d6a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:02.031940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74821d3a-016b-4d6a-b629-389f8f657d6a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:02.047878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:02.065087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd419da5-6374-4f5a-95d5-de71c237b31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:02.065696 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd419da5-6374-4f5a-95d5-de71c237b31a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:02.065970 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd419da5-6374-4f5a-95d5-de71c237b31a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:02.066240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd419da5-6374-4f5a-95d5-de71c237b31a None admin] PATH_INFO: `/v3/projects/b276ce53b5674c0ab665917c43e4c984` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:02.067361 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd419da5-6374-4f5a-95d5-de71c237b31a None admin] RBAC: Authorizing `identity:get_project(project_id=b276ce53b5674c0ab665917c43e4c984)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:02.068783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd419da5-6374-4f5a-95d5-de71c237b31a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:02.070357 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 559/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:23:01 2022] GET /identity/v3/projects/b276ce53b5674c0ab665917c43e4c984 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:02.077047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbed44-4da7-47d3-972e-d9f693f712c1 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:02.080084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:02.172639 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbed44-4da7-47d3-972e-d9f693f712c1 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:02.205369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7a879-ddc0-482b-9f1d-9ac89e74098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:02.205957 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7a879-ddc0-482b-9f1d-9ac89e74098b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:02.206236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7a879-ddc0-482b-9f1d-9ac89e74098b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:02.206527 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7a879-ddc0-482b-9f1d-9ac89e74098b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:02.207252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7a879-ddc0-482b-9f1d-9ac89e74098b None admin] RBAC: Adding query filter params (role.id=49763e40fa024aaa9522c00cea577eca, scope.project.id=b276ce53b5674c0ab665917c43e4c984, user.id=c79d6f4325c5474cb37c9b43054abbfd) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:23:02.207552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7a879-ddc0-482b-9f1d-9ac89e74098b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:02.208954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7a879-ddc0-482b-9f1d-9ac89e74098b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:02.214084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 558/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:23:02 2022] GET /identity/v3/role_assignments?user.id=c79d6f4325c5474cb37c9b43054abbfd&scope.project.id=b276ce53b5674c0ab665917c43e4c984&role.id=49763e40fa024aaa9522c00cea577eca => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:04.296923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f70468-830b-48f2-a40e-15f051157b20 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:04.297398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f70468-830b-48f2-a40e-15f051157b20 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:04.297511 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f70468-830b-48f2-a40e-15f051157b20 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:04.298822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 560/1118] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:04.303879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d8764-747d-4077-8b5c-f5c23ec94cd4 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:04.304260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d8764-747d-4077-8b5c-f5c23ec94cd4 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:04.304507 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d8764-747d-4077-8b5c-f5c23ec94cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:04.322246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-9a6d8764-747d-4077-8b5c-f5c23ec94cd4 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:04.323495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9a6d8764-747d-4077-8b5c-f5c23ec94cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:04.381433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:04.387035 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 559/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 05:23:04.654083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f70468-830b-48f2-a40e-15f051157b20 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:04.750815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f70468-830b-48f2-a40e-15f051157b20 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:04.782872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af259b88-bd23-404b-a162-365d168f2ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:04.783475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af259b88-bd23-404b-a162-365d168f2ff3 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:04.783750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af259b88-bd23-404b-a162-365d168f2ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:04.784017 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af259b88-bd23-404b-a162-365d168f2ff3 None admin] PATH_INFO: `/v3/roles/49763e40fa024aaa9522c00cea577eca` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:04.785378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af259b88-bd23-404b-a162-365d168f2ff3 None admin] RBAC: Authorizing `identity:get_role(role_id=49763e40fa024aaa9522c00cea577eca)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:04.786763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af259b88-bd23-404b-a162-365d168f2ff3 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:04.788028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 561/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:23:04 2022] GET /identity/v3/roles/49763e40fa024aaa9522c00cea577eca => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:04.793624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d8764-747d-4077-8b5c-f5c23ec94cd4 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:04.888777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d8764-747d-4077-8b5c-f5c23ec94cd4 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:04.922718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e041f87-0889-44c7-a0d2-bc459fb18d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:04.923264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e041f87-0889-44c7-a0d2-bc459fb18d4a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:04.923536 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e041f87-0889-44c7-a0d2-bc459fb18d4a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:04.923800 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e041f87-0889-44c7-a0d2-bc459fb18d4a None admin] PATH_INFO: `/v3/users/c79d6f4325c5474cb37c9b43054abbfd` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:04.924891 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e041f87-0889-44c7-a0d2-bc459fb18d4a None admin] RBAC: Authorizing `identity:get_user(user_id=c79d6f4325c5474cb37c9b43054abbfd)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:04.926331 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e041f87-0889-44c7-a0d2-bc459fb18d4a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:04.927915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 560/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:23:04 2022] GET /identity/v3/users/c79d6f4325c5474cb37c9b43054abbfd => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:04.934084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af259b88-bd23-404b-a162-365d168f2ff3 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:04.986132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:05.036048 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af259b88-bd23-404b-a162-365d168f2ff3 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:05.070726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0670ab-5739-4394-a1e7-f1bcec55928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:05.071336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0670ab-5739-4394-a1e7-f1bcec55928e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:05.071611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0670ab-5739-4394-a1e7-f1bcec55928e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:05.071879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0670ab-5739-4394-a1e7-f1bcec55928e None admin] PATH_INFO: `/v3/projects/b276ce53b5674c0ab665917c43e4c984` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:05.072967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0670ab-5739-4394-a1e7-f1bcec55928e None admin] RBAC: Authorizing `identity:get_project(project_id=b276ce53b5674c0ab665917c43e4c984)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:05.074395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0670ab-5739-4394-a1e7-f1bcec55928e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:05.076637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 562/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:23:04 2022] GET /identity/v3/projects/b276ce53b5674c0ab665917c43e4c984 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:05.082854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e041f87-0889-44c7-a0d2-bc459fb18d4a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:05.147520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:05.181347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e041f87-0889-44c7-a0d2-bc459fb18d4a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:05.214337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4eb95d-ebe9-49e1-9d86-8b639a5d5fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:05.215014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4eb95d-ebe9-49e1-9d86-8b639a5d5fb3 None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:05.215290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4eb95d-ebe9-49e1-9d86-8b639a5d5fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:05.215560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4eb95d-ebe9-49e1-9d86-8b639a5d5fb3 None admin] PATH_INFO: `/v3/projects/b276ce53b5674c0ab665917c43e4c984/users/c79d6f4325c5474cb37c9b43054abbfd/roles/49763e40fa024aaa9522c00cea577eca` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:05.217700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4eb95d-ebe9-49e1-9d86-8b639a5d5fb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b276ce53b5674c0ab665917c43e4c984, user_id=c79d6f4325c5474cb37c9b43054abbfd, role_id=49763e40fa024aaa9522c00cea577eca)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:05.219160 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4eb95d-ebe9-49e1-9d86-8b639a5d5fb3 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:05.232461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 561/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:23:05 2022] PUT /identity/v3/projects/b276ce53b5674c0ab665917c43e4c984/users/c79d6f4325c5474cb37c9b43054abbfd/roles/49763e40fa024aaa9522c00cea577eca => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:23:07.384211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fdf34-1ebd-49c1-ab61-aa1b37df2fd8 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:07.384741 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fdf34-1ebd-49c1-ab61-aa1b37df2fd8 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:07.384741 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fdf34-1ebd-49c1-ab61-aa1b37df2fd8 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:07.386058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 563/1124] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:07.391485 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef6f2-46ab-43cb-a14a-7d5edcf9e7d0 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:07.391920 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef6f2-46ab-43cb-a14a-7d5edcf9e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:07.392028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef6f2-46ab-43cb-a14a-7d5edcf9e7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:07.409694 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-65cef6f2-46ab-43cb-a14a-7d5edcf9e7d0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:07.410915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-65cef6f2-46ab-43cb-a14a-7d5edcf9e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:07.475070 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 562/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:07.749549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fdf34-1ebd-49c1-ab61-aa1b37df2fd8 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:07.845882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fdf34-1ebd-49c1-ab61-aa1b37df2fd8 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:07.865040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:07.878544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68741170-fbd9-46e0-88c1-e9c66ce75cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:07.879154 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68741170-fbd9-46e0-88c1-e9c66ce75cc6 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:07.879426 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68741170-fbd9-46e0-88c1-e9c66ce75cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:07.879690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68741170-fbd9-46e0-88c1-e9c66ce75cc6 None admin] PATH_INFO: `/v3/roles/49763e40fa024aaa9522c00cea577eca` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:07.881045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68741170-fbd9-46e0-88c1-e9c66ce75cc6 None admin] RBAC: Authorizing `identity:get_role(role_id=49763e40fa024aaa9522c00cea577eca)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:07.882399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68741170-fbd9-46e0-88c1-e9c66ce75cc6 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:07.883703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 564/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:23:07 2022] GET /identity/v3/roles/49763e40fa024aaa9522c00cea577eca => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:07.889500 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cef6f2-46ab-43cb-a14a-7d5edcf9e7d0 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:07.943379 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:07.985821 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cef6f2-46ab-43cb-a14a-7d5edcf9e7d0 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:08.018384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea28e71-5851-4d65-9603-a610abf2db1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:08.019029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea28e71-5851-4d65-9603-a610abf2db1a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:08.019303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea28e71-5851-4d65-9603-a610abf2db1a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:08.019572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea28e71-5851-4d65-9603-a610abf2db1a None admin] PATH_INFO: `/v3/users/c79d6f4325c5474cb37c9b43054abbfd` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:08.020666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea28e71-5851-4d65-9603-a610abf2db1a None admin] RBAC: Authorizing `identity:get_user(user_id=c79d6f4325c5474cb37c9b43054abbfd)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:08.022071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea28e71-5851-4d65-9603-a610abf2db1a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:08.023640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 563/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:23:07 2022] GET /identity/v3/users/c79d6f4325c5474cb37c9b43054abbfd => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:08.029889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68741170-fbd9-46e0-88c1-e9c66ce75cc6 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:08.124260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68741170-fbd9-46e0-88c1-e9c66ce75cc6 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:08.156681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166bb83-ba04-432c-b6e2-ee21067cbb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:08.157270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166bb83-ba04-432c-b6e2-ee21067cbb03 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:08.157545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166bb83-ba04-432c-b6e2-ee21067cbb03 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:08.157811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166bb83-ba04-432c-b6e2-ee21067cbb03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:08.209292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:08.222284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166bb83-ba04-432c-b6e2-ee21067cbb03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:08.223784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166bb83-ba04-432c-b6e2-ee21067cbb03 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:08.320226 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 565/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:23:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:23:08.326684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea28e71-5851-4d65-9603-a610abf2db1a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:08.422220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea28e71-5851-4d65-9603-a610abf2db1a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:08.445189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:08.456346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf05bc5-2379-4d1d-a659-e1a3df5f7acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:08.456960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf05bc5-2379-4d1d-a659-e1a3df5f7acd None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:08.457239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf05bc5-2379-4d1d-a659-e1a3df5f7acd None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:08.457512 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf05bc5-2379-4d1d-a659-e1a3df5f7acd None admin] PATH_INFO: `/v3/projects/b276ce53b5674c0ab665917c43e4c984` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:08.458651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf05bc5-2379-4d1d-a659-e1a3df5f7acd None admin] RBAC: Authorizing `identity:get_project(project_id=b276ce53b5674c0ab665917c43e4c984)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:08.460069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf05bc5-2379-4d1d-a659-e1a3df5f7acd None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:08.461661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 564/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:23:08 2022] GET /identity/v3/projects/b276ce53b5674c0ab665917c43e4c984 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:08.467702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166bb83-ba04-432c-b6e2-ee21067cbb03 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:08.549484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:08.561893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166bb83-ba04-432c-b6e2-ee21067cbb03 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:08.595038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399a0d9-39d8-46d9-9dd8-f4ab66f58f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:08.595563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399a0d9-39d8-46d9-9dd8-f4ab66f58f8a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:08.595837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399a0d9-39d8-46d9-9dd8-f4ab66f58f8a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:08.596104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399a0d9-39d8-46d9-9dd8-f4ab66f58f8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:08.596820 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399a0d9-39d8-46d9-9dd8-f4ab66f58f8a None admin] RBAC: Adding query filter params (role.id=49763e40fa024aaa9522c00cea577eca, scope.project.id=b276ce53b5674c0ab665917c43e4c984, user.id=c79d6f4325c5474cb37c9b43054abbfd) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:23:08.597124 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399a0d9-39d8-46d9-9dd8-f4ab66f58f8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:08.598567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399a0d9-39d8-46d9-9dd8-f4ab66f58f8a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:08.604121 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 566/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:23:08 2022] GET /identity/v3/role_assignments?user.id=c79d6f4325c5474cb37c9b43054abbfd&scope.project.id=b276ce53b5674c0ab665917c43e4c984&role.id=49763e40fa024aaa9522c00cea577eca => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:10.729609 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974b2c8-42c4-4d1d-a4ad-f402b709f4ae None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:10.730140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974b2c8-42c4-4d1d-a4ad-f402b709f4ae None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:10.730140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974b2c8-42c4-4d1d-a4ad-f402b709f4ae None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:10.732093 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 565/1131] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:10.737496 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3db68-8a74-48b5-8c26-f7fc188199ec None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:10.737902 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3db68-8a74-48b5-8c26-f7fc188199ec None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:10.738034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3db68-8a74-48b5-8c26-f7fc188199ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:10.755858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-7cf3db68-8a74-48b5-8c26-f7fc188199ec None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:10.757040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-7cf3db68-8a74-48b5-8c26-f7fc188199ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:10.820940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 567/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:11.091190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974b2c8-42c4-4d1d-a4ad-f402b709f4ae None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:11.188099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974b2c8-42c4-4d1d-a4ad-f402b709f4ae None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:11.221003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897ba4a-5542-42f3-bfc6-5b054c3176a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:11.221618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897ba4a-5542-42f3-bfc6-5b054c3176a4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:11.221894 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897ba4a-5542-42f3-bfc6-5b054c3176a4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:11.222164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897ba4a-5542-42f3-bfc6-5b054c3176a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:11.223317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897ba4a-5542-42f3-bfc6-5b054c3176a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:11.224746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897ba4a-5542-42f3-bfc6-5b054c3176a4 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:11.226300 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 566/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:23:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:11.232035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3db68-8a74-48b5-8c26-f7fc188199ec None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:11.310176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:11.328758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3db68-8a74-48b5-8c26-f7fc188199ec None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:11.361533 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957a791-7458-4e10-85ac-598dd715dfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:11.362070 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957a791-7458-4e10-85ac-598dd715dfb4 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:11.362343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957a791-7458-4e10-85ac-598dd715dfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:11.362635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957a791-7458-4e10-85ac-598dd715dfb4 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:11.363279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957a791-7458-4e10-85ac-598dd715dfb4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:11.364708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957a791-7458-4e10-85ac-598dd715dfb4 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:11.390429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 568/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:23:11 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:23:13.540908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612e83e-ffce-40ad-b859-ac90da473196 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:13.541409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612e83e-ffce-40ad-b859-ac90da473196 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:13.541409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612e83e-ffce-40ad-b859-ac90da473196 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:13.542730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 567/1135] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:13.548514 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706996d-79d3-40e3-8ef5-b0df92f22187 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:13.548887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706996d-79d3-40e3-8ef5-b0df92f22187 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:13.549054 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706996d-79d3-40e3-8ef5-b0df92f22187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:13.571038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-f706996d-79d3-40e3-8ef5-b0df92f22187 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:13.571038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f706996d-79d3-40e3-8ef5-b0df92f22187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:13.633656 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 569/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:13.911802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612e83e-ffce-40ad-b859-ac90da473196 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:13.970458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:14.010336 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612e83e-ffce-40ad-b859-ac90da473196 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:14.042875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7439ff-2348-4605-ab08-9af596a34d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:14.044062 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7439ff-2348-4605-ab08-9af596a34d01 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:14.044340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7439ff-2348-4605-ab08-9af596a34d01 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:14.044606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7439ff-2348-4605-ab08-9af596a34d01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:14.045700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7439ff-2348-4605-ab08-9af596a34d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:14.047144 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7439ff-2348-4605-ab08-9af596a34d01 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:14.048674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 568/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:23:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:14.054585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706996d-79d3-40e3-8ef5-b0df92f22187 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:14.113769 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:14.151485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706996d-79d3-40e3-8ef5-b0df92f22187 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:14.184168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb2e92-52e6-4494-b9a3-d97c2ddfa040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:14.184701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb2e92-52e6-4494-b9a3-d97c2ddfa040 None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:14.184975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb2e92-52e6-4494-b9a3-d97c2ddfa040 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:14.185486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb2e92-52e6-4494-b9a3-d97c2ddfa040 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:14.186145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb2e92-52e6-4494-b9a3-d97c2ddfa040 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:14.187603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb2e92-52e6-4494-b9a3-d97c2ddfa040 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:14.208283 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 570/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:23:14 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:23:16.381709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcde6e-57da-4b20-b66e-2d786d928508 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:16.382258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcde6e-57da-4b20-b66e-2d786d928508 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:16.382258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcde6e-57da-4b20-b66e-2d786d928508 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:16.383623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 569/1139] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:16.389349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49a780-4dfd-4c31-87c5-5126ca01af59 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:16.389774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49a780-4dfd-4c31-87c5-5126ca01af59 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:16.389897 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49a780-4dfd-4c31-87c5-5126ca01af59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:16.408281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-0f49a780-4dfd-4c31-87c5-5126ca01af59 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:16.409475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0f49a780-4dfd-4c31-87c5-5126ca01af59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:16.473775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 571/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:16.741031 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcde6e-57da-4b20-b66e-2d786d928508 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:16.840681 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcde6e-57da-4b20-b66e-2d786d928508 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:16.866123 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:16.874664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846841ff-3014-4010-beee-17768622dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:16.875277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846841ff-3014-4010-beee-17768622dbf8 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:16.875553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846841ff-3014-4010-beee-17768622dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:16.875823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846841ff-3014-4010-beee-17768622dbf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:16.885545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846841ff-3014-4010-beee-17768622dbf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-846841ff-3014-4010-beee-17768622dbf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:23:16.891204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:23:16.892802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:23:16.894169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:23:16.894169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:23:16.894169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:23:16.894169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:23:16.894169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:23:16.894169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:23:16.894169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:23:16.894169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:23:16.894169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:23:16.894169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:23:16.894169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:23:16.894169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:23:16.894169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 570/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:23:16.898490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49a780-4dfd-4c31-87c5-5126ca01af59 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:16.948303 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:17.003113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49a780-4dfd-4c31-87c5-5126ca01af59 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:17.038138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4eae19-0f3a-4ea0-8713-ef3d82afdac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:17.038767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4eae19-0f3a-4ea0-8713-ef3d82afdac0 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:17.039040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4eae19-0f3a-4ea0-8713-ef3d82afdac0 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:17.039312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4eae19-0f3a-4ea0-8713-ef3d82afdac0 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:17.039971 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4eae19-0f3a-4ea0-8713-ef3d82afdac0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:23:17.040272 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4eae19-0f3a-4ea0-8713-ef3d82afdac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:17.041653 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4eae19-0f3a-4ea0-8713-ef3d82afdac0 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:17.049694 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 572/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:23:17.055634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846841ff-3014-4010-beee-17768622dbf8 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:17.157553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846841ff-3014-4010-beee-17768622dbf8 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:17.191650 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6be206-f25d-4452-98b5-4c53943f468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:17.192266 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6be206-f25d-4452-98b5-4c53943f468f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:17.192544 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6be206-f25d-4452-98b5-4c53943f468f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:17.192817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6be206-f25d-4452-98b5-4c53943f468f None admin] PATH_INFO: `/v3/users/8a77856729f842689f59fbe4804ca0ae` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:17.207042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6be206-f25d-4452-98b5-4c53943f468f None admin] RBAC: Authorizing `identity:get_user(user_id=8a77856729f842689f59fbe4804ca0ae)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:17.208473 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6be206-f25d-4452-98b5-4c53943f468f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:17.210070 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 571/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:23:17 2022] GET /identity/v3/users/8a77856729f842689f59fbe4804ca0ae => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:17.216513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4eae19-0f3a-4ea0-8713-ef3d82afdac0 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:17.312584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4eae19-0f3a-4ea0-8713-ef3d82afdac0 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:17.325199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:17.346110 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47b407-1ca3-45ec-b413-f8931fe4cc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:17.346735 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47b407-1ca3-45ec-b413-f8931fe4cc69 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:17.347015 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47b407-1ca3-45ec-b413-f8931fe4cc69 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:17.347281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47b407-1ca3-45ec-b413-f8931fe4cc69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:17.418678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47b407-1ca3-45ec-b413-f8931fe4cc69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:17.421211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47b407-1ca3-45ec-b413-f8931fe4cc69 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:17.519686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 573/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:23:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:23:17.525658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6be206-f25d-4452-98b5-4c53943f468f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:17.571074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:17.622584 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6be206-f25d-4452-98b5-4c53943f468f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:17.658120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10000c19-3da8-442d-a74c-79e592e295a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:17.658761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10000c19-3da8-442d-a74c-79e592e295a6 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:17.659035 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10000c19-3da8-442d-a74c-79e592e295a6 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:17.659301 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10000c19-3da8-442d-a74c-79e592e295a6 None admin] PATH_INFO: `/v3/projects/936fc428b0024e97a56b20eca786468f` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:17.660395 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10000c19-3da8-442d-a74c-79e592e295a6 None admin] RBAC: Authorizing `identity:get_project(project_id=936fc428b0024e97a56b20eca786468f)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:17.661809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10000c19-3da8-442d-a74c-79e592e295a6 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:17.663450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 572/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:23:17 2022] GET /identity/v3/projects/936fc428b0024e97a56b20eca786468f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:17.669547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47b407-1ca3-45ec-b413-f8931fe4cc69 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:17.684262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:17.767718 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47b407-1ca3-45ec-b413-f8931fe4cc69 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:17.799648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eea39-53d1-4df9-a31a-b207af6de6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:17.800237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eea39-53d1-4df9-a31a-b207af6de6f2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:17.800513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eea39-53d1-4df9-a31a-b207af6de6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:17.800788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eea39-53d1-4df9-a31a-b207af6de6f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:17.801500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5eea39-53d1-4df9-a31a-b207af6de6f2 None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=936fc428b0024e97a56b20eca786468f, user.id=8a77856729f842689f59fbe4804ca0ae) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:23:17.801803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5eea39-53d1-4df9-a31a-b207af6de6f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:17.803260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5eea39-53d1-4df9-a31a-b207af6de6f2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:17.808392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 574/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:23:17 2022] GET /identity/v3/role_assignments?user.id=8a77856729f842689f59fbe4804ca0ae&scope.project.id=936fc428b0024e97a56b20eca786468f&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:19.912909 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ddfbe-a6d0-401d-8ebe-9c651fce9647 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:19.913433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ddfbe-a6d0-401d-8ebe-9c651fce9647 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:19.913433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ddfbe-a6d0-401d-8ebe-9c651fce9647 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:19.914804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 573/1147] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:19.920465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023a1a7-6d7d-4bd3-95c7-df4e38aa2f5f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:19.920857 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023a1a7-6d7d-4bd3-95c7-df4e38aa2f5f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:19.921019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023a1a7-6d7d-4bd3-95c7-df4e38aa2f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:19.939070 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-a023a1a7-6d7d-4bd3-95c7-df4e38aa2f5f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:19.940260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a023a1a7-6d7d-4bd3-95c7-df4e38aa2f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:20.003962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 575/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:20.276475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ddfbe-a6d0-401d-8ebe-9c651fce9647 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:20.373936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ddfbe-a6d0-401d-8ebe-9c651fce9647 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:20.387688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:20.407734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96c506-3213-4e85-b803-b4ff8dec73f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:20.408343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96c506-3213-4e85-b803-b4ff8dec73f2 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:20.408620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96c506-3213-4e85-b803-b4ff8dec73f2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:20.408895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96c506-3213-4e85-b803-b4ff8dec73f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:20.418783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96c506-3213-4e85-b803-b4ff8dec73f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-af96c506-3213-4e85-b803-b4ff8dec73f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:23:20.423552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:23:20.424627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:23:20.425486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:23:20.425486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:23:20.425486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:23:20.425486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:23:20.425486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:23:20.425486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:23:20.425486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:23:20.425486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:23:20.425486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:23:20.425486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:23:20.425486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:23:20.425486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:23:20.425486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 574/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:23:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:23:20.430960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023a1a7-6d7d-4bd3-95c7-df4e38aa2f5f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:20.440277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:20.528201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023a1a7-6d7d-4bd3-95c7-df4e38aa2f5f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:20.560896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62003cc4-8268-4f47-9495-bc90e6085532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:20.561490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62003cc4-8268-4f47-9495-bc90e6085532 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:20.561770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62003cc4-8268-4f47-9495-bc90e6085532 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:20.562041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62003cc4-8268-4f47-9495-bc90e6085532 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:20.562721 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62003cc4-8268-4f47-9495-bc90e6085532 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:23:20.563022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62003cc4-8268-4f47-9495-bc90e6085532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:20.564395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62003cc4-8268-4f47-9495-bc90e6085532 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:20.572087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 576/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:23:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:20.578467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96c506-3213-4e85-b803-b4ff8dec73f2 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:20.674688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96c506-3213-4e85-b803-b4ff8dec73f2 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:20.706796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0eefa-d08e-4a6d-9d4b-f7123b14df9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:20.707390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0eefa-d08e-4a6d-9d4b-f7123b14df9a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:20.707664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0eefa-d08e-4a6d-9d4b-f7123b14df9a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:20.707933 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0eefa-d08e-4a6d-9d4b-f7123b14df9a None admin] PATH_INFO: `/v3/users/8a77856729f842689f59fbe4804ca0ae` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:20.709034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0eefa-d08e-4a6d-9d4b-f7123b14df9a None admin] RBAC: Authorizing `identity:get_user(user_id=8a77856729f842689f59fbe4804ca0ae)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:20.710459 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0eefa-d08e-4a6d-9d4b-f7123b14df9a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:20.712012 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 575/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:23:20 2022] GET /identity/v3/users/8a77856729f842689f59fbe4804ca0ae => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:20.718044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62003cc4-8268-4f47-9495-bc90e6085532 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:20.781039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:20.813635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62003cc4-8268-4f47-9495-bc90e6085532 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:20.846479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173cd45-0125-435e-9e17-2e51f9919572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:20.847116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173cd45-0125-435e-9e17-2e51f9919572 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:20.847391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173cd45-0125-435e-9e17-2e51f9919572 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:20.847658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173cd45-0125-435e-9e17-2e51f9919572 None admin] PATH_INFO: `/v3/projects/936fc428b0024e97a56b20eca786468f` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:20.848746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173cd45-0125-435e-9e17-2e51f9919572 None admin] RBAC: Authorizing `identity:get_project(project_id=936fc428b0024e97a56b20eca786468f)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:20.850174 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173cd45-0125-435e-9e17-2e51f9919572 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:20.851789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 577/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:23:20 2022] GET /identity/v3/projects/936fc428b0024e97a56b20eca786468f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:20.857504 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0eefa-d08e-4a6d-9d4b-f7123b14df9a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:20.899077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:20.954109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0eefa-d08e-4a6d-9d4b-f7123b14df9a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:20.987019 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c92979-1bf3-47e7-9c87-5532bc86a310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:20.987650 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92979-1bf3-47e7-9c87-5532bc86a310 None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:20.987928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92979-1bf3-47e7-9c87-5532bc86a310 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:20.988200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92979-1bf3-47e7-9c87-5532bc86a310 None admin] PATH_INFO: `/v3/projects/936fc428b0024e97a56b20eca786468f/users/8a77856729f842689f59fbe4804ca0ae/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:20.990060 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c92979-1bf3-47e7-9c87-5532bc86a310 None admin] RBAC: Authorizing `identity:create_grant(project_id=936fc428b0024e97a56b20eca786468f, user_id=8a77856729f842689f59fbe4804ca0ae, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:20.991503 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c92979-1bf3-47e7-9c87-5532bc86a310 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:21.004178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 576/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:23:20 2022] PUT /identity/v3/projects/936fc428b0024e97a56b20eca786468f/users/8a77856729f842689f59fbe4804ca0ae/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:23:23.097098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8f05c-5eaf-4de8-8546-4de1b6534409 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:23.097629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8f05c-5eaf-4de8-8546-4de1b6534409 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:23.097629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8f05c-5eaf-4de8-8546-4de1b6534409 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:23.099012 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 578/1154] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:23.104086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1894-9e0c-4e30-8c21-39fda292cf62 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:23.104461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1894-9e0c-4e30-8c21-39fda292cf62 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:23.104637 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1894-9e0c-4e30-8c21-39fda292cf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:23.123517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-834d1894-9e0c-4e30-8c21-39fda292cf62 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:23.124698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-834d1894-9e0c-4e30-8c21-39fda292cf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:23.189027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 577/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:23.455542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8f05c-5eaf-4de8-8546-4de1b6534409 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:23.559287 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8f05c-5eaf-4de8-8546-4de1b6534409 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:23.592028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d936237-808c-41de-a58f-6fac9b1f985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:23.592644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d936237-808c-41de-a58f-6fac9b1f985b None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:23.592924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d936237-808c-41de-a58f-6fac9b1f985b None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:23.593196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d936237-808c-41de-a58f-6fac9b1f985b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:23.595794 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:23.604918 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d936237-808c-41de-a58f-6fac9b1f985b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-4d936237-808c-41de-a58f-6fac9b1f985b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:23:23.610300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:23:23.611276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:23:23.612199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:23:23.612199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:23:23.612199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:23:23.612199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:23:23.612199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:23:23.612199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:23:23.612199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:23:23.612199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:23:23.612199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:23:23.612199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:23:23.612199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:23:23.612199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:23:23.612199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 579/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:23:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:23:23.617453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d1894-9e0c-4e30-8c21-39fda292cf62 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:23.649812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:23.717537 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d1894-9e0c-4e30-8c21-39fda292cf62 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:23.749846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c27f5-c096-41bf-afeb-3dc0f7da5e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:23.750438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c27f5-c096-41bf-afeb-3dc0f7da5e2e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:23.750743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c27f5-c096-41bf-afeb-3dc0f7da5e2e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:23.751013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c27f5-c096-41bf-afeb-3dc0f7da5e2e None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:23.751663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c27f5-c096-41bf-afeb-3dc0f7da5e2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:23:23.751961 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c27f5-c096-41bf-afeb-3dc0f7da5e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:23.753322 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c27f5-c096-41bf-afeb-3dc0f7da5e2e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:23.760962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 578/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:23:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:23.767066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d936237-808c-41de-a58f-6fac9b1f985b None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:23.865092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d936237-808c-41de-a58f-6fac9b1f985b None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:23.898276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebbc1a-1f63-4787-8dc1-5417fcf9dfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:23.898920 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebbc1a-1f63-4787-8dc1-5417fcf9dfa2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:23.899194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebbc1a-1f63-4787-8dc1-5417fcf9dfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:23.899457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebbc1a-1f63-4787-8dc1-5417fcf9dfa2 None admin] PATH_INFO: `/v3/users/8a77856729f842689f59fbe4804ca0ae` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:23.900551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebbc1a-1f63-4787-8dc1-5417fcf9dfa2 None admin] RBAC: Authorizing `identity:get_user(user_id=8a77856729f842689f59fbe4804ca0ae)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:23.901965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebbc1a-1f63-4787-8dc1-5417fcf9dfa2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:23.904125 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 580/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:23:23 2022] GET /identity/v3/users/8a77856729f842689f59fbe4804ca0ae => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:23.909885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c27f5-c096-41bf-afeb-3dc0f7da5e2e None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:23.999668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:24.006258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c27f5-c096-41bf-afeb-3dc0f7da5e2e None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:24.039089 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724d72-f6ea-449e-97cd-67813fae309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:24.039674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724d72-f6ea-449e-97cd-67813fae309d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:24.039951 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724d72-f6ea-449e-97cd-67813fae309d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:24.040218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724d72-f6ea-449e-97cd-67813fae309d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:24.104549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94724d72-f6ea-449e-97cd-67813fae309d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:24.106009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94724d72-f6ea-449e-97cd-67813fae309d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:24.192862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:24.200425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 579/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:23:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:23:24.206162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebbc1a-1f63-4787-8dc1-5417fcf9dfa2 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:24.266625 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:24.303356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebbc1a-1f63-4787-8dc1-5417fcf9dfa2 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:24.336314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4dcb1-9caa-4a5f-84c3-cf82b2c26647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:24.336932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4dcb1-9caa-4a5f-84c3-cf82b2c26647 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:24.337208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4dcb1-9caa-4a5f-84c3-cf82b2c26647 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:24.337476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4dcb1-9caa-4a5f-84c3-cf82b2c26647 None admin] PATH_INFO: `/v3/projects/936fc428b0024e97a56b20eca786468f` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:24.338590 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4dcb1-9caa-4a5f-84c3-cf82b2c26647 None admin] RBAC: Authorizing `identity:get_project(project_id=936fc428b0024e97a56b20eca786468f)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:24.340019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4dcb1-9caa-4a5f-84c3-cf82b2c26647 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:24.341608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 581/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:23:24 2022] GET /identity/v3/projects/936fc428b0024e97a56b20eca786468f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:24.347734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724d72-f6ea-449e-97cd-67813fae309d None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:24.444473 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724d72-f6ea-449e-97cd-67813fae309d None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:24.479945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd3304-a4ca-40d4-96fb-82a755a5e749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:24.480575 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3304-a4ca-40d4-96fb-82a755a5e749 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:24.480857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3304-a4ca-40d4-96fb-82a755a5e749 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:24.481129 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3304-a4ca-40d4-96fb-82a755a5e749 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:24.481845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd3304-a4ca-40d4-96fb-82a755a5e749 None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=936fc428b0024e97a56b20eca786468f, user.id=8a77856729f842689f59fbe4804ca0ae) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:23:24.482152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd3304-a4ca-40d4-96fb-82a755a5e749 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:24.483596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd3304-a4ca-40d4-96fb-82a755a5e749 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:24.489204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 580/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:23:24 2022] GET /identity/v3/role_assignments?user.id=8a77856729f842689f59fbe4804ca0ae&scope.project.id=936fc428b0024e97a56b20eca786468f&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:26.623811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa30a30-c823-410e-a63f-7818486a002b None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:26.624375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa30a30-c823-410e-a63f-7818486a002b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:26.624375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa30a30-c823-410e-a63f-7818486a002b None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:26.625685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 582/1162] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:26.630803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649611-f817-4e4b-8dde-7f9e3d94300c None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:26.631244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649611-f817-4e4b-8dde-7f9e3d94300c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:26.631348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649611-f817-4e4b-8dde-7f9e3d94300c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:26.648842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8b649611-f817-4e4b-8dde-7f9e3d94300c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:26.650014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8b649611-f817-4e4b-8dde-7f9e3d94300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:26.701479 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:26.715127 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 581/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:26.984537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa30a30-c823-410e-a63f-7818486a002b None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:27.080548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa30a30-c823-410e-a63f-7818486a002b None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:27.108365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:27.113315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bf25c-2026-4ccb-85ce-48a37e1dbf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:27.113899 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bf25c-2026-4ccb-85ce-48a37e1dbf5c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:27.114171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bf25c-2026-4ccb-85ce-48a37e1dbf5c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:27.114434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bf25c-2026-4ccb-85ce-48a37e1dbf5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:27.177386 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bf25c-2026-4ccb-85ce-48a37e1dbf5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:27.178856 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bf25c-2026-4ccb-85ce-48a37e1dbf5c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:27.272313 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 583/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:23:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:23:27.278690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b649611-f817-4e4b-8dde-7f9e3d94300c None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:27.372332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b649611-f817-4e4b-8dde-7f9e3d94300c None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:27.405639 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc5137-4db7-4744-a637-05a30b853124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:27.406243 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5137-4db7-4744-a637-05a30b853124 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:27.406535 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5137-4db7-4744-a637-05a30b853124 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:27.406811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5137-4db7-4744-a637-05a30b853124 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:27.413141 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc5137-4db7-4744-a637-05a30b853124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:27.414593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc5137-4db7-4744-a637-05a30b853124 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-75bc5137-4db7-4744-a637-05a30b853124 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:23:27.425557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:23:27.426829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:23:27.427939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 582/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 05:23:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:23:27.432656 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bf25c-2026-4ccb-85ce-48a37e1dbf5c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:27.462164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:27.527754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bf25c-2026-4ccb-85ce-48a37e1dbf5c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:27.560700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ab889-aee8-46d7-af8d-0708001fe2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:27.561306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ab889-aee8-46d7-af8d-0708001fe2d0 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:27.561583 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ab889-aee8-46d7-af8d-0708001fe2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:27.561853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ab889-aee8-46d7-af8d-0708001fe2d0 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:27.562473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ab889-aee8-46d7-af8d-0708001fe2d0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:23:27.562799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ab889-aee8-46d7-af8d-0708001fe2d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:27.564156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ab889-aee8-46d7-af8d-0708001fe2d0 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:27.571040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 584/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 05:23:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:29.664504 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569037f1-1160-445b-93e9-3746f8938296 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:29.665051 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569037f1-1160-445b-93e9-3746f8938296 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:29.665051 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569037f1-1160-445b-93e9-3746f8938296 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:29.666365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 583/1167] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:29.672710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c06b7-0413-46b0-8726-219a024f3ecc None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:29.673423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c06b7-0413-46b0-8726-219a024f3ecc None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:29.673557 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c06b7-0413-46b0-8726-219a024f3ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:29.692781 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-943c06b7-0413-46b0-8726-219a024f3ecc None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:29.693979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-943c06b7-0413-46b0-8726-219a024f3ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:29.758014 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 585/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:30.027640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569037f1-1160-445b-93e9-3746f8938296 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:30.076575 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:30.126310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569037f1-1160-445b-93e9-3746f8938296 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:30.159820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187a014-a914-45bb-a674-316ff53710b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:30.160422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187a014-a914-45bb-a674-316ff53710b8 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:30.160699 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187a014-a914-45bb-a674-316ff53710b8 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:30.160970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187a014-a914-45bb-a674-316ff53710b8 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:30.161638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187a014-a914-45bb-a674-316ff53710b8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:30.163038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187a014-a914-45bb-a674-316ff53710b8 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:30.179558 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 584/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Fri Sep 16 05:23:30 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:23:32.373320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb4bd-faa1-48df-b565-0c5da46e1810 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:32.373863 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb4bd-faa1-48df-b565-0c5da46e1810 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:32.373863 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb4bd-faa1-48df-b565-0c5da46e1810 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:32.375320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 586/1170] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:32.380489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142c711-66df-49b5-97df-da76832a4323 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:32.380901 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142c711-66df-49b5-97df-da76832a4323 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:32.381045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142c711-66df-49b5-97df-da76832a4323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:32.399236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-7142c711-66df-49b5-97df-da76832a4323 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:32.400405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7142c711-66df-49b5-97df-da76832a4323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:32.466480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 585/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:32.735878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb4bd-faa1-48df-b565-0c5da46e1810 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:32.765518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:32.836579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb4bd-faa1-48df-b565-0c5da46e1810 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:32.869185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cfb90-6b12-478a-901a-34cc47535655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:32.869796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cfb90-6b12-478a-901a-34cc47535655 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:32.870073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cfb90-6b12-478a-901a-34cc47535655 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:32.870367 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cfb90-6b12-478a-901a-34cc47535655 None admin] PATH_INFO: `/v3/domains/923439ff410d4d1eb391f1a987b225b1` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:32.880355 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cfb90-6b12-478a-901a-34cc47535655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=923439ff410d4d1eb391f1a987b225b1)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:32.881804 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cfb90-6b12-478a-901a-34cc47535655 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:32.883387 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 587/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Fri Sep 16 05:23:32 2022] GET /identity/v3/domains/923439ff410d4d1eb391f1a987b225b1 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:32.889344 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142c711-66df-49b5-97df-da76832a4323 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:32.928183 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:32.986395 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142c711-66df-49b5-97df-da76832a4323 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:33.018642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbf777-ee10-44ac-8ad3-56a62c81eec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:33.019232 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbf777-ee10-44ac-8ad3-56a62c81eec0 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:33.019509 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbf777-ee10-44ac-8ad3-56a62c81eec0 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:33.019779 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbf777-ee10-44ac-8ad3-56a62c81eec0 None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:33.020416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbf777-ee10-44ac-8ad3-56a62c81eec0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:33.021836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbf777-ee10-44ac-8ad3-56a62c81eec0 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:33.047636 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 586/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:23:32 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:23:35.243256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988454a-d9f6-4c9f-930b-5ca3b884f92f None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:35.243657 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988454a-d9f6-4c9f-930b-5ca3b884f92f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:35.243808 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988454a-d9f6-4c9f-930b-5ca3b884f92f None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:35.245182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 588/1174] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:35.250492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da963785-ac8c-4a05-9eb2-8a943ea707df None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:35.250896 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da963785-ac8c-4a05-9eb2-8a943ea707df None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:35.251071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da963785-ac8c-4a05-9eb2-8a943ea707df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:35.268767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-da963785-ac8c-4a05-9eb2-8a943ea707df None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:35.269949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-da963785-ac8c-4a05-9eb2-8a943ea707df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:35.333929 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 587/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:35.603055 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988454a-d9f6-4c9f-930b-5ca3b884f92f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:35.685537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:35.701329 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988454a-d9f6-4c9f-930b-5ca3b884f92f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:35.734573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4ee1d-82f2-473d-9b27-e70ad8642753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:35.735188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4ee1d-82f2-473d-9b27-e70ad8642753 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:35.735464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4ee1d-82f2-473d-9b27-e70ad8642753 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:35.735732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4ee1d-82f2-473d-9b27-e70ad8642753 None admin] PATH_INFO: `/v3/domains/923439ff410d4d1eb391f1a987b225b1` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:35.736826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4ee1d-82f2-473d-9b27-e70ad8642753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=923439ff410d4d1eb391f1a987b225b1)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:35.738264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4ee1d-82f2-473d-9b27-e70ad8642753 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:35.739836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 589/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Fri Sep 16 05:23:35 2022] GET /identity/v3/domains/923439ff410d4d1eb391f1a987b225b1 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:35.745521 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da963785-ac8c-4a05-9eb2-8a943ea707df None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:35.766867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:35.844933 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da963785-ac8c-4a05-9eb2-8a943ea707df None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:35.880240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f2201-5684-4598-ae36-80d5498bab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:35.881095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f2201-5684-4598-ae36-80d5498bab04 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:35.881608 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f2201-5684-4598-ae36-80d5498bab04 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:35.882107 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f2201-5684-4598-ae36-80d5498bab04 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:35.883317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f2201-5684-4598-ae36-80d5498bab04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:35.886576 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f2201-5684-4598-ae36-80d5498bab04 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:35.909452 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 588/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:23:35 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:23:38.069799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb21cb-0cf2-45c2-a6ca-196b18fff98f None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:38.070351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb21cb-0cf2-45c2-a6ca-196b18fff98f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:38.070351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb21cb-0cf2-45c2-a6ca-196b18fff98f None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:38.071706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 590/1178] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:38.077505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c276e5b-4cfb-46b0-a306-27c30f125ef2 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:38.077894 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c276e5b-4cfb-46b0-a306-27c30f125ef2 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:38.078038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c276e5b-4cfb-46b0-a306-27c30f125ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:38.096402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-1c276e5b-4cfb-46b0-a306-27c30f125ef2 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:38.097574 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1c276e5b-4cfb-46b0-a306-27c30f125ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:38.161057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 589/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:38.431537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb21cb-0cf2-45c2-a6ca-196b18fff98f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:38.531854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb21cb-0cf2-45c2-a6ca-196b18fff98f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:38.563654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c016c7-7eb1-4c84-99f0-58ba862436e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:38.564264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c016c7-7eb1-4c84-99f0-58ba862436e5 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:38.564539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c016c7-7eb1-4c84-99f0-58ba862436e5 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:38.564805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c016c7-7eb1-4c84-99f0-58ba862436e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:38.574844 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c016c7-7eb1-4c84-99f0-58ba862436e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-f1c016c7-7eb1-4c84-99f0-58ba862436e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:23:38.579544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:23:38.580610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:23:38.581593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:23:38.581593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:23:38.581593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:23:38.581593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:23:38.581593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:23:38.581593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:23:38.581593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:23:38.581593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:23:38.581593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:23:38.581593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:23:38.581593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:23:38.581593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:23:38.581593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 591/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:23:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:23:38.586627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c276e5b-4cfb-46b0-a306-27c30f125ef2 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:38.594995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:38.682234 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c276e5b-4cfb-46b0-a306-27c30f125ef2 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:38.713941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbd68e-6ff6-4dc1-8f19-2323f416c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:38.714556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbd68e-6ff6-4dc1-8f19-2323f416c4bc None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:38.715337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbd68e-6ff6-4dc1-8f19-2323f416c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:38.715601 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbd68e-6ff6-4dc1-8f19-2323f416c4bc None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:38.716242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbd68e-6ff6-4dc1-8f19-2323f416c4bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:23:38.716538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbd68e-6ff6-4dc1-8f19-2323f416c4bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:38.717882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbd68e-6ff6-4dc1-8f19-2323f416c4bc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:38.725447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 590/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:23:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:38.731774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c016c7-7eb1-4c84-99f0-58ba862436e5 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:38.747169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:38.827812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c016c7-7eb1-4c84-99f0-58ba862436e5 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:38.859654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a34a7a-bf65-4175-a09a-a2623a4cdfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:38.860258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a34a7a-bf65-4175-a09a-a2623a4cdfdd None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:38.860536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a34a7a-bf65-4175-a09a-a2623a4cdfdd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:38.860805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a34a7a-bf65-4175-a09a-a2623a4cdfdd None admin] PATH_INFO: `/v3/users/b1b9b7963f0c478e9a597f72f5f54946` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:38.874051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a34a7a-bf65-4175-a09a-a2623a4cdfdd None admin] RBAC: Authorizing `identity:get_user(user_id=b1b9b7963f0c478e9a597f72f5f54946)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:38.875504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a34a7a-bf65-4175-a09a-a2623a4cdfdd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:38.877049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 592/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:23:38 2022] GET /identity/v3/users/b1b9b7963f0c478e9a597f72f5f54946 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:38.882588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbd68e-6ff6-4dc1-8f19-2323f416c4bc None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:38.948205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:38.982044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbd68e-6ff6-4dc1-8f19-2323f416c4bc None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:39.014267 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f99fe-3985-4fec-8ba6-034cd5e0f529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:39.014890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f99fe-3985-4fec-8ba6-034cd5e0f529 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:39.015168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f99fe-3985-4fec-8ba6-034cd5e0f529 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:39.015436 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f99fe-3985-4fec-8ba6-034cd5e0f529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:39.079932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f99fe-3985-4fec-8ba6-034cd5e0f529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:39.081377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f99fe-3985-4fec-8ba6-034cd5e0f529 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:39.143511 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:39.176842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 591/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:23:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:23:39.182836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a34a7a-bf65-4175-a09a-a2623a4cdfdd None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:39.251775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:39.281027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a34a7a-bf65-4175-a09a-a2623a4cdfdd None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:39.313678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810ccf9-2fbc-4756-9884-c01392958ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:39.314296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810ccf9-2fbc-4756-9884-c01392958ecc None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:39.314660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810ccf9-2fbc-4756-9884-c01392958ecc None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:39.314934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810ccf9-2fbc-4756-9884-c01392958ecc None admin] PATH_INFO: `/v3/projects/181019d22c584c3880fafa27b4d5ef62` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:39.316036 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810ccf9-2fbc-4756-9884-c01392958ecc None admin] RBAC: Authorizing `identity:get_project(project_id=181019d22c584c3880fafa27b4d5ef62)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:39.317463 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810ccf9-2fbc-4756-9884-c01392958ecc None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:39.319102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 593/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:23:39 2022] GET /identity/v3/projects/181019d22c584c3880fafa27b4d5ef62 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:39.325838 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f99fe-3985-4fec-8ba6-034cd5e0f529 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:39.427879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f99fe-3985-4fec-8ba6-034cd5e0f529 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:39.461260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40b157-9be2-4e74-bca6-f3c8d613bdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:39.461851 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b157-9be2-4e74-bca6-f3c8d613bdb9 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:39.462126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b157-9be2-4e74-bca6-f3c8d613bdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:39.462397 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b157-9be2-4e74-bca6-f3c8d613bdb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:39.463140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40b157-9be2-4e74-bca6-f3c8d613bdb9 None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=181019d22c584c3880fafa27b4d5ef62, user.id=b1b9b7963f0c478e9a597f72f5f54946) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:23:39.463448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40b157-9be2-4e74-bca6-f3c8d613bdb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:39.464886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40b157-9be2-4e74-bca6-f3c8d613bdb9 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:39.470011 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 592/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:23:39 2022] GET /identity/v3/role_assignments?user.id=b1b9b7963f0c478e9a597f72f5f54946&scope.project.id=181019d22c584c3880fafa27b4d5ef62&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:41.563789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bface565-2302-4ebc-997c-73c08a8e6457 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:41.564323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bface565-2302-4ebc-997c-73c08a8e6457 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:41.564323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bface565-2302-4ebc-997c-73c08a8e6457 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:41.565642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 594/1186] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:41.570870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fbd50-517d-4365-a44c-91885d656519 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:41.571279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fbd50-517d-4365-a44c-91885d656519 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:41.571414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fbd50-517d-4365-a44c-91885d656519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:41.589870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-d77fbd50-517d-4365-a44c-91885d656519 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:41.591084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d77fbd50-517d-4365-a44c-91885d656519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:41.615684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:41.657260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 593/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:41.924420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bface565-2302-4ebc-997c-73c08a8e6457 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:42.022696 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bface565-2302-4ebc-997c-73c08a8e6457 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:42.054956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b7069-8847-4e29-9315-d81b86385eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:42.055564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b7069-8847-4e29-9315-d81b86385eaa None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:42.055838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b7069-8847-4e29-9315-d81b86385eaa None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:42.056108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b7069-8847-4e29-9315-d81b86385eaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:42.064180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:42.067321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b7069-8847-4e29-9315-d81b86385eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-555b7069-8847-4e29-9315-d81b86385eaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:23:42.072212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:23:42.073332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:23:42.074546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:23:42.074546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:23:42.074546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:23:42.074546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:23:42.074546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:23:42.074546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:23:42.074546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:23:42.074546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:23:42.074546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:23:42.074546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:23:42.074546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:23:42.074546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:23:42.074546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 595/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:23:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:23:42.079238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fbd50-517d-4365-a44c-91885d656519 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:42.172887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fbd50-517d-4365-a44c-91885d656519 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:42.205491 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfd054-7a9a-4d45-b259-28d6922c6697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:42.206027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfd054-7a9a-4d45-b259-28d6922c6697 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:42.206302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfd054-7a9a-4d45-b259-28d6922c6697 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:42.206594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfd054-7a9a-4d45-b259-28d6922c6697 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:42.207244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfd054-7a9a-4d45-b259-28d6922c6697 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:23:42.207541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfd054-7a9a-4d45-b259-28d6922c6697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:42.208880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfd054-7a9a-4d45-b259-28d6922c6697 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:42.217007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 594/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:23:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:42.222881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b7069-8847-4e29-9315-d81b86385eaa None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:42.321124 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b7069-8847-4e29-9315-d81b86385eaa None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:42.354066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7726b6-429a-4aa5-89f4-c55a59003527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:42.354708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7726b6-429a-4aa5-89f4-c55a59003527 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:42.354986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7726b6-429a-4aa5-89f4-c55a59003527 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:42.355877 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7726b6-429a-4aa5-89f4-c55a59003527 None admin] PATH_INFO: `/v3/users/b1b9b7963f0c478e9a597f72f5f54946` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:42.357028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7726b6-429a-4aa5-89f4-c55a59003527 None admin] RBAC: Authorizing `identity:get_user(user_id=b1b9b7963f0c478e9a597f72f5f54946)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:42.358458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7726b6-429a-4aa5-89f4-c55a59003527 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:42.360043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 596/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:23:42 2022] GET /identity/v3/users/b1b9b7963f0c478e9a597f72f5f54946 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:42.365906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfd054-7a9a-4d45-b259-28d6922c6697 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:42.390532 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:42.463004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfd054-7a9a-4d45-b259-28d6922c6697 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:42.495597 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090699d-4625-4689-b3bb-7daa30481fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:42.496227 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090699d-4625-4689-b3bb-7daa30481fc8 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:42.496503 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090699d-4625-4689-b3bb-7daa30481fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:42.496771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090699d-4625-4689-b3bb-7daa30481fc8 None admin] PATH_INFO: `/v3/projects/181019d22c584c3880fafa27b4d5ef62` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:42.497869 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090699d-4625-4689-b3bb-7daa30481fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=181019d22c584c3880fafa27b4d5ef62)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:42.499302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090699d-4625-4689-b3bb-7daa30481fc8 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:42.500903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 595/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:23:42 2022] GET /identity/v3/projects/181019d22c584c3880fafa27b4d5ef62 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:42.506727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7726b6-429a-4aa5-89f4-c55a59003527 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:42.570269 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:42.603074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7726b6-429a-4aa5-89f4-c55a59003527 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:42.634790 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8687b9-0a8b-488a-988c-55313860f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:42.635422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8687b9-0a8b-488a-988c-55313860f87e None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:42.635701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8687b9-0a8b-488a-988c-55313860f87e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:42.635971 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8687b9-0a8b-488a-988c-55313860f87e None admin] PATH_INFO: `/v3/projects/181019d22c584c3880fafa27b4d5ef62/users/b1b9b7963f0c478e9a597f72f5f54946/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:42.638356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8687b9-0a8b-488a-988c-55313860f87e None admin] RBAC: Authorizing `identity:create_grant(project_id=181019d22c584c3880fafa27b4d5ef62, user_id=b1b9b7963f0c478e9a597f72f5f54946, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:42.639806 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8687b9-0a8b-488a-988c-55313860f87e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:42.651598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 597/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:23:42 2022] PUT /identity/v3/projects/181019d22c584c3880fafa27b4d5ef62/users/b1b9b7963f0c478e9a597f72f5f54946/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:23:44.796701 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d19d3-c4aa-4e59-aae7-6b3beb4e6516 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:44.797272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d19d3-c4aa-4e59-aae7-6b3beb4e6516 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:44.797272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d19d3-c4aa-4e59-aae7-6b3beb4e6516 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:44.798610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 596/1193] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:23:44.803888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ab957-3b3d-4d05-9a1d-e1e0ebd1e821 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:44.804278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ab957-3b3d-4d05-9a1d-e1e0ebd1e821 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:44.804429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ab957-3b3d-4d05-9a1d-e1e0ebd1e821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:44.822793 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-2f0ab957-3b3d-4d05-9a1d-e1e0ebd1e821 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:23:44.824536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2f0ab957-3b3d-4d05-9a1d-e1e0ebd1e821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:23:44.887708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 598/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:23:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:23:45.162014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d19d3-c4aa-4e59-aae7-6b3beb4e6516 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:45.253517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:45.264056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d19d3-c4aa-4e59-aae7-6b3beb4e6516 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:45.297642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5de207-0ddc-493e-91a2-becc19bd58bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:45.298267 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5de207-0ddc-493e-91a2-becc19bd58bb None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:45.298638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5de207-0ddc-493e-91a2-becc19bd58bb None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:45.298914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5de207-0ddc-493e-91a2-becc19bd58bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:45.309182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5de207-0ddc-493e-91a2-becc19bd58bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-bf5de207-0ddc-493e-91a2-becc19bd58bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:23:45.314247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:23:45.315349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:23:45.316219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:23:45.316219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:23:45.316219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:23:45.316219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:23:45.316219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:23:45.316219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:23:45.316219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:23:45.316219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:23:45.316219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:23:45.316219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:23:45.316219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:23:45.316219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:23:45.316219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 597/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:23:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:23:45.321351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ab957-3b3d-4d05-9a1d-e1e0ebd1e821 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:45.377844 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:45.419587 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ab957-3b3d-4d05-9a1d-e1e0ebd1e821 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:45.451846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be4e30-9571-4a3e-9741-b3259f44abdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:45.452438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be4e30-9571-4a3e-9741-b3259f44abdd None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:45.452714 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be4e30-9571-4a3e-9741-b3259f44abdd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:45.452985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be4e30-9571-4a3e-9741-b3259f44abdd None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:45.453630 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be4e30-9571-4a3e-9741-b3259f44abdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:23:45.453929 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be4e30-9571-4a3e-9741-b3259f44abdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:45.455331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be4e30-9571-4a3e-9741-b3259f44abdd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:45.463100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 599/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:23:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:45.469466 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5de207-0ddc-493e-91a2-becc19bd58bb None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:45.565952 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5de207-0ddc-493e-91a2-becc19bd58bb None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:45.607678 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c31cb8-1323-4f89-83b9-f812d746b1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:45.608689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31cb8-1323-4f89-83b9-f812d746b1a1 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:45.609161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31cb8-1323-4f89-83b9-f812d746b1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:45.609641 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31cb8-1323-4f89-83b9-f812d746b1a1 None admin] PATH_INFO: `/v3/users/b1b9b7963f0c478e9a597f72f5f54946` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:45.611145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c31cb8-1323-4f89-83b9-f812d746b1a1 None admin] RBAC: Authorizing `identity:get_user(user_id=b1b9b7963f0c478e9a597f72f5f54946)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:45.612587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c31cb8-1323-4f89-83b9-f812d746b1a1 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:45.614212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 598/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 05:23:45 2022] GET /identity/v3/users/b1b9b7963f0c478e9a597f72f5f54946 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:45.620650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be4e30-9571-4a3e-9741-b3259f44abdd None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:45.739270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be4e30-9571-4a3e-9741-b3259f44abdd None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:45.758148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:45.772432 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998e9e4-02a7-42f8-93d4-afac7faa93a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:45.773028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998e9e4-02a7-42f8-93d4-afac7faa93a9 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:45.773307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998e9e4-02a7-42f8-93d4-afac7faa93a9 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:45.773578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998e9e4-02a7-42f8-93d4-afac7faa93a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:45.837965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998e9e4-02a7-42f8-93d4-afac7faa93a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:45.840069 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998e9e4-02a7-42f8-93d4-afac7faa93a9 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:45.932496 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 600/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:23:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:23:45.939250 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c31cb8-1323-4f89-83b9-f812d746b1a1 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:45.961179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:46.049132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c31cb8-1323-4f89-83b9-f812d746b1a1 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:46.082197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231769-0879-450e-89a2-d31474388da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:46.082848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231769-0879-450e-89a2-d31474388da2 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:46.083126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231769-0879-450e-89a2-d31474388da2 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:46.083396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231769-0879-450e-89a2-d31474388da2 None admin] PATH_INFO: `/v3/projects/181019d22c584c3880fafa27b4d5ef62` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:46.084495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97231769-0879-450e-89a2-d31474388da2 None admin] RBAC: Authorizing `identity:get_project(project_id=181019d22c584c3880fafa27b4d5ef62)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:46.085912 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97231769-0879-450e-89a2-d31474388da2 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:46.087548 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 599/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 05:23:45 2022] GET /identity/v3/projects/181019d22c584c3880fafa27b4d5ef62 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:46.093740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998e9e4-02a7-42f8-93d4-afac7faa93a9 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:23:46.113901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:46.189356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998e9e4-02a7-42f8-93d4-afac7faa93a9 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:23:46.222085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e569149-02a6-4bc1-8f63-70cf7467f05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:23:46.222710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e569149-02a6-4bc1-8f63-70cf7467f05f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:23:46.222989 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e569149-02a6-4bc1-8f63-70cf7467f05f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:23:46.223260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e569149-02a6-4bc1-8f63-70cf7467f05f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:23:46.223976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e569149-02a6-4bc1-8f63-70cf7467f05f None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=181019d22c584c3880fafa27b4d5ef62, user.id=b1b9b7963f0c478e9a597f72f5f54946) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:23:46.224282 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e569149-02a6-4bc1-8f63-70cf7467f05f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:23:46.225713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e569149-02a6-4bc1-8f63-70cf7467f05f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:23:46.231603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 601/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:23:46 2022] GET /identity/v3/role_assignments?user.id=b1b9b7963f0c478e9a597f72f5f54946&scope.project.id=181019d22c584c3880fafa27b4d5ef62&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:23:56.078135 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=56 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:23:56.228946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=58 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:41.383995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a841fd-26d2-4669-9f8d-3f278e0b33f4 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:41.384653 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a841fd-26d2-4669-9f8d-3f278e0b33f4 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:41.384653 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a841fd-26d2-4669-9f8d-3f278e0b33f4 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:41.386165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 600/1201] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:24:41.395782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29840f7b-795b-4df4-b4f9-a47f3ecf872a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:41.395782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29840f7b-795b-4df4-b4f9-a47f3ecf872a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:41.395782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29840f7b-795b-4df4-b4f9-a47f3ecf872a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:41.414576 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-29840f7b-795b-4df4-b4f9-a47f3ecf872a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:24:41.416192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-29840f7b-795b-4df4-b4f9-a47f3ecf872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:24:41.508555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 602/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:24:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:24:41.863513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a841fd-26d2-4669-9f8d-3f278e0b33f4 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:42.009648 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a841fd-26d2-4669-9f8d-3f278e0b33f4 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:42.052245 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55894af5-06ae-4f0b-8ca4-69ecdd5c09ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:42.053026 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55894af5-06ae-4f0b-8ca4-69ecdd5c09ec None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:42.053265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55894af5-06ae-4f0b-8ca4-69ecdd5c09ec None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:42.053567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55894af5-06ae-4f0b-8ca4-69ecdd5c09ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:42.069567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55894af5-06ae-4f0b-8ca4-69ecdd5c09ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:42.071092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55894af5-06ae-4f0b-8ca4-69ecdd5c09ec None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-55894af5-06ae-4f0b-8ca4-69ecdd5c09ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:24:42.088778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:42.089865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:24:42.090907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:24:42.090907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:42.090907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:24:42.090907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 601/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:24:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:42.096818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29840f7b-795b-4df4-b4f9-a47f3ecf872a None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:42.222438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29840f7b-795b-4df4-b4f9-a47f3ecf872a None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:42.259422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:42.268038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9040d-1a47-4bfb-8f06-92fc0ad00b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:42.268690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9040d-1a47-4bfb-8f06-92fc0ad00b9f None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:42.268992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9040d-1a47-4bfb-8f06-92fc0ad00b9f None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:42.269397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9040d-1a47-4bfb-8f06-92fc0ad00b9f None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:42.270099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9040d-1a47-4bfb-8f06-92fc0ad00b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:42.270400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9040d-1a47-4bfb-8f06-92fc0ad00b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:42.272020 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9040d-1a47-4bfb-8f06-92fc0ad00b9f None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:42.294549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 603/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:42.298235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55894af5-06ae-4f0b-8ca4-69ecdd5c09ec None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:42.364322 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:42.424189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55894af5-06ae-4f0b-8ca4-69ecdd5c09ec None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:42.465810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bd2bb-a71c-4746-a70b-a77bbc6e803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:42.466533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bd2bb-a71c-4746-a70b-a77bbc6e803f None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:42.466826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bd2bb-a71c-4746-a70b-a77bbc6e803f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:42.467100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bd2bb-a71c-4746-a70b-a77bbc6e803f None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:42.467753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bd2bb-a71c-4746-a70b-a77bbc6e803f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:42.470328 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bd2bb-a71c-4746-a70b-a77bbc6e803f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:42.513644 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 602/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 05:24:42 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:24:44.910704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209e683-c43f-4499-899d-e505cc722a8e None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:44.911434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209e683-c43f-4499-899d-e505cc722a8e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:44.911434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209e683-c43f-4499-899d-e505cc722a8e None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:44.912720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 604/1206] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:24:44.918818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed6b60-b0b5-40a8-be13-d2cc0aa9d540 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:44.919414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed6b60-b0b5-40a8-be13-d2cc0aa9d540 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:44.919414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed6b60-b0b5-40a8-be13-d2cc0aa9d540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:44.939187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-94ed6b60-b0b5-40a8-be13-d2cc0aa9d540 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:24:44.940418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-94ed6b60-b0b5-40a8-be13-d2cc0aa9d540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:24:45.015368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 603/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:24:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:24:45.286733 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209e683-c43f-4499-899d-e505cc722a8e None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:45.407766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209e683-c43f-4499-899d-e505cc722a8e None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:45.448610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b0aa8-de14-4150-a6eb-651d50392b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:45.449245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b0aa8-de14-4150-a6eb-651d50392b66 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:45.449518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b0aa8-de14-4150-a6eb-651d50392b66 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:45.449947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b0aa8-de14-4150-a6eb-651d50392b66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:45.464466 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b0aa8-de14-4150-a6eb-651d50392b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-577b0aa8-de14-4150-a6eb-651d50392b66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:24:45.469331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:45.470373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:45.471325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:45.471325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:45.471325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:45.471325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:45.471325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:24:45.471325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:24:45.471325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:24:45.471325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:24:45.471325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:24:45.471325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:24:45.471325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:24:45.471325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:24:45.471325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 605/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:24:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:45.476729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed6b60-b0b5-40a8-be13-d2cc0aa9d540 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:45.519062 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:45.584017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed6b60-b0b5-40a8-be13-d2cc0aa9d540 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:45.629925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9e8d7-f900-4b9a-a2dc-6ab92e00e2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:45.630569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9e8d7-f900-4b9a-a2dc-6ab92e00e2cc None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:45.630850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9e8d7-f900-4b9a-a2dc-6ab92e00e2cc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:45.631122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9e8d7-f900-4b9a-a2dc-6ab92e00e2cc None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:45.631798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9e8d7-f900-4b9a-a2dc-6ab92e00e2cc None admin] RBAC: Adding query filter params (name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:45.632098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9e8d7-f900-4b9a-a2dc-6ab92e00e2cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:45.633541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9e8d7-f900-4b9a-a2dc-6ab92e00e2cc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:45.643273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 604/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:24:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:45.649645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b0aa8-de14-4150-a6eb-651d50392b66 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:45.708605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:45.774333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b0aa8-de14-4150-a6eb-651d50392b66 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:45.818499 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c94678-c4eb-4745-90f4-752e50078429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:45.819217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c94678-c4eb-4745-90f4-752e50078429 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:45.819533 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c94678-c4eb-4745-90f4-752e50078429 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:45.819905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c94678-c4eb-4745-90f4-752e50078429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:45.832063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c94678-c4eb-4745-90f4-752e50078429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:45.833912 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c94678-c4eb-4745-90f4-752e50078429 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-f5c94678-c4eb-4745-90f4-752e50078429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:24:45.851713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:45.854773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:24:45.856001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:24:45.856001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:45.856001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:24:45.856001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 606/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:45.859176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9e8d7-f900-4b9a-a2dc-6ab92e00e2cc None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:45.977311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:45.985607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9e8d7-f900-4b9a-a2dc-6ab92e00e2cc None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:46.020302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963554e-a1dc-45d3-97ce-75e6348320c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:46.020914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963554e-a1dc-45d3-97ce-75e6348320c1 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:46.021191 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963554e-a1dc-45d3-97ce-75e6348320c1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:46.021460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963554e-a1dc-45d3-97ce-75e6348320c1 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:46.022105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963554e-a1dc-45d3-97ce-75e6348320c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:46.022408 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963554e-a1dc-45d3-97ce-75e6348320c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:46.024323 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963554e-a1dc-45d3-97ce-75e6348320c1 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:46.043028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 605/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:46.044247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c94678-c4eb-4745-90f4-752e50078429 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:46.168839 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c94678-c4eb-4745-90f4-752e50078429 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:46.170430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:46.209196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332219c0-68f1-4961-aa85-00d34ac6a062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:46.210111 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332219c0-68f1-4961-aa85-00d34ac6a062 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:46.211074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332219c0-68f1-4961-aa85-00d34ac6a062 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:46.211485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332219c0-68f1-4961-aa85-00d34ac6a062 None admin] PATH_INFO: `/v3/users/placement` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:46.220943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332219c0-68f1-4961-aa85-00d34ac6a062 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:46.222617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332219c0-68f1-4961-aa85-00d34ac6a062 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-332219c0-68f1-4961-aa85-00d34ac6a062 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:24:46.239853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:46.240871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:46.241850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:46.241850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:46.241850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:24:46.241850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:24:46.241850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:24:46.241850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:24:46.241850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:24:46.241850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:24:46.241850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 05:24:46.241850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:24:46.244158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 607/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:24:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:46.250056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963554e-a1dc-45d3-97ce-75e6348320c1 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:46.356261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963554e-a1dc-45d3-97ce-75e6348320c1 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:46.398443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0eaf7-9a7e-49cf-ac43-1f82980337d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:46.399110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0eaf7-9a7e-49cf-ac43-1f82980337d1 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:46.399381 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0eaf7-9a7e-49cf-ac43-1f82980337d1 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:46.399694 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0eaf7-9a7e-49cf-ac43-1f82980337d1 None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:46.400360 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0eaf7-9a7e-49cf-ac43-1f82980337d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:46.400679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0eaf7-9a7e-49cf-ac43-1f82980337d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:46.402105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0eaf7-9a7e-49cf-ac43-1f82980337d1 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:46.426216 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 606/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 16 05:24:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:46.431911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332219c0-68f1-4961-aa85-00d34ac6a062 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:46.541447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332219c0-68f1-4961-aa85-00d34ac6a062 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:46.576765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de4674-078a-4079-b13e-14330d5e9135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:46.577365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de4674-078a-4079-b13e-14330d5e9135 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:46.577683 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de4674-078a-4079-b13e-14330d5e9135 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:46.577916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de4674-078a-4079-b13e-14330d5e9135 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:46.612700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:46.657946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de4674-078a-4079-b13e-14330d5e9135 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:46.659873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de4674-078a-4079-b13e-14330d5e9135 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:46.772737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 608/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:24:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:24:46.778640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0eaf7-9a7e-49cf-ac43-1f82980337d1 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:46.799033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:46.894920 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0eaf7-9a7e-49cf-ac43-1f82980337d1 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:46.941230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ab23a-b72a-4bf0-a3ec-5bf07e3af5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:46.942336 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ab23a-b72a-4bf0-a3ec-5bf07e3af5f5 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:46.942637 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ab23a-b72a-4bf0-a3ec-5bf07e3af5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:46.942916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ab23a-b72a-4bf0-a3ec-5bf07e3af5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:46.955855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ab23a-b72a-4bf0-a3ec-5bf07e3af5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:46.957582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ab23a-b72a-4bf0-a3ec-5bf07e3af5f5 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-a38ab23a-b72a-4bf0-a3ec-5bf07e3af5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:24:46.974311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:46.975443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:24:46.977041 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:24:46.977041 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:46.977041 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:24:46.977041 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 607/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:46.981669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de4674-078a-4079-b13e-14330d5e9135 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:47.061456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:47.119618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de4674-078a-4079-b13e-14330d5e9135 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:47.168712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbe0f8-f579-4106-9ce3-edcab8ef061a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:47.169477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbe0f8-f579-4106-9ce3-edcab8ef061a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:47.169819 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbe0f8-f579-4106-9ce3-edcab8ef061a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:47.170096 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbe0f8-f579-4106-9ce3-edcab8ef061a None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:47.170782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbe0f8-f579-4106-9ce3-edcab8ef061a None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:47.171086 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbe0f8-f579-4106-9ce3-edcab8ef061a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:47.172473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbe0f8-f579-4106-9ce3-edcab8ef061a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:47.195832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 609/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:47.202176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ab23a-b72a-4bf0-a3ec-5bf07e3af5f5 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:47.294121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:47.335017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ab23a-b72a-4bf0-a3ec-5bf07e3af5f5 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:47.372354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79104bc4-dd97-41d1-82ff-0dea97fd8c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:47.373063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79104bc4-dd97-41d1-82ff-0dea97fd8c56 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:47.373385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79104bc4-dd97-41d1-82ff-0dea97fd8c56 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:47.373727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79104bc4-dd97-41d1-82ff-0dea97fd8c56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:47.383039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79104bc4-dd97-41d1-82ff-0dea97fd8c56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:47.384847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79104bc4-dd97-41d1-82ff-0dea97fd8c56 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-79104bc4-dd97-41d1-82ff-0dea97fd8c56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:24:47.398908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:47.399947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:47.405998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:24:47.405998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:24:47.405998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:24:47.405998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:24:47.405998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:24:47.405998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:24:47.405998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:24:47.405998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:24:47.405998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 608/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:24:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:47.407589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbe0f8-f579-4106-9ce3-edcab8ef061a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:47.523466 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbe0f8-f579-4106-9ce3-edcab8ef061a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:47.549543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:47.564457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a8280-faee-4560-bcac-ffd59eb059cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:47.565047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a8280-faee-4560-bcac-ffd59eb059cd None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:47.565322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a8280-faee-4560-bcac-ffd59eb059cd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:47.565591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a8280-faee-4560-bcac-ffd59eb059cd None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:47.566278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a8280-faee-4560-bcac-ffd59eb059cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:47.566613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a8280-faee-4560-bcac-ffd59eb059cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:47.568061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a8280-faee-4560-bcac-ffd59eb059cd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:47.581905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 610/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:24:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:47.589325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79104bc4-dd97-41d1-82ff-0dea97fd8c56 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:47.706706 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79104bc4-dd97-41d1-82ff-0dea97fd8c56 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:47.738533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:47.745574 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775aec9-0d88-4e77-8b88-25cc775c80c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:47.746230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775aec9-0d88-4e77-8b88-25cc775c80c8 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:47.746578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775aec9-0d88-4e77-8b88-25cc775c80c8 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:47.746956 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775aec9-0d88-4e77-8b88-25cc775c80c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:47.747620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775aec9-0d88-4e77-8b88-25cc775c80c8 None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=8ef60b27f5f545aa8ea063009ec66eb4) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:47.747963 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775aec9-0d88-4e77-8b88-25cc775c80c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:47.749487 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775aec9-0d88-4e77-8b88-25cc775c80c8 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:47.755399 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 609/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:24:47 2022] GET /identity/v3/role_assignments?user.id=8ef60b27f5f545aa8ea063009ec66eb4&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:49.924597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f10435-2235-49f4-a3e5-bbd867b89449 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:49.925266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f10435-2235-49f4-a3e5-bbd867b89449 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:49.925266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f10435-2235-49f4-a3e5-bbd867b89449 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:49.926436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 611/1220] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:24:49.932114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b775998-fd18-446a-937b-add429dd39d8 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:49.932837 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b775998-fd18-446a-937b-add429dd39d8 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:49.932947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b775998-fd18-446a-937b-add429dd39d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:49.951297 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-1b775998-fd18-446a-937b-add429dd39d8 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:24:49.952486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1b775998-fd18-446a-937b-add429dd39d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:24:50.032385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 610/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:24:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:24:50.317863 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f10435-2235-49f4-a3e5-bbd867b89449 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:50.426497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f10435-2235-49f4-a3e5-bbd867b89449 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:50.465574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d0af6-218a-4230-bd7a-cb98d7e66242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:50.466269 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d0af6-218a-4230-bd7a-cb98d7e66242 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:50.466607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d0af6-218a-4230-bd7a-cb98d7e66242 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:50.466908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d0af6-218a-4230-bd7a-cb98d7e66242 None admin] PATH_INFO: `/v3/roles/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:50.478610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d0af6-218a-4230-bd7a-cb98d7e66242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-ee0d0af6-218a-4230-bd7a-cb98d7e66242 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:24:50.483967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:50.485141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:50.485984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:50.485984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:50.485984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:50.485984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:50.485984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:24:50.485984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:24:50.485984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:24:50.485984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:24:50.485984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:24:50.485984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:24:50.485984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:24:50.485984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:24:50.485984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 612/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:24:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:50.491804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b775998-fd18-446a-937b-add429dd39d8 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:50.596015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b775998-fd18-446a-937b-add429dd39d8 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:50.624441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:50.636759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e8ba6-f572-40f2-a628-074e71043d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:50.637444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e8ba6-f572-40f2-a628-074e71043d04 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:50.637798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e8ba6-f572-40f2-a628-074e71043d04 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:50.638140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e8ba6-f572-40f2-a628-074e71043d04 None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:50.638916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e8ba6-f572-40f2-a628-074e71043d04 None admin] RBAC: Adding query filter params (name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:50.639293 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e8ba6-f572-40f2-a628-074e71043d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:50.640728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e8ba6-f572-40f2-a628-074e71043d04 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:50.649192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 611/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:24:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:50.655163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d0af6-218a-4230-bd7a-cb98d7e66242 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:50.709638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:50.768465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d0af6-218a-4230-bd7a-cb98d7e66242 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:50.804765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b998cc-62ef-4880-ac86-2c4ef9d6867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:50.805392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b998cc-62ef-4880-ac86-2c4ef9d6867d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:50.805677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b998cc-62ef-4880-ac86-2c4ef9d6867d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:50.805982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b998cc-62ef-4880-ac86-2c4ef9d6867d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:50.816863 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b998cc-62ef-4880-ac86-2c4ef9d6867d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:50.818545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b998cc-62ef-4880-ac86-2c4ef9d6867d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-62b998cc-62ef-4880-ac86-2c4ef9d6867d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:24:50.835645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:50.836797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:24:50.837689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:24:50.837689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:50.837689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:24:50.837689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 613/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:50.842826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e8ba6-f572-40f2-a628-074e71043d04 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:50.964661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e8ba6-f572-40f2-a628-074e71043d04 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:51.002526 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b25ba-33eb-493f-a662-78a45ac150bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:51.003254 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b25ba-33eb-493f-a662-78a45ac150bc None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:51.003634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b25ba-33eb-493f-a662-78a45ac150bc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:51.004100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b25ba-33eb-493f-a662-78a45ac150bc None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:51.004661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b25ba-33eb-493f-a662-78a45ac150bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:51.004981 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b25ba-33eb-493f-a662-78a45ac150bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:51.006302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b25ba-33eb-493f-a662-78a45ac150bc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:51.025013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 612/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:24:51.026175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b998cc-62ef-4880-ac86-2c4ef9d6867d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:51.123557 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:51.132473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b998cc-62ef-4880-ac86-2c4ef9d6867d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:51.169544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e12b6-c8b8-4a27-96c8-123c7d687490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:51.170287 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e12b6-c8b8-4a27-96c8-123c7d687490 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:51.170464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e12b6-c8b8-4a27-96c8-123c7d687490 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:51.170758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e12b6-c8b8-4a27-96c8-123c7d687490 None admin] PATH_INFO: `/v3/users/placement` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:51.178316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e12b6-c8b8-4a27-96c8-123c7d687490 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:51.180323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e12b6-c8b8-4a27-96c8-123c7d687490 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-056e12b6-c8b8-4a27-96c8-123c7d687490 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:24:51.191606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:51.192894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:51.194234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:51.194234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:51.194234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:24:51.194234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:24:51.194234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:24:51.194234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:24:51.194234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:24:51.194234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:24:51.194234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 05:24:51.194234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:24:51.194234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 614/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:24:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:24:51.199609 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b25ba-33eb-493f-a662-78a45ac150bc None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:51.257935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:51.320805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b25ba-33eb-493f-a662-78a45ac150bc None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:51.354107 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d3ddb-0058-45c5-a2cf-fc008e5c053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:51.354743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d3ddb-0058-45c5-a2cf-fc008e5c053c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:51.355022 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d3ddb-0058-45c5-a2cf-fc008e5c053c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:51.355292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d3ddb-0058-45c5-a2cf-fc008e5c053c None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:51.356010 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d3ddb-0058-45c5-a2cf-fc008e5c053c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:51.356309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d3ddb-0058-45c5-a2cf-fc008e5c053c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:51.357739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d3ddb-0058-45c5-a2cf-fc008e5c053c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:51.376559 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 613/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 16 05:24:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:51.382999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e12b6-c8b8-4a27-96c8-123c7d687490 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:51.486607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e12b6-c8b8-4a27-96c8-123c7d687490 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:51.523479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f09da-42f1-4d37-ab3a-85b28a13c9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:51.524190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f09da-42f1-4d37-ab3a-85b28a13c9ef None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:51.524507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f09da-42f1-4d37-ab3a-85b28a13c9ef None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:51.524818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f09da-42f1-4d37-ab3a-85b28a13c9ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:51.536987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f09da-42f1-4d37-ab3a-85b28a13c9ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:51.538628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f09da-42f1-4d37-ab3a-85b28a13c9ef None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-a24f09da-42f1-4d37-ab3a-85b28a13c9ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:24:51.555468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:51.556729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:24:51.558064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:24:51.558064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:51.558064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:24:51.558064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 615/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 05:24:51.563178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d3ddb-0058-45c5-a2cf-fc008e5c053c None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:51.677927 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d3ddb-0058-45c5-a2cf-fc008e5c053c None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:51.681331 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:51.716069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2d839-c273-4b74-ac8b-6e3223d8fc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:51.716681 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2d839-c273-4b74-ac8b-6e3223d8fc09 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:51.716955 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2d839-c273-4b74-ac8b-6e3223d8fc09 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:51.717220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2d839-c273-4b74-ac8b-6e3223d8fc09 None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:51.717962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2d839-c273-4b74-ac8b-6e3223d8fc09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:51.718301 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2d839-c273-4b74-ac8b-6e3223d8fc09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:51.719860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2d839-c273-4b74-ac8b-6e3223d8fc09 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:51.731758 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 614/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:51.737415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f09da-42f1-4d37-ab3a-85b28a13c9ef None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:51.747163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:51.842882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f09da-42f1-4d37-ab3a-85b28a13c9ef None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:51.878003 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21ddb8-c583-44a4-9ce0-b78869babe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:51.878756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21ddb8-c583-44a4-9ce0-b78869babe59 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:51.878998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21ddb8-c583-44a4-9ce0-b78869babe59 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:51.879267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21ddb8-c583-44a4-9ce0-b78869babe59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:51.886164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21ddb8-c583-44a4-9ce0-b78869babe59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:51.887658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21ddb8-c583-44a4-9ce0-b78869babe59 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-bc21ddb8-c583-44a4-9ce0-b78869babe59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:24:51.899701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:51.900725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:51.901763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:24:51.901763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:24:51.901763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:24:51.901763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:24:51.901763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:24:51.901763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:24:51.901763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:24:51.901763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:24:51.901763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 616/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:24:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:51.907075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2d839-c273-4b74-ac8b-6e3223d8fc09 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:52.034956 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2d839-c273-4b74-ac8b-6e3223d8fc09 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:52.073174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c8068-dde1-472d-af2c-07dcd5e445fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:52.073750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c8068-dde1-472d-af2c-07dcd5e445fa None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:52.074018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c8068-dde1-472d-af2c-07dcd5e445fa None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:52.074284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c8068-dde1-472d-af2c-07dcd5e445fa None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:52.075000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c8068-dde1-472d-af2c-07dcd5e445fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:52.075305 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c8068-dde1-472d-af2c-07dcd5e445fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:52.076732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c8068-dde1-472d-af2c-07dcd5e445fa None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:52.089489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 615/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:24:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:52.096871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21ddb8-c583-44a4-9ce0-b78869babe59 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:52.169348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:52.206861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21ddb8-c583-44a4-9ce0-b78869babe59 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:52.245578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9432f-1200-4563-983c-13a796381dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:52.246237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9432f-1200-4563-983c-13a796381dc2 None admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:52.246522 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9432f-1200-4563-983c-13a796381dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:52.246808 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9432f-1200-4563-983c-13a796381dc2 None admin] PATH_INFO: `/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/8ef60b27f5f545aa8ea063009ec66eb4/roles/bed020f3301c4f169f2a6d5795cd26f0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:52.261838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9432f-1200-4563-983c-13a796381dc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=74c9d19fb1534f8f8888e957d1007640, user_id=8ef60b27f5f545aa8ea063009ec66eb4, role_id=bed020f3301c4f169f2a6d5795cd26f0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:52.263456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9432f-1200-4563-983c-13a796381dc2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:52.276072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 617/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:24:52 2022] PUT /identity/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/8ef60b27f5f545aa8ea063009ec66eb4/roles/bed020f3301c4f169f2a6d5795cd26f0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:24:54.546540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceed38f-6d46-4661-aea5-05d2e2998f96 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:54.547037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceed38f-6d46-4661-aea5-05d2e2998f96 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:54.547037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceed38f-6d46-4661-aea5-05d2e2998f96 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:54.548343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 616/1233] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:24:54.554249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81c7c4-b014-4abe-902d-3196de9cdc5d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:54.554689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81c7c4-b014-4abe-902d-3196de9cdc5d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:54.554826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81c7c4-b014-4abe-902d-3196de9cdc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:54.575966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-ad81c7c4-b014-4abe-902d-3196de9cdc5d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:24:54.577181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ad81c7c4-b014-4abe-902d-3196de9cdc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:24:54.654171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 618/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:24:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:24:54.923848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceed38f-6d46-4661-aea5-05d2e2998f96 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:54.955464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:55.036642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceed38f-6d46-4661-aea5-05d2e2998f96 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:55.076390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b7f94-9a0d-4d84-8078-a13f97e80a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:55.077014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b7f94-9a0d-4d84-8078-a13f97e80a0e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:55.077287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b7f94-9a0d-4d84-8078-a13f97e80a0e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:55.077558 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b7f94-9a0d-4d84-8078-a13f97e80a0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:55.088572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b7f94-9a0d-4d84-8078-a13f97e80a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-6f5b7f94-9a0d-4d84-8078-a13f97e80a0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:24:55.093335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:55.094462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:55.095735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:55.095735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:55.095735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:55.095735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:55.095735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:24:55.095735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:24:55.095735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:24:55.095735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:24:55.095735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:24:55.095735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:24:55.095735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 05:24:55.095735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:24:55.095735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 617/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 05:24:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:55.100994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81c7c4-b014-4abe-902d-3196de9cdc5d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:55.146458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:55.201807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81c7c4-b014-4abe-902d-3196de9cdc5d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:55.247319 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a74e38-2a22-48fd-812e-59c290af116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:55.248506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a74e38-2a22-48fd-812e-59c290af116a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:55.248506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a74e38-2a22-48fd-812e-59c290af116a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:55.248681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a74e38-2a22-48fd-812e-59c290af116a None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:55.249530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a74e38-2a22-48fd-812e-59c290af116a None admin] RBAC: Adding query filter params (name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:55.249883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a74e38-2a22-48fd-812e-59c290af116a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:55.251586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a74e38-2a22-48fd-812e-59c290af116a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:55.261394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 619/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 05:24:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:55.267407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b7f94-9a0d-4d84-8078-a13f97e80a0e None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:55.356876 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:55.374425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b7f94-9a0d-4d84-8078-a13f97e80a0e None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:55.414870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b7997-ede5-43be-86c6-2bd96c7b56a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:55.415729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b7997-ede5-43be-86c6-2bd96c7b56a6 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:55.416047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b7997-ede5-43be-86c6-2bd96c7b56a6 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:55.416385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b7997-ede5-43be-86c6-2bd96c7b56a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:55.428166 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b7997-ede5-43be-86c6-2bd96c7b56a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:55.429674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b7997-ede5-43be-86c6-2bd96c7b56a6 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-d21b7997-ede5-43be-86c6-2bd96c7b56a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:24:55.446581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:55.447823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:24:55.448865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:24:55.448865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:55.448865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:24:55.448865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 618/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:55.453571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a74e38-2a22-48fd-812e-59c290af116a None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:55.567827 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a74e38-2a22-48fd-812e-59c290af116a None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:55.577628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:55.605972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c6d23-fd9d-4ee3-9fe8-d77f50f97ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:55.606611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c6d23-fd9d-4ee3-9fe8-d77f50f97ad6 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:55.606889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c6d23-fd9d-4ee3-9fe8-d77f50f97ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:55.607159 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c6d23-fd9d-4ee3-9fe8-d77f50f97ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:55.607797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c6d23-fd9d-4ee3-9fe8-d77f50f97ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:55.608113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c6d23-fd9d-4ee3-9fe8-d77f50f97ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:55.609469 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c6d23-fd9d-4ee3-9fe8-d77f50f97ad6 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:55.621507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 620/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:55.628585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b7997-ede5-43be-86c6-2bd96c7b56a6 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:55.729696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b7997-ede5-43be-86c6-2bd96c7b56a6 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:55.764315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599f48c-2e05-4689-b736-adfe34d9f44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:55.764930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599f48c-2e05-4689-b736-adfe34d9f44f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:55.765204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599f48c-2e05-4689-b736-adfe34d9f44f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:55.765469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599f48c-2e05-4689-b736-adfe34d9f44f None admin] PATH_INFO: `/v3/users/placement` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:55.768147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:55.773679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599f48c-2e05-4689-b736-adfe34d9f44f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:55.775418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599f48c-2e05-4689-b736-adfe34d9f44f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-4599f48c-2e05-4689-b736-adfe34d9f44f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:24:55.787230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:55.788299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:55.789288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:55.789288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:55.789288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:24:55.789288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:24:55.789288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:24:55.789288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:24:55.789288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:24:55.789288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:24:55.789288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 05:24:55.789288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:24:55.789288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 619/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:24:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:55.794283 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c6d23-fd9d-4ee3-9fe8-d77f50f97ad6 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:55.896944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c6d23-fd9d-4ee3-9fe8-d77f50f97ad6 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:55.940368 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470da17-b89f-424d-815d-e6d87f508a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:55.941103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470da17-b89f-424d-815d-e6d87f508a63 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:55.941449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470da17-b89f-424d-815d-e6d87f508a63 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:55.941888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470da17-b89f-424d-815d-e6d87f508a63 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:55.942939 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470da17-b89f-424d-815d-e6d87f508a63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:55.943309 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470da17-b89f-424d-815d-e6d87f508a63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:55.945852 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470da17-b89f-424d-815d-e6d87f508a63 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:55.967594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 621/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 16 05:24:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:55.973689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599f48c-2e05-4689-b736-adfe34d9f44f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:56.089999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599f48c-2e05-4689-b736-adfe34d9f44f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:56.124967 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262a79e-014e-4e79-bd00-910814bfb353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:56.125643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262a79e-014e-4e79-bd00-910814bfb353 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:56.126048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262a79e-014e-4e79-bd00-910814bfb353 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:56.126327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262a79e-014e-4e79-bd00-910814bfb353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:56.196478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:56.203908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262a79e-014e-4e79-bd00-910814bfb353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:56.205362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262a79e-014e-4e79-bd00-910814bfb353 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:56.316820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 620/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:24:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:24:56.324118 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470da17-b89f-424d-815d-e6d87f508a63 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:56.356780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:56.441757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470da17-b89f-424d-815d-e6d87f508a63 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:56.476067 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ed420-01a2-4f79-a1c8-e00c3740e21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:56.476686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ed420-01a2-4f79-a1c8-e00c3740e21d None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:56.476958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ed420-01a2-4f79-a1c8-e00c3740e21d None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:56.477236 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ed420-01a2-4f79-a1c8-e00c3740e21d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:56.487086 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ed420-01a2-4f79-a1c8-e00c3740e21d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:56.488538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ed420-01a2-4f79-a1c8-e00c3740e21d None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-f19ed420-01a2-4f79-a1c8-e00c3740e21d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:24:56.503869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:56.505113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:24:56.506179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:24:56.506179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:24:56.506179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:24:56.506179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 622/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:56.513376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262a79e-014e-4e79-bd00-910814bfb353 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:56.614645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:56.620648 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262a79e-014e-4e79-bd00-910814bfb353 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:56.655006 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3eb6e-942c-41a6-8658-28969f0b51ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:56.655690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3eb6e-942c-41a6-8658-28969f0b51ea None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:56.655864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3eb6e-942c-41a6-8658-28969f0b51ea None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:56.656134 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3eb6e-942c-41a6-8658-28969f0b51ea None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:56.656771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3eb6e-942c-41a6-8658-28969f0b51ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:56.657067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3eb6e-942c-41a6-8658-28969f0b51ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:56.658428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3eb6e-942c-41a6-8658-28969f0b51ea None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:56.671393 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 621/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:56.678150 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ed420-01a2-4f79-a1c8-e00c3740e21d None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:56.772770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:56.795738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ed420-01a2-4f79-a1c8-e00c3740e21d None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:56.833695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a080af-605e-44bf-9178-fc5428c635e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:56.834319 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a080af-605e-44bf-9178-fc5428c635e3 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:56.834647 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a080af-605e-44bf-9178-fc5428c635e3 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:56.835491 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a080af-605e-44bf-9178-fc5428c635e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:56.843260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a080af-605e-44bf-9178-fc5428c635e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:56.844712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a080af-605e-44bf-9178-fc5428c635e3 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-e1a080af-605e-44bf-9178-fc5428c635e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:24:56.856193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:24:56.857292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:24:56.858608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:24:56.858608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:24:56.858608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:24:56.858608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:24:56.858608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:24:56.858608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:24:56.858608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:24:56.858608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:24:56.858608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 623/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:24:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:24:56.863316 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3eb6e-942c-41a6-8658-28969f0b51ea None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:56.972333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3eb6e-942c-41a6-8658-28969f0b51ea None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:57.007284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d367d-e3c5-4146-a5a7-09287284375c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:57.007907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d367d-e3c5-4146-a5a7-09287284375c None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:57.008164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d367d-e3c5-4146-a5a7-09287284375c None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:57.008429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d367d-e3c5-4146-a5a7-09287284375c None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:57.009112 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d367d-e3c5-4146-a5a7-09287284375c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:57.009414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d367d-e3c5-4146-a5a7-09287284375c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:57.010878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d367d-e3c5-4146-a5a7-09287284375c None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:57.023987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 622/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:24:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:57.029757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a080af-605e-44bf-9178-fc5428c635e3 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:57.135173 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a080af-605e-44bf-9178-fc5428c635e3 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:24:57.171747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196849b-0db2-46a8-a078-e0fe9bd46f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:24:57.172439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196849b-0db2-46a8-a078-e0fe9bd46f40 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:57.172717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196849b-0db2-46a8-a078-e0fe9bd46f40 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:57.172990 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196849b-0db2-46a8-a078-e0fe9bd46f40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:57.173774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196849b-0db2-46a8-a078-e0fe9bd46f40 None admin] RBAC: Adding query filter params (role.id=bed020f3301c4f169f2a6d5795cd26f0, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=8ef60b27f5f545aa8ea063009ec66eb4) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:24:57.174096 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196849b-0db2-46a8-a078-e0fe9bd46f40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:24:57.175589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196849b-0db2-46a8-a078-e0fe9bd46f40 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:24:57.198537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 624/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:24:57 2022] GET /identity/v3/role_assignments?user.id=8ef60b27f5f545aa8ea063009ec66eb4&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=bed020f3301c4f169f2a6d5795cd26f0 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:24:59.482891 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff183d-d871-417b-b6a5-725f27dc2d44 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:59.483549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff183d-d871-417b-b6a5-725f27dc2d44 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:59.483549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff183d-d871-417b-b6a5-725f27dc2d44 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:59.484745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 623/1247] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:24:59.489930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac9230-2d64-4879-98b5-cc4e5dabbb68 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:24:59.490409 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac9230-2d64-4879-98b5-cc4e5dabbb68 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:24:59.490539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac9230-2d64-4879-98b5-cc4e5dabbb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:24:59.497539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:59.511384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-36ac9230-2d64-4879-98b5-cc4e5dabbb68 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:24:59.512591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-36ac9230-2d64-4879-98b5-cc4e5dabbb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:24:59.582134 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 625/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:24:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:24:59.849567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff183d-d871-417b-b6a5-725f27dc2d44 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:24:59.868470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:24:59.961784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff183d-d871-417b-b6a5-725f27dc2d44 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:00.001563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4d831-e644-463f-9367-d16709ee7880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:00.002204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d831-e644-463f-9367-d16709ee7880 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:00.002486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d831-e644-463f-9367-d16709ee7880 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:00.002791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d831-e644-463f-9367-d16709ee7880 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:00.012824 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4d831-e644-463f-9367-d16709ee7880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-1bb4d831-e644-463f-9367-d16709ee7880 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:25:00.019021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:00.020349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:00.021421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:00.021421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:00.021421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:00.021421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:00.021421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:25:00.021421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:25:00.021421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:25:00.021421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:25:00.021421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:25:00.021421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:25:00.021421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:25:00.021421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:25:00.021421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 624/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:24:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:00.027670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac9230-2d64-4879-98b5-cc4e5dabbb68 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:00.136472 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac9230-2d64-4879-98b5-cc4e5dabbb68 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:00.167814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:00.173501 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7a829-d564-42dd-aa69-b3d57d7e55cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:00.174184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a829-d564-42dd-aa69-b3d57d7e55cc None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:00.174567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a829-d564-42dd-aa69-b3d57d7e55cc None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:00.174893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a829-d564-42dd-aa69-b3d57d7e55cc None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:00.175622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7a829-d564-42dd-aa69-b3d57d7e55cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:00.175965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7a829-d564-42dd-aa69-b3d57d7e55cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:00.177456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7a829-d564-42dd-aa69-b3d57d7e55cc None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:00.187550 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 626/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:25:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:25:00.193689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4d831-e644-463f-9367-d16709ee7880 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:00.280658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:00.304688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4d831-e644-463f-9367-d16709ee7880 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:00.344042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ce47b-8ddc-43e0-ab9c-6a822b3d0fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:00.344775 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ce47b-8ddc-43e0-ab9c-6a822b3d0fa0 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:00.345066 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ce47b-8ddc-43e0-ab9c-6a822b3d0fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:00.345338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ce47b-8ddc-43e0-ab9c-6a822b3d0fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:00.357527 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ce47b-8ddc-43e0-ab9c-6a822b3d0fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:00.359211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ce47b-8ddc-43e0-ab9c-6a822b3d0fa0 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-217ce47b-8ddc-43e0-ab9c-6a822b3d0fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:25:00.374161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:00.375809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:25:00.377056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:25:00.377056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:25:00.377056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:25:00.377056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 625/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:00.381082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7a829-d564-42dd-aa69-b3d57d7e55cc None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:00.493113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7a829-d564-42dd-aa69-b3d57d7e55cc None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:00.529221 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8227f-c4c1-4c30-bd13-83dfc3acf09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:00.529833 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8227f-c4c1-4c30-bd13-83dfc3acf09e None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:00.530106 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8227f-c4c1-4c30-bd13-83dfc3acf09e None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:00.530370 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8227f-c4c1-4c30-bd13-83dfc3acf09e None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:00.531044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8227f-c4c1-4c30-bd13-83dfc3acf09e None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:00.531340 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8227f-c4c1-4c30-bd13-83dfc3acf09e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:00.532755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8227f-c4c1-4c30-bd13-83dfc3acf09e None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:00.546646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 627/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:00.552519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ce47b-8ddc-43e0-ab9c-6a822b3d0fa0 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:00.658728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ce47b-8ddc-43e0-ab9c-6a822b3d0fa0 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:00.698191 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:00.706754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe0b9d-514c-4988-914c-17e51a33c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:00.707398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe0b9d-514c-4988-914c-17e51a33c218 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:00.707671 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe0b9d-514c-4988-914c-17e51a33c218 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:00.707935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe0b9d-514c-4988-914c-17e51a33c218 None admin] PATH_INFO: `/v3/users/placement` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:00.717193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe0b9d-514c-4988-914c-17e51a33c218 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:00.718679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe0b9d-514c-4988-914c-17e51a33c218 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-cdfe0b9d-514c-4988-914c-17e51a33c218 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:25:00.730533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:00.731698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:00.733174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:00.733174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:00.733174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:25:00.733174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:25:00.733174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:25:00.733174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:25:00.733174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:25:00.733174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:25:00.733174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 05:25:00.733174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:25:00.733174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 626/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:25:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:00.737532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8227f-c4c1-4c30-bd13-83dfc3acf09e None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:00.803492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:00.851303 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8227f-c4c1-4c30-bd13-83dfc3acf09e None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:00.886209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f6bf2-facb-4857-b749-646b15920020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:00.886854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f6bf2-facb-4857-b749-646b15920020 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:00.887131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f6bf2-facb-4857-b749-646b15920020 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:00.887398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f6bf2-facb-4857-b749-646b15920020 None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:00.888137 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f6bf2-facb-4857-b749-646b15920020 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:00.888441 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f6bf2-facb-4857-b749-646b15920020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:00.889902 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f6bf2-facb-4857-b749-646b15920020 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:00.909603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 628/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 16 05:25:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:00.915443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe0b9d-514c-4988-914c-17e51a33c218 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:01.033614 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe0b9d-514c-4988-914c-17e51a33c218 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:01.068095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f54eb-32c8-43e3-87ec-169299a025e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:01.068627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f54eb-32c8-43e3-87ec-169299a025e7 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:01.069561 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f54eb-32c8-43e3-87ec-169299a025e7 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:01.069839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f54eb-32c8-43e3-87ec-169299a025e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:01.125355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:01.139285 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f54eb-32c8-43e3-87ec-169299a025e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:01.140717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f54eb-32c8-43e3-87ec-169299a025e7 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:01.236324 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 627/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:25:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:25:01.242558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f6bf2-facb-4857-b749-646b15920020 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:01.342009 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f6bf2-facb-4857-b749-646b15920020 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:01.355033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:01.375896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab140a-94a0-4991-84f3-0d500042fa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:01.376514 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab140a-94a0-4991-84f3-0d500042fa3c None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:01.376792 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab140a-94a0-4991-84f3-0d500042fa3c None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:01.377061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab140a-94a0-4991-84f3-0d500042fa3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:01.386748 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab140a-94a0-4991-84f3-0d500042fa3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:01.388189 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab140a-94a0-4991-84f3-0d500042fa3c None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-e5ab140a-94a0-4991-84f3-0d500042fa3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:25:01.402242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:01.403341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:25:01.404402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:25:01.404402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:25:01.404402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:01.404402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 629/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:01.409023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f54eb-32c8-43e3-87ec-169299a025e7 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:01.493268 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:01.504687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f54eb-32c8-43e3-87ec-169299a025e7 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:01.536900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405b887-09aa-49ae-b99c-53caa9fd4aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:01.537987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405b887-09aa-49ae-b99c-53caa9fd4aad None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:01.538263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405b887-09aa-49ae-b99c-53caa9fd4aad None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:01.538546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405b887-09aa-49ae-b99c-53caa9fd4aad None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:01.539170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405b887-09aa-49ae-b99c-53caa9fd4aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:01.539463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405b887-09aa-49ae-b99c-53caa9fd4aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:01.540810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405b887-09aa-49ae-b99c-53caa9fd4aad None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:01.551423 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 628/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:01.558355 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab140a-94a0-4991-84f3-0d500042fa3c None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:01.654218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab140a-94a0-4991-84f3-0d500042fa3c None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:01.687473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5fe61-bfe3-48bb-b4d4-00f1feb81c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:01.688075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5fe61-bfe3-48bb-b4d4-00f1feb81c12 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:01.688352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5fe61-bfe3-48bb-b4d4-00f1feb81c12 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:01.688617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5fe61-bfe3-48bb-b4d4-00f1feb81c12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:01.694989 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5fe61-bfe3-48bb-b4d4-00f1feb81c12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:01.696417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5fe61-bfe3-48bb-b4d4-00f1feb81c12 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-ddb5fe61-bfe3-48bb-b4d4-00f1feb81c12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:25:01.707224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:01.708250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:01.709175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:25:01.709175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:25:01.709175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:25:01.709175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:25:01.709175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:25:01.709175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:25:01.709175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:25:01.709175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:01.709175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 630/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:25:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:01.714674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405b887-09aa-49ae-b99c-53caa9fd4aad None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:01.810496 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405b887-09aa-49ae-b99c-53caa9fd4aad None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:01.842461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2a89f-8ec0-4647-9f58-2650c3a722bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:01.843069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2a89f-8ec0-4647-9f58-2650c3a722bc None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:01.843343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2a89f-8ec0-4647-9f58-2650c3a722bc None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:01.843608 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2a89f-8ec0-4647-9f58-2650c3a722bc None admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:01.844281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2a89f-8ec0-4647-9f58-2650c3a722bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:01.844576 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2a89f-8ec0-4647-9f58-2650c3a722bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:01.846001 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2a89f-8ec0-4647-9f58-2650c3a722bc None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:01.857879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 629/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:25:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:01.863943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5fe61-bfe3-48bb-b4d4-00f1feb81c12 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:01.889279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:01.966880 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5fe61-bfe3-48bb-b4d4-00f1feb81c12 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:01.999157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f31c4b-659d-4b75-8dd0-31826877ba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:01.999746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f31c4b-659d-4b75-8dd0-31826877ba98 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:02.000023 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f31c4b-659d-4b75-8dd0-31826877ba98 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:02.000293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f31c4b-659d-4b75-8dd0-31826877ba98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:02.001008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f31c4b-659d-4b75-8dd0-31826877ba98 None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=8ef60b27f5f545aa8ea063009ec66eb4) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:02.001311 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f31c4b-659d-4b75-8dd0-31826877ba98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:02.002769 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f31c4b-659d-4b75-8dd0-31826877ba98 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:02.007931 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 631/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:25:01 2022] GET /identity/v3/role_assignments?user.id=8ef60b27f5f545aa8ea063009ec66eb4&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:04.187612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c728718-6650-43b0-a9eb-fed17a78fb64 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:04.188165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c728718-6650-43b0-a9eb-fed17a78fb64 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:04.188165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c728718-6650-43b0-a9eb-fed17a78fb64 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:04.189487 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 630/1261] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:25:04.194484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbc9cf-f79a-4a4b-96c9-9aacc2f7d96d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:04.194917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbc9cf-f79a-4a4b-96c9-9aacc2f7d96d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:04.195058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbc9cf-f79a-4a4b-96c9-9aacc2f7d96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:04.213191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-7adbc9cf-f79a-4a4b-96c9-9aacc2f7d96d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:25:04.214369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-7adbc9cf-f79a-4a4b-96c9-9aacc2f7d96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:25:04.279083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 632/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:25:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:25:04.561488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c728718-6650-43b0-a9eb-fed17a78fb64 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:04.572792 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:04.661018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c728718-6650-43b0-a9eb-fed17a78fb64 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:04.694373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2290-697a-40f4-98b0-b9ffe114c325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:04.695009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2290-697a-40f4-98b0-b9ffe114c325 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:04.695286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2290-697a-40f4-98b0-b9ffe114c325 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:04.695553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2290-697a-40f4-98b0-b9ffe114c325 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:04.705218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e2290-697a-40f4-98b0-b9ffe114c325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-127e2290-697a-40f4-98b0-b9ffe114c325 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:25:04.710034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:04.711136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:04.712025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:04.712025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:04.712025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:04.712025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:04.712025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:25:04.712025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:25:04.712025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:25:04.712025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:25:04.712025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:25:04.712025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:25:04.712025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:25:04.712025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:25:04.712025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 631/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:25:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:04.717042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbc9cf-f79a-4a4b-96c9-9aacc2f7d96d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:04.735209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:04.817775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbc9cf-f79a-4a4b-96c9-9aacc2f7d96d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:04.850360 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de42779-7fad-4464-b37e-436b37f527e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:04.850981 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de42779-7fad-4464-b37e-436b37f527e5 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:04.851257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de42779-7fad-4464-b37e-436b37f527e5 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:04.851524 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de42779-7fad-4464-b37e-436b37f527e5 None admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:04.852165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de42779-7fad-4464-b37e-436b37f527e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:04.852459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de42779-7fad-4464-b37e-436b37f527e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:04.853828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de42779-7fad-4464-b37e-436b37f527e5 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:04.861494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 633/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:25:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:04.867752 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2290-697a-40f4-98b0-b9ffe114c325 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:04.941428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:04.979525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2290-697a-40f4-98b0-b9ffe114c325 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:05.012972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7e113-9a00-4d60-9ec3-d6234ef13cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:05.013588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7e113-9a00-4d60-9ec3-d6234ef13cf4 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:05.013860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7e113-9a00-4d60-9ec3-d6234ef13cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:05.014122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7e113-9a00-4d60-9ec3-d6234ef13cf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:05.023709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7e113-9a00-4d60-9ec3-d6234ef13cf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:05.025140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7e113-9a00-4d60-9ec3-d6234ef13cf4 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-8ea7e113-9a00-4d60-9ec3-d6234ef13cf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:25:05.039136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:05.040252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:25:05.041513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:25:05.041513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:25:05.041513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:25:05.041513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 632/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:05.047269 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de42779-7fad-4464-b37e-436b37f527e5 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:05.130435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:05.148954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de42779-7fad-4464-b37e-436b37f527e5 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:05.181295 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0705fc-330a-45db-ae2d-b6003c0b0658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:05.181881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0705fc-330a-45db-ae2d-b6003c0b0658 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:05.182155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0705fc-330a-45db-ae2d-b6003c0b0658 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:05.182712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0705fc-330a-45db-ae2d-b6003c0b0658 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:05.183338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0705fc-330a-45db-ae2d-b6003c0b0658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:05.183635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0705fc-330a-45db-ae2d-b6003c0b0658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:05.184992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0705fc-330a-45db-ae2d-b6003c0b0658 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:05.196178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 634/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:05.201825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7e113-9a00-4d60-9ec3-d6234ef13cf4 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:05.299556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7e113-9a00-4d60-9ec3-d6234ef13cf4 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:05.318975 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:05.332643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fecd3-92d1-4f65-9217-fcba1c72fb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:05.333257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fecd3-92d1-4f65-9217-fcba1c72fb5d None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:05.333536 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fecd3-92d1-4f65-9217-fcba1c72fb5d None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:05.333807 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fecd3-92d1-4f65-9217-fcba1c72fb5d None admin] PATH_INFO: `/v3/users/placement` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:05.341957 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fecd3-92d1-4f65-9217-fcba1c72fb5d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:05.343519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fecd3-92d1-4f65-9217-fcba1c72fb5d None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-e77fecd3-92d1-4f65-9217-fcba1c72fb5d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:25:05.355866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:05.356898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:05.357948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:05.357948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:05.357948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:25:05.357948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:25:05.357948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:25:05.357948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:25:05.357948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:25:05.357948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:25:05.357948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 05:25:05.357948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:25:05.357948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 633/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:25:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:05.362813 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0705fc-330a-45db-ae2d-b6003c0b0658 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:05.458861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0705fc-330a-45db-ae2d-b6003c0b0658 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:05.491636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27908887-b344-43fb-b6dc-cbe57ade10de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:05.492216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27908887-b344-43fb-b6dc-cbe57ade10de None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:05.492490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27908887-b344-43fb-b6dc-cbe57ade10de None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:05.492756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27908887-b344-43fb-b6dc-cbe57ade10de None admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:05.493464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27908887-b344-43fb-b6dc-cbe57ade10de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:05.493765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27908887-b344-43fb-b6dc-cbe57ade10de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:05.495219 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27908887-b344-43fb-b6dc-cbe57ade10de None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:05.503398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:05.511727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 635/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 16 05:25:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:05.517456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fecd3-92d1-4f65-9217-fcba1c72fb5d None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:05.613594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fecd3-92d1-4f65-9217-fcba1c72fb5d None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:05.645086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0f46f-20f5-4a49-ab7b-eaf98b869f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:05.645681 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0f46f-20f5-4a49-ab7b-eaf98b869f8a None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:05.645953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0f46f-20f5-4a49-ab7b-eaf98b869f8a None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:05.646218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0f46f-20f5-4a49-ab7b-eaf98b869f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:05.656761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0f46f-20f5-4a49-ab7b-eaf98b869f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:05.658175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0f46f-20f5-4a49-ab7b-eaf98b869f8a None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-51d0f46f-20f5-4a49-ab7b-eaf98b869f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:25:05.672320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:05.673419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:25:05.674312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:25:05.674312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:25:05.674312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:25:05.674312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 634/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:05.678951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27908887-b344-43fb-b6dc-cbe57ade10de None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:05.776401 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27908887-b344-43fb-b6dc-cbe57ade10de None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:05.809046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbd1fa-1313-435d-a526-5cd5b36c8ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:05.809637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbd1fa-1313-435d-a526-5cd5b36c8ed6 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:05.809910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbd1fa-1313-435d-a526-5cd5b36c8ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:05.810173 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbd1fa-1313-435d-a526-5cd5b36c8ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:05.810832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbd1fa-1313-435d-a526-5cd5b36c8ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:05.811126 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbd1fa-1313-435d-a526-5cd5b36c8ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:05.812483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbd1fa-1313-435d-a526-5cd5b36c8ed6 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:05.823603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 636/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:05.829116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0f46f-20f5-4a49-ab7b-eaf98b869f8a None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:05.861304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:05.938847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0f46f-20f5-4a49-ab7b-eaf98b869f8a None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:05.974672 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac0c4e-b59e-49ae-9bb8-7bb9ced7a5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:05.975345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac0c4e-b59e-49ae-9bb8-7bb9ced7a5ed None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:05.975619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac0c4e-b59e-49ae-9bb8-7bb9ced7a5ed None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:05.975884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac0c4e-b59e-49ae-9bb8-7bb9ced7a5ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:05.982461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac0c4e-b59e-49ae-9bb8-7bb9ced7a5ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:05.983956 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac0c4e-b59e-49ae-9bb8-7bb9ced7a5ed None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-68ac0c4e-b59e-49ae-9bb8-7bb9ced7a5ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:25:05.995055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:05.995924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:05.996820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:25:05.996820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:25:05.996820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:25:05.996820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:25:05.996820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:25:05.996820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:25:05.996820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:25:05.996820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:25:05.996820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 635/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:06.003376 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbd1fa-1313-435d-a526-5cd5b36c8ed6 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:06.064855 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:06.107030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbd1fa-1313-435d-a526-5cd5b36c8ed6 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:06.140071 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db99f7e-4248-474f-b5cc-2895fee7ce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:06.140673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db99f7e-4248-474f-b5cc-2895fee7ce5a None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:06.140946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db99f7e-4248-474f-b5cc-2895fee7ce5a None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:06.141213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db99f7e-4248-474f-b5cc-2895fee7ce5a None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:06.141893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db99f7e-4248-474f-b5cc-2895fee7ce5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:06.142195 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db99f7e-4248-474f-b5cc-2895fee7ce5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:06.143695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db99f7e-4248-474f-b5cc-2895fee7ce5a None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:06.156030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 637/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:25:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:06.162050 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac0c4e-b59e-49ae-9bb8-7bb9ced7a5ed None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:06.251839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:06.261418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac0c4e-b59e-49ae-9bb8-7bb9ced7a5ed None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:06.293263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d6a71-08e8-4dfd-8ab0-be6d635d4262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:06.293911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6a71-08e8-4dfd-8ab0-be6d635d4262 None admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:06.294186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6a71-08e8-4dfd-8ab0-be6d635d4262 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:06.294454 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6a71-08e8-4dfd-8ab0-be6d635d4262 None admin] PATH_INFO: `/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/8ef60b27f5f545aa8ea063009ec66eb4/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:06.296347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6a71-08e8-4dfd-8ab0-be6d635d4262 None admin] RBAC: Authorizing `identity:create_grant(project_id=74c9d19fb1534f8f8888e957d1007640, user_id=8ef60b27f5f545aa8ea063009ec66eb4, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:06.297774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6a71-08e8-4dfd-8ab0-be6d635d4262 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:06.310567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 636/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 05:25:06 2022] PUT /identity/v3/projects/74c9d19fb1534f8f8888e957d1007640/users/8ef60b27f5f545aa8ea063009ec66eb4/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:25:08.432194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d2cfa-4bbf-48db-8010-cb737f400502 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:08.432994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d2cfa-4bbf-48db-8010-cb737f400502 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:08.432994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d2cfa-4bbf-48db-8010-cb737f400502 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:08.434318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 638/1274] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:25:08.439406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d501d18-6a9c-41cb-b72c-1c24587a7086 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:08.439770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d501d18-6a9c-41cb-b72c-1c24587a7086 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:08.439953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d501d18-6a9c-41cb-b72c-1c24587a7086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:08.457704 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-7d501d18-6a9c-41cb-b72c-1c24587a7086 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:25:08.458944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7d501d18-6a9c-41cb-b72c-1c24587a7086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:25:08.523670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 637/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:25:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:25:08.790042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d2cfa-4bbf-48db-8010-cb737f400502 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:08.888648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d2cfa-4bbf-48db-8010-cb737f400502 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:08.909540 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:08.928491 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc98f9-608f-4976-920a-d3b44556a750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:08.929114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc98f9-608f-4976-920a-d3b44556a750 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:08.929456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc98f9-608f-4976-920a-d3b44556a750 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:08.929648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc98f9-608f-4976-920a-d3b44556a750 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:08.940243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc98f9-608f-4976-920a-d3b44556a750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-47bc98f9-608f-4976-920a-d3b44556a750 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 05:25:08.945448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:08.946896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:08.948052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:08.948052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:08.948052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:08.948052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:08.948052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 05:25:08.948052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 05:25:08.948052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 05:25:08.948052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 05:25:08.948052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 05:25:08.948052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 05:25:08.948052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 05:25:08.948052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:08.948052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 639/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 05:25:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:08.953310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d501d18-6a9c-41cb-b72c-1c24587a7086 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:09.035743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:09.053812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d501d18-6a9c-41cb-b72c-1c24587a7086 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:09.087842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec4cf-e0fd-4f6b-9ea2-71167ec7634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:09.088434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec4cf-e0fd-4f6b-9ea2-71167ec7634b None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:09.088712 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec4cf-e0fd-4f6b-9ea2-71167ec7634b None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:09.088982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec4cf-e0fd-4f6b-9ea2-71167ec7634b None admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:09.089632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ec4cf-e0fd-4f6b-9ea2-71167ec7634b None admin] RBAC: Adding query filter params (name=admin) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:09.089931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ec4cf-e0fd-4f6b-9ea2-71167ec7634b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:09.091318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ec4cf-e0fd-4f6b-9ea2-71167ec7634b None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:09.098998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 638/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 05:25:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:09.104791 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc98f9-608f-4976-920a-d3b44556a750 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:09.200975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc98f9-608f-4976-920a-d3b44556a750 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:09.232564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a82bcf-c251-4c4c-aff7-e6eca615a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:09.233170 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82bcf-c251-4c4c-aff7-e6eca615a7d4 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:09.233443 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82bcf-c251-4c4c-aff7-e6eca615a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:09.233706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82bcf-c251-4c4c-aff7-e6eca615a7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:09.244006 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a82bcf-c251-4c4c-aff7-e6eca615a7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:09.245440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a82bcf-c251-4c4c-aff7-e6eca615a7d4 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-f6a82bcf-c251-4c4c-aff7-e6eca615a7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:25:09.260083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:09.261204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:25:09.262419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:25:09.262419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:25:09.262419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:09.262419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 640/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:09.266831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec4cf-e0fd-4f6b-9ea2-71167ec7634b None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:09.362780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec4cf-e0fd-4f6b-9ea2-71167ec7634b None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:09.395439 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff1a35-d2fb-4277-8f1f-b6b965b6682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:09.396029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff1a35-d2fb-4277-8f1f-b6b965b6682e None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:09.396307 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff1a35-d2fb-4277-8f1f-b6b965b6682e None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:09.396576 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff1a35-d2fb-4277-8f1f-b6b965b6682e None admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:09.397229 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff1a35-d2fb-4277-8f1f-b6b965b6682e None admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:09.397526 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff1a35-d2fb-4277-8f1f-b6b965b6682e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:09.398913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff1a35-d2fb-4277-8f1f-b6b965b6682e None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:09.410286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 639/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:09.415726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a82bcf-c251-4c4c-aff7-e6eca615a7d4 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:09.446359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:09.513272 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a82bcf-c251-4c4c-aff7-e6eca615a7d4 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:09.544677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08b70b-b940-4071-b9ca-5f43bb7340d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:09.545280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08b70b-b940-4071-b9ca-5f43bb7340d2 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:09.545553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08b70b-b940-4071-b9ca-5f43bb7340d2 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:09.545817 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08b70b-b940-4071-b9ca-5f43bb7340d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:09.552857 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08b70b-b940-4071-b9ca-5f43bb7340d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:09.554819 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08b70b-b940-4071-b9ca-5f43bb7340d2 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-4d08b70b-b940-4071-b9ca-5f43bb7340d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 05:25:09.565787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:09.570475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:09.571707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:09.571707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:09.571707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 05:25:09.571707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 05:25:09.571707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 05:25:09.571707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 05:25:09.571707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 05:25:09.571707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 05:25:09.571707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 05:25:09.571707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:09.571707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 641/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:25:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:09.573083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff1a35-d2fb-4277-8f1f-b6b965b6682e None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:09.576760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:09.669052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff1a35-d2fb-4277-8f1f-b6b965b6682e None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:09.701813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14428eb-5b98-4bf4-b39a-dcd82e95483f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:09.702392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14428eb-5b98-4bf4-b39a-dcd82e95483f None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:09.702701 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14428eb-5b98-4bf4-b39a-dcd82e95483f None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:09.702970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14428eb-5b98-4bf4-b39a-dcd82e95483f None admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:09.703676 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14428eb-5b98-4bf4-b39a-dcd82e95483f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:09.703976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14428eb-5b98-4bf4-b39a-dcd82e95483f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:09.705392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14428eb-5b98-4bf4-b39a-dcd82e95483f None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:09.721543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 640/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 16 05:25:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:09.727658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08b70b-b940-4071-b9ca-5f43bb7340d2 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:09.814027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:09.823816 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08b70b-b940-4071-b9ca-5f43bb7340d2 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:09.855472 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab269c76-4df2-443d-a00d-2abf6de041bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:09.856050 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab269c76-4df2-443d-a00d-2abf6de041bd None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:09.856323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab269c76-4df2-443d-a00d-2abf6de041bd None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:09.856590 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab269c76-4df2-443d-a00d-2abf6de041bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:09.922938 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab269c76-4df2-443d-a00d-2abf6de041bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:09.924307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab269c76-4df2-443d-a00d-2abf6de041bd None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:10.007890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:10.017994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 642/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 05:25:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 05:25:10.024263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14428eb-5b98-4bf4-b39a-dcd82e95483f None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:10.087863 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:10.124818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14428eb-5b98-4bf4-b39a-dcd82e95483f None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:10.157439 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ed16c-b6f8-4e67-a082-a4f12fc333b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:10.158052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ed16c-b6f8-4e67-a082-a4f12fc333b7 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:10.158325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ed16c-b6f8-4e67-a082-a4f12fc333b7 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:10.158625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ed16c-b6f8-4e67-a082-a4f12fc333b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:10.168848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ed16c-b6f8-4e67-a082-a4f12fc333b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:10.170289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ed16c-b6f8-4e67-a082-a4f12fc333b7 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-711ed16c-b6f8-4e67-a082-a4f12fc333b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 05:25:10.184759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:10.185866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 05:25:10.187015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 05:25:10.187015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 05:25:10.187015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:25:10.187015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 641/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:10.191461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab269c76-4df2-443d-a00d-2abf6de041bd None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:10.286143 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab269c76-4df2-443d-a00d-2abf6de041bd None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:10.319814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa008326-e606-4a88-82c5-80ffa4254f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:10.320404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa008326-e606-4a88-82c5-80ffa4254f92 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:10.320682 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa008326-e606-4a88-82c5-80ffa4254f92 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:10.320952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa008326-e606-4a88-82c5-80ffa4254f92 None admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:10.321579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa008326-e606-4a88-82c5-80ffa4254f92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:10.321879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa008326-e606-4a88-82c5-80ffa4254f92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:10.323277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa008326-e606-4a88-82c5-80ffa4254f92 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:10.333981 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 643/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 05:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:10.340164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ed16c-b6f8-4e67-a082-a4f12fc333b7 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:10.436504 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ed16c-b6f8-4e67-a082-a4f12fc333b7 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:10.449906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:10.469974 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9ad5e-feaf-488c-aa60-8d3a7d811988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:10.470616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ad5e-feaf-488c-aa60-8d3a7d811988 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:10.470895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ad5e-feaf-488c-aa60-8d3a7d811988 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:10.471164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ad5e-feaf-488c-aa60-8d3a7d811988 None admin] PATH_INFO: `/v3/projects/service` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:10.477518 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9ad5e-feaf-488c-aa60-8d3a7d811988 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:10.478977 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9ad5e-feaf-488c-aa60-8d3a7d811988 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application [None req-35d9ad5e-feaf-488c-aa60-8d3a7d811988 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 05:25:10.490795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:10.491814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:10.492882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 05:25:10.492882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 05:25:10.492882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 05:25:10.492882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 05:25:10.492882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 05:25:10.492882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 05:25:10.492882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 05:25:10.492882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: ERROR keystone.server.flask.application Sep 16 05:25:10.492882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 642/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 05:25:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:10.497605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa008326-e606-4a88-82c5-80ffa4254f92 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:10.545565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:10.593741 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa008326-e606-4a88-82c5-80ffa4254f92 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:10.624793 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbacc29-a6bf-46b8-973c-650578fc5cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:10.625378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbacc29-a6bf-46b8-973c-650578fc5cd5 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:10.625651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbacc29-a6bf-46b8-973c-650578fc5cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:10.625919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbacc29-a6bf-46b8-973c-650578fc5cd5 None admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:10.626619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbacc29-a6bf-46b8-973c-650578fc5cd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:10.626920 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbacc29-a6bf-46b8-973c-650578fc5cd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:10.628345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbacc29-a6bf-46b8-973c-650578fc5cd5 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:10.640127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 644/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 05:25:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:10.645999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9ad5e-feaf-488c-aa60-8d3a7d811988 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:10.743063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9ad5e-feaf-488c-aa60-8d3a7d811988 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:10.775237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd79b5-5cf3-424f-8772-9a3a3fbc53df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:10.775815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd79b5-5cf3-424f-8772-9a3a3fbc53df None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:10.776096 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd79b5-5cf3-424f-8772-9a3a3fbc53df None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:10.776363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd79b5-5cf3-424f-8772-9a3a3fbc53df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:10.777068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd79b5-5cf3-424f-8772-9a3a3fbc53df None admin] RBAC: Adding query filter params (role.id=58e91278467047aaa25e6e7b7e1dc735, scope.project.id=74c9d19fb1534f8f8888e957d1007640, user.id=8ef60b27f5f545aa8ea063009ec66eb4) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:10.777369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd79b5-5cf3-424f-8772-9a3a3fbc53df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:10.778800 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd79b5-5cf3-424f-8772-9a3a3fbc53df None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:10.784318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 643/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 05:25:10 2022] GET /identity/v3/role_assignments?user.id=8ef60b27f5f545aa8ea063009ec66eb4&scope.project.id=74c9d19fb1534f8f8888e957d1007640&role.id=58e91278467047aaa25e6e7b7e1dc735 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:12.914043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d61372-a097-402e-b540-f0a4a121e8fd None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:12.914748 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d61372-a097-402e-b540-f0a4a121e8fd None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:12.914748 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d61372-a097-402e-b540-f0a4a121e8fd None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:12.915958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 645/1288] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:25:12.921688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54783ccf-8e99-4966-ac4a-27d84ee777ee None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:12.922142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54783ccf-8e99-4966-ac4a-27d84ee777ee None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:12.922579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54783ccf-8e99-4966-ac4a-27d84ee777ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:12.944525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-54783ccf-8e99-4966-ac4a-27d84ee777ee None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:25:12.945799 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-54783ccf-8e99-4966-ac4a-27d84ee777ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:25:12.980605 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:13.016620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 644/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:25:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:25:13.285484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d61372-a097-402e-b540-f0a4a121e8fd None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:13.383991 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d61372-a097-402e-b540-f0a4a121e8fd None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:13.394033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:13.416723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471a4fc-133c-47ab-ac70-a89286b09029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:13.417335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471a4fc-133c-47ab-ac70-a89286b09029 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:13.417610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471a4fc-133c-47ab-ac70-a89286b09029 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:13.417878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471a4fc-133c-47ab-ac70-a89286b09029 None admin] PATH_INFO: `/v3/services/placement` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:13.418451 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471a4fc-133c-47ab-ac70-a89286b09029 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:13.419846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471a4fc-133c-47ab-ac70-a89286b09029 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-7471a4fc-133c-47ab-ac70-a89286b09029 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:13.428410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:13.429605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:13.430477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 646/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 05:25:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:13.435758 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54783ccf-8e99-4966-ac4a-27d84ee777ee None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:13.531754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54783ccf-8e99-4966-ac4a-27d84ee777ee None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:13.563898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7474fa3-2139-4ebc-b3e2-b61d5e259a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:13.564492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7474fa3-2139-4ebc-b3e2-b61d5e259a56 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:13.564770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7474fa3-2139-4ebc-b3e2-b61d5e259a56 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:13.565036 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7474fa3-2139-4ebc-b3e2-b61d5e259a56 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:13.565651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7474fa3-2139-4ebc-b3e2-b61d5e259a56 None admin] RBAC: Adding query filter params (name=placement) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:13.565949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7474fa3-2139-4ebc-b3e2-b61d5e259a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:13.567329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7474fa3-2139-4ebc-b3e2-b61d5e259a56 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:13.572490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 645/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 16 05:25:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:13.578150 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471a4fc-133c-47ab-ac70-a89286b09029 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:13.675377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471a4fc-133c-47ab-ac70-a89286b09029 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:13.708555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5039b2-8dea-4317-9ff6-1d9fd1f88b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:13.709140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5039b2-8dea-4317-9ff6-1d9fd1f88b16 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:13.709420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5039b2-8dea-4317-9ff6-1d9fd1f88b16 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:13.709687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5039b2-8dea-4317-9ff6-1d9fd1f88b16 None admin] PATH_INFO: `/v3/services` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:13.710304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5039b2-8dea-4317-9ff6-1d9fd1f88b16 None admin] RBAC: Adding query filter params (type=placement) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:13.710634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5039b2-8dea-4317-9ff6-1d9fd1f88b16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:13.711999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5039b2-8dea-4317-9ff6-1d9fd1f88b16 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:13.716248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 647/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 16 05:25:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:15.825016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2acb0-1412-4f1b-8a5e-8e0fbf62691d None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:15.825591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2acb0-1412-4f1b-8a5e-8e0fbf62691d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:15.825591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2acb0-1412-4f1b-8a5e-8e0fbf62691d None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:15.826917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 646/1293] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:25:15.832290 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72300b67-022f-4938-b566-2898bd500007 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:15.832684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72300b67-022f-4938-b566-2898bd500007 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:15.832832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72300b67-022f-4938-b566-2898bd500007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:15.850473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-72300b67-022f-4938-b566-2898bd500007 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:25:15.852180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-72300b67-022f-4938-b566-2898bd500007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:25:15.880947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:15.920409 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 648/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:25:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:25:16.198094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2acb0-1412-4f1b-8a5e-8e0fbf62691d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:16.228989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:16.296627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2acb0-1412-4f1b-8a5e-8e0fbf62691d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:16.329159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac32e2-99ee-4575-9c55-8d48b88ae345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:16.329745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac32e2-99ee-4575-9c55-8d48b88ae345 None admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:16.330019 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac32e2-99ee-4575-9c55-8d48b88ae345 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:16.330287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac32e2-99ee-4575-9c55-8d48b88ae345 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:16.330964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac32e2-99ee-4575-9c55-8d48b88ae345 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:16.332314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac32e2-99ee-4575-9c55-8d48b88ae345 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:16.346580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 647/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 05:25:16 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:25:18.553504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304aee1c-d5b5-408f-ad2d-4cd166e71593 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:18.554031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304aee1c-d5b5-408f-ad2d-4cd166e71593 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:18.554031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304aee1c-d5b5-408f-ad2d-4cd166e71593 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:18.555900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 649/1296] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:25:18.561355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18855f6e-602a-4418-9437-e9fc52ccb529 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:18.561796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18855f6e-602a-4418-9437-e9fc52ccb529 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:18.561911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18855f6e-602a-4418-9437-e9fc52ccb529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:18.580623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-18855f6e-602a-4418-9437-e9fc52ccb529 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:25:18.581815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-18855f6e-602a-4418-9437-e9fc52ccb529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:25:18.652659 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 648/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:25:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:25:18.937670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304aee1c-d5b5-408f-ad2d-4cd166e71593 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:19.046754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304aee1c-d5b5-408f-ad2d-4cd166e71593 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:19.079109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632bd41-8682-456b-bded-9249a38f5b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:19.079720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632bd41-8682-456b-bded-9249a38f5b11 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:19.079997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632bd41-8682-456b-bded-9249a38f5b11 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:19.080270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632bd41-8682-456b-bded-9249a38f5b11 None admin] PATH_INFO: `/v3/services/placement` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:19.080840 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632bd41-8682-456b-bded-9249a38f5b11 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:19.082210 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632bd41-8682-456b-bded-9249a38f5b11 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-7632bd41-8682-456b-bded-9249a38f5b11 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:19.091276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:19.094675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:19.095788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 650/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 05:25:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:19.098568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18855f6e-602a-4418-9437-e9fc52ccb529 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:19.116886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:19.196337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18855f6e-602a-4418-9437-e9fc52ccb529 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:19.230025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ac4d5-fefa-45c7-9145-642211fa5ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:19.230650 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ac4d5-fefa-45c7-9145-642211fa5ac0 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:19.230922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ac4d5-fefa-45c7-9145-642211fa5ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:19.231186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ac4d5-fefa-45c7-9145-642211fa5ac0 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:19.231805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ac4d5-fefa-45c7-9145-642211fa5ac0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:19.232099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ac4d5-fefa-45c7-9145-642211fa5ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:19.233447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ac4d5-fefa-45c7-9145-642211fa5ac0 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:19.238617 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 649/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 16 05:25:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:19.244779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632bd41-8682-456b-bded-9249a38f5b11 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:19.275821 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:19.344201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632bd41-8682-456b-bded-9249a38f5b11 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:19.376187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c7de4-663f-46b5-9ee9-96649fc75c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:19.376779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c7de4-663f-46b5-9ee9-96649fc75c43 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:19.377062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c7de4-663f-46b5-9ee9-96649fc75c43 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:19.377333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c7de4-663f-46b5-9ee9-96649fc75c43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:19.378030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c7de4-663f-46b5-9ee9-96649fc75c43 None admin] RBAC: Adding query filter params (interface=public, service_id=d5058b28e9664fefbc22e69b211740ed, region_id=RegionOne) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:19.378337 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c7de4-663f-46b5-9ee9-96649fc75c43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:19.379810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c7de4-663f-46b5-9ee9-96649fc75c43 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:19.385161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 651/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 05:25:19 2022] GET /identity/v3/endpoints?service_id=d5058b28e9664fefbc22e69b211740ed&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:19.391390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ac4d5-fefa-45c7-9145-642211fa5ac0 None admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:19.471760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:19.490045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ac4d5-fefa-45c7-9145-642211fa5ac0 None admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:19.523894 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074e70e-9bfa-408c-8c14-34749e6e7843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:19.524483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074e70e-9bfa-408c-8c14-34749e6e7843 None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:19.524762 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074e70e-9bfa-408c-8c14-34749e6e7843 None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:19.525032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074e70e-9bfa-408c-8c14-34749e6e7843 None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:19.525631 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074e70e-9bfa-408c-8c14-34749e6e7843 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:19.527017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074e70e-9bfa-408c-8c14-34749e6e7843 None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:19.533850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 650/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 05:25:19 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:25:21.713223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3b585-7966-4362-9062-900a8d3337c8 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:21.713778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3b585-7966-4362-9062-900a8d3337c8 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:21.713778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3b585-7966-4362-9062-900a8d3337c8 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:21.715111 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 652/1302] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:25:21.720210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a4497-154c-444a-83f5-a3953b52b96f None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:21.720634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a4497-154c-444a-83f5-a3953b52b96f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:21.720734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a4497-154c-444a-83f5-a3953b52b96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:21.741595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-251a4497-154c-444a-83f5-a3953b52b96f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:25:21.743498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-251a4497-154c-444a-83f5-a3953b52b96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:25:21.814525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 651/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:25:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 05:25:22.079828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3b585-7966-4362-9062-900a8d3337c8 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:22.174781 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:22.183185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3b585-7966-4362-9062-900a8d3337c8 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:22.216746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9e2ae-de3b-4d9f-9bac-3f54948192b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:22.217359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9e2ae-de3b-4d9f-9bac-3f54948192b9 None admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:22.217634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9e2ae-de3b-4d9f-9bac-3f54948192b9 None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:22.217901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9e2ae-de3b-4d9f-9bac-3f54948192b9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:22.218470 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9e2ae-de3b-4d9f-9bac-3f54948192b9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:22.219857 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9e2ae-de3b-4d9f-9bac-3f54948192b9 None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application [None req-03e9e2ae-de3b-4d9f-9bac-3f54948192b9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 05:25:22.228381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 05:25:22.229571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application with Lock( Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self._enter() Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application return self.creator() Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application created_value = creator( Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: ERROR keystone.server.flask.application Sep 16 05:25:22.230423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 653/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 05:25:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 05:25:22.235578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a4497-154c-444a-83f5-a3953b52b96f None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:22.310582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:22.332765 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a4497-154c-444a-83f5-a3953b52b96f None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:22.364748 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adf8ed-1fc0-4bdd-bc48-8ea894130fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:22.365333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf8ed-1fc0-4bdd-bc48-8ea894130fba None admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:22.365604 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf8ed-1fc0-4bdd-bc48-8ea894130fba None admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:22.365873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf8ed-1fc0-4bdd-bc48-8ea894130fba None admin] PATH_INFO: `/v3/services` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:22.366483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adf8ed-1fc0-4bdd-bc48-8ea894130fba None admin] RBAC: Adding query filter params (name=placement) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:25:22.366878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adf8ed-1fc0-4bdd-bc48-8ea894130fba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:22.368710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adf8ed-1fc0-4bdd-bc48-8ea894130fba None admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:22.373589 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 652/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 16 05:25:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:25:22.379278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9e2ae-de3b-4d9f-9bac-3f54948192b9 None admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:25:22.480101 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9e2ae-de3b-4d9f-9bac-3f54948192b9 None admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:25:22.512341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088502cb-8ace-4b60-b6f7-3e8f3de3d6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:25:22.512927 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088502cb-8ace-4b60-b6f7-3e8f3de3d6ca None admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:25:22.513201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088502cb-8ace-4b60-b6f7-3e8f3de3d6ca None admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:25:22.513466 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088502cb-8ace-4b60-b6f7-3e8f3de3d6ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:25:22.514112 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088502cb-8ace-4b60-b6f7-3e8f3de3d6ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:25:22.515516 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088502cb-8ace-4b60-b6f7-3e8f3de3d6ca None admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:25:22.534120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 654/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:25:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:25:32.370711 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=30 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:25:32.530347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:26.033826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c0eb-60d8-4442-80ef-1e274fc277c5 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:26.034303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c0eb-60d8-4442-80ef-1e274fc277c5 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:26.034405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c0eb-60d8-4442-80ef-1e274fc277c5 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:26.040798 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765c18-4e19-482a-b1e5-c4a3e588dd23 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:26.041202 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765c18-4e19-482a-b1e5-c4a3e588dd23 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:26.041335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5765c18-4e19-482a-b1e5-c4a3e588dd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:26.046484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 653/1307] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:26:26 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:26:26.154964 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-d5765c18-4e19-482a-b1e5-c4a3e588dd23 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:26:26.157136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d5765c18-4e19-482a-b1e5-c4a3e588dd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:26.311377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 655/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:26:26.610234 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b06550-ad56-42f0-8a1c-21c568cb8485 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:26.610623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b06550-ad56-42f0-8a1c-21c568cb8485 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:26.611144 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b06550-ad56-42f0-8a1c-21c568cb8485 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:26.612563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 654/1309] 10.222.0.20 () {54 vars in 965 bytes} [Fri Sep 16 05:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:26:26.618650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633cf41-5ec8-43a3-b519-9b645ee9012b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:26.619042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633cf41-5ec8-43a3-b519-9b645ee9012b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:26.619355 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633cf41-5ec8-43a3-b519-9b645ee9012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:26.698316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-5633cf41-5ec8-43a3-b519-9b645ee9012b None None] MFA Rules not processed for user `d51f44d06b0f4303a753709bd1bcf3e5`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:26:26.700165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5633cf41-5ec8-43a3-b519-9b645ee9012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:26.722164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:26.785328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 656/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Sep 16 05:26:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:26:26.794830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b06550-ad56-42f0-8a1c-21c568cb8485 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:26:26.796622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e5b06550-ad56-42f0-8a1c-21c568cb8485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:26.925727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b06550-ad56-42f0-8a1c-21c568cb8485 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:26:27.007850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec5522-0fee-4e39-b132-732a761afdc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:26:27.008588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec5522-0fee-4e39-b132-732a761afdc6 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:27.008930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec5522-0fee-4e39-b132-732a761afdc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:27.009258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec5522-0fee-4e39-b132-732a761afdc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:27.010949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-02ec5522-0fee-4e39-b132-732a761afdc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:27.072535 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:27.131695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec5522-0fee-4e39-b132-732a761afdc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:26:27.133147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec5522-0fee-4e39-b132-732a761afdc6 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:26:27.152887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 655/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:26:29.688626 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f73d1-50e4-423d-b730-d0216b3daabd None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:29.689059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f73d1-50e4-423d-b730-d0216b3daabd None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:29.689059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f73d1-50e4-423d-b730-d0216b3daabd None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:29.690333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 657/1312] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:26:29.695822 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b74f48-964d-40c2-8020-d17f237ae4af None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:29.696220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b74f48-964d-40c2-8020-d17f237ae4af None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:29.696362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b74f48-964d-40c2-8020-d17f237ae4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:29.775692 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-87b74f48-964d-40c2-8020-d17f237ae4af None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:26:29.776893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-87b74f48-964d-40c2-8020-d17f237ae4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:29.871553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 656/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:26:30.151172 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f73d1-50e4-423d-b730-d0216b3daabd None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:26:30.153183 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e33f73d1-50e4-423d-b730-d0216b3daabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:30.254775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f73d1-50e4-423d-b730-d0216b3daabd None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:26:30.333595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:30.336247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c74954-7503-4fbc-8e53-1102fc78ae97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:26:30.337066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c74954-7503-4fbc-8e53-1102fc78ae97 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:30.337549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c74954-7503-4fbc-8e53-1102fc78ae97 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:30.338011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c74954-7503-4fbc-8e53-1102fc78ae97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:30.340298 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b6c74954-7503-4fbc-8e53-1102fc78ae97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:30.450647 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c74954-7503-4fbc-8e53-1102fc78ae97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:26:30.451947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c74954-7503-4fbc-8e53-1102fc78ae97 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:26:30.469875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 658/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:26:32.895260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b30073-ff2f-48fa-8b0e-29375c8eb411 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:32.895831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b30073-ff2f-48fa-8b0e-29375c8eb411 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:32.895831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b30073-ff2f-48fa-8b0e-29375c8eb411 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:32.897165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 657/1315] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:26:32.902752 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce1aa9-7dc4-4cb6-8b7a-96283d0a2268 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:32.903182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce1aa9-7dc4-4cb6-8b7a-96283d0a2268 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:32.903307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce1aa9-7dc4-4cb6-8b7a-96283d0a2268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:32.976666 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-03ce1aa9-7dc4-4cb6-8b7a-96283d0a2268 None None] MFA Rules not processed for user `fe727ca16f464f80a1fe24f7038c113c`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:26:32.978448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-03ce1aa9-7dc4-4cb6-8b7a-96283d0a2268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:33.029550 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:33.073146 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 659/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:26:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:26:33.363323 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b30073-ff2f-48fa-8b0e-29375c8eb411 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:26:33.365091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c9b30073-ff2f-48fa-8b0e-29375c8eb411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:33.374715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:33.467592 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b30073-ff2f-48fa-8b0e-29375c8eb411 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:26:33.539753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b64010-cb39-41e5-af63-f5107614f099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:26:33.540276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b64010-cb39-41e5-af63-f5107614f099 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:33.540549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b64010-cb39-41e5-af63-f5107614f099 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:33.540843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b64010-cb39-41e5-af63-f5107614f099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:33.542400 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f7b64010-cb39-41e5-af63-f5107614f099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:33.604867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:33.651577 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b64010-cb39-41e5-af63-f5107614f099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:26:33.653017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b64010-cb39-41e5-af63-f5107614f099 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:26:33.671001 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 658/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:26:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:26:36.343510 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36784ac-45c4-4bec-a638-bdfbf488264a None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:36.344074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36784ac-45c4-4bec-a638-bdfbf488264a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:36.344074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36784ac-45c4-4bec-a638-bdfbf488264a None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:36.345368 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 660/1318] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:26:36.350487 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0008e-ce2f-459f-b47f-a6d3324705e6 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:36.350900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0008e-ce2f-459f-b47f-a6d3324705e6 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:36.351058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0008e-ce2f-459f-b47f-a6d3324705e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:36.417885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8ef0008e-ce2f-459f-b47f-a6d3324705e6 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:26:36.420658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8ef0008e-ce2f-459f-b47f-a6d3324705e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:36.515695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 659/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:26:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:26:36.798432 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36784ac-45c4-4bec-a638-bdfbf488264a None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:26:36.800013 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e36784ac-45c4-4bec-a638-bdfbf488264a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:36.901331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36784ac-45c4-4bec-a638-bdfbf488264a None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:26:36.972906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e59f75-4a69-4056-819e-89516a9bd599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:26:36.973492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e59f75-4a69-4056-819e-89516a9bd599 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:36.973763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e59f75-4a69-4056-819e-89516a9bd599 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:36.974023 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e59f75-4a69-4056-819e-89516a9bd599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:36.975613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-04e59f75-4a69-4056-819e-89516a9bd599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:36.982246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:37.082153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e59f75-4a69-4056-819e-89516a9bd599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:26:37.083624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e59f75-4a69-4056-819e-89516a9bd599 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:26:37.100951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 661/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:26:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:26:39.864469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b49c0f-3ea8-442b-9a9c-db5434325bfa None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:39.865016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b49c0f-3ea8-442b-9a9c-db5434325bfa None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:39.865016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b49c0f-3ea8-442b-9a9c-db5434325bfa None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:39.866348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 660/1321] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:26:39.872110 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddf926-4e7c-4eba-9471-27a538d923b1 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:39.872561 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddf926-4e7c-4eba-9471-27a538d923b1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:39.872653 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddf926-4e7c-4eba-9471-27a538d923b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:39.944859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-19ddf926-4e7c-4eba-9471-27a538d923b1 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:26:39.945990 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-19ddf926-4e7c-4eba-9471-27a538d923b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:40.007840 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:40.050951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 662/1322] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:26:40.344941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05965c-ad65-4ecb-85cf-a6d7b1425dee None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:40.345228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05965c-ad65-4ecb-85cf-a6d7b1425dee None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:40.345499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05965c-ad65-4ecb-85cf-a6d7b1425dee None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:40.346914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 661/1323] 10.222.0.20 () {54 vars in 965 bytes} [Fri Sep 16 05:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:26:40.353068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c1ee-edab-47c7-a681-6f9135b4086a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:40.353353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c1ee-edab-47c7-a681-6f9135b4086a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:40.353627 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c1ee-edab-47c7-a681-6f9135b4086a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:40.429498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b3f3c1ee-edab-47c7-a681-6f9135b4086a None None] MFA Rules not processed for user `d51f44d06b0f4303a753709bd1bcf3e5`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:26:40.430739 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b3f3c1ee-edab-47c7-a681-6f9135b4086a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:40.509248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 663/1324] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Sep 16 05:26:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:26:40.518673 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05965c-ad65-4ecb-85cf-a6d7b1425dee None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:26:40.520195 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3f05965c-ad65-4ecb-85cf-a6d7b1425dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:40.540450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:40.627212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05965c-ad65-4ecb-85cf-a6d7b1425dee None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:26:40.701939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a6a0b-3b57-4ca4-85e1-295c0eb5bbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:26:40.702562 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a6a0b-3b57-4ca4-85e1-295c0eb5bbaf service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:40.702847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a6a0b-3b57-4ca4-85e1-295c0eb5bbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:40.703116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a6a0b-3b57-4ca4-85e1-295c0eb5bbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:40.704705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0c1a6a0b-3b57-4ca4-85e1-295c0eb5bbaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:40.774948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:40.812455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a6a0b-3b57-4ca4-85e1-295c0eb5bbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:26:40.813873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a6a0b-3b57-4ca4-85e1-295c0eb5bbaf service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:26:40.832009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 662/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:26:43.234572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1bf7-28b2-491c-a56e-023cb87a70e5 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:43.235095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1bf7-28b2-491c-a56e-023cb87a70e5 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:43.235095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1bf7-28b2-491c-a56e-023cb87a70e5 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:43.236487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 664/1326] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:26:43.241880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b43eb1-8cc6-401a-ae50-204bcc35badf None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:43.242285 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b43eb1-8cc6-401a-ae50-204bcc35badf None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:43.242375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b43eb1-8cc6-401a-ae50-204bcc35badf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:43.309083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-b8b43eb1-8cc6-401a-ae50-204bcc35badf None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:26:43.310289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b8b43eb1-8cc6-401a-ae50-204bcc35badf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:43.405168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 663/1327] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:26:43.696521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a1bf7-28b2-491c-a56e-023cb87a70e5 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:26:43.698084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-234a1bf7-28b2-491c-a56e-023cb87a70e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:43.757625 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:43.801258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a1bf7-28b2-491c-a56e-023cb87a70e5 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:26:43.875391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b153a75-7465-4ec9-8847-134b4eb6ff81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:26:43.875995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b153a75-7465-4ec9-8847-134b4eb6ff81 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:43.876271 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b153a75-7465-4ec9-8847-134b4eb6ff81 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:43.876540 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b153a75-7465-4ec9-8847-134b4eb6ff81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:43.878138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8b153a75-7465-4ec9-8847-134b4eb6ff81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:43.987783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:43.989786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b153a75-7465-4ec9-8847-134b4eb6ff81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:26:43.991801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b153a75-7465-4ec9-8847-134b4eb6ff81 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:26:44.010564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 665/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:26:46.236733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3b07d-d74c-4470-afb6-76d82d9128b6 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:46.237290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3b07d-d74c-4470-afb6-76d82d9128b6 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:46.237290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3b07d-d74c-4470-afb6-76d82d9128b6 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:46.240086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 664/1329] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:26:46.244401 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f5a09-ce76-4c9d-b261-e0e9c053fc4a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:46.244812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f5a09-ce76-4c9d-b261-e0e9c053fc4a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:46.244923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f5a09-ce76-4c9d-b261-e0e9c053fc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:46.315088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-8c7f5a09-ce76-4c9d-b261-e0e9c053fc4a None None] MFA Rules not processed for user `fe727ca16f464f80a1fe24f7038c113c`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:26:46.316339 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8c7f5a09-ce76-4c9d-b261-e0e9c053fc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:46.416134 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 666/1330] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:26:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:26:46.699518 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3b07d-d74c-4470-afb6-76d82d9128b6 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:26:46.701065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1ad3b07d-d74c-4470-afb6-76d82d9128b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:46.732455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:46.804434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3b07d-d74c-4470-afb6-76d82d9128b6 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:26:46.880530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb69fe-f67a-4aaa-8616-4832259778c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:26:46.881138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb69fe-f67a-4aaa-8616-4832259778c9 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:46.881411 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb69fe-f67a-4aaa-8616-4832259778c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:46.881680 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb69fe-f67a-4aaa-8616-4832259778c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:46.883317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-cdbb69fe-f67a-4aaa-8616-4832259778c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:46.966558 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:46.998624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb69fe-f67a-4aaa-8616-4832259778c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:26:47.000059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb69fe-f67a-4aaa-8616-4832259778c9 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:26:47.018204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 665/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:26:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:26:49.383102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fdd69-e595-43b7-b1df-050caf7bca01 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:49.383650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fdd69-e595-43b7-b1df-050caf7bca01 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:49.383650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fdd69-e595-43b7-b1df-050caf7bca01 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:49.385031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 667/1332] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:26:49.390793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4e40f-ff8f-4e58-8f2e-aeaf99a02d2b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:49.391231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4e40f-ff8f-4e58-8f2e-aeaf99a02d2b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:49.391329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4e40f-ff8f-4e58-8f2e-aeaf99a02d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:49.456309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-51a4e40f-ff8f-4e58-8f2e-aeaf99a02d2b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:26:49.457519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-51a4e40f-ff8f-4e58-8f2e-aeaf99a02d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:49.551519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 666/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:26:49.833104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fdd69-e595-43b7-b1df-050caf7bca01 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:26:49.834694 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c22fdd69-e595-43b7-b1df-050caf7bca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:49.903591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:49.938486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fdd69-e595-43b7-b1df-050caf7bca01 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:26:50.008681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786dd1c6-a393-45aa-b869-64f1ac85ea8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:26:50.009272 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dd1c6-a393-45aa-b869-64f1ac85ea8f service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:50.009544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dd1c6-a393-45aa-b869-64f1ac85ea8f service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:50.009810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dd1c6-a393-45aa-b869-64f1ac85ea8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:50.011418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-786dd1c6-a393-45aa-b869-64f1ac85ea8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:50.116246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786dd1c6-a393-45aa-b869-64f1ac85ea8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:26:50.117603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786dd1c6-a393-45aa-b869-64f1ac85ea8f service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:26:50.127807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:50.136093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 668/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:26:52.323487 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f75c-5a15-469e-a9b5-15f84c64b77a None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:52.323996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f75c-5a15-469e-a9b5-15f84c64b77a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:52.324108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f75c-5a15-469e-a9b5-15f84c64b77a None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:52.325874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 667/1335] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:26:52.331065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a067e4-f219-42c8-9340-af47e168a8bb None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:52.331479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a067e4-f219-42c8-9340-af47e168a8bb None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:52.331616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a067e4-f219-42c8-9340-af47e168a8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:52.396710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-38a067e4-f219-42c8-9340-af47e168a8bb None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:26:52.397915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-38a067e4-f219-42c8-9340-af47e168a8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:52.491640 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 669/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:26:52.779316 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0f75c-5a15-469e-a9b5-15f84c64b77a None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:26:52.780889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9ca0f75c-5a15-469e-a9b5-15f84c64b77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:52.821505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:52.886661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0f75c-5a15-469e-a9b5-15f84c64b77a None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:26:52.958726 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577e13f-a41b-4562-9579-187841907e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:26:52.959327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577e13f-a41b-4562-9579-187841907e59 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:52.959599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577e13f-a41b-4562-9579-187841907e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:52.959864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577e13f-a41b-4562-9579-187841907e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:52.961471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0577e13f-a41b-4562-9579-187841907e59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:53.052068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:53.082654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577e13f-a41b-4562-9579-187841907e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:26:53.084089 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577e13f-a41b-4562-9579-187841907e59 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:26:53.102047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 668/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:26:55.591262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97596-a388-458e-9e7d-8a124ec0e218 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:55.591818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97596-a388-458e-9e7d-8a124ec0e218 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:55.591818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97596-a388-458e-9e7d-8a124ec0e218 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:55.593116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 670/1338] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:26:55.598169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b34b4a-18c2-45ce-947e-47344355fc15 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:55.598573 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b34b4a-18c2-45ce-947e-47344355fc15 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:55.598736 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b34b4a-18c2-45ce-947e-47344355fc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:55.663429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-33b34b4a-18c2-45ce-947e-47344355fc15 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:26:55.664626 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-33b34b4a-18c2-45ce-947e-47344355fc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:55.758792 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 669/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:26:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:26:56.047062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe97596-a388-458e-9e7d-8a124ec0e218 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:26:56.048714 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8fe97596-a388-458e-9e7d-8a124ec0e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:56.124071 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:26:56.151339 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe97596-a388-458e-9e7d-8a124ec0e218 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:26:56.225208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c582fc-25f5-4daf-85aa-7307e431b4b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:26:56.225822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c582fc-25f5-4daf-85aa-7307e431b4b1 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:26:56.226100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c582fc-25f5-4daf-85aa-7307e431b4b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:26:56.226374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c582fc-25f5-4daf-85aa-7307e431b4b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:26:56.228036 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e1c582fc-25f5-4daf-85aa-7307e431b4b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:26:56.337312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c582fc-25f5-4daf-85aa-7307e431b4b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:26:56.338795 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c582fc-25f5-4daf-85aa-7307e431b4b1 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:26:56.357453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 671/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:26:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:00.332717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03ee2-726e-474f-acb4-8fbeb6f83e66 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:00.333250 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03ee2-726e-474f-acb4-8fbeb6f83e66 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:00.333250 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03ee2-726e-474f-acb4-8fbeb6f83e66 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:00.334769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 670/1341] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:00.339956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e71312-ab2b-4f91-bec0-5c5064e01f46 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:00.340412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e71312-ab2b-4f91-bec0-5c5064e01f46 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:00.340524 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e71312-ab2b-4f91-bec0-5c5064e01f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:00.345909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:00.419758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-56e71312-ab2b-4f91-bec0-5c5064e01f46 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:00.421009 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-56e71312-ab2b-4f91-bec0-5c5064e01f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:00.525487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 672/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:00.807573 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c03ee2-726e-474f-acb4-8fbeb6f83e66 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:00.809145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b0c03ee2-726e-474f-acb4-8fbeb6f83e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:00.858291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:00.914917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c03ee2-726e-474f-acb4-8fbeb6f83e66 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:00.992670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a44bb9-8534-4a4d-8546-c8b10ce36748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:00.993278 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a44bb9-8534-4a4d-8546-c8b10ce36748 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:00.993550 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a44bb9-8534-4a4d-8546-c8b10ce36748 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:00.993815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a44bb9-8534-4a4d-8546-c8b10ce36748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:00.995438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c8a44bb9-8534-4a4d-8546-c8b10ce36748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:01.089069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:01.106400 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a44bb9-8534-4a4d-8546-c8b10ce36748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:01.107882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a44bb9-8534-4a4d-8546-c8b10ce36748 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:01.125934 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 671/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:04.253354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cafb9-71b3-4213-a6ab-19d01668eba7 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:04.253852 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cafb9-71b3-4213-a6ab-19d01668eba7 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:04.253949 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cafb9-71b3-4213-a6ab-19d01668eba7 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:04.255406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 673/1344] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:04.260341 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed83096-b17f-42db-a65f-6af1b03da380 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:04.260772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed83096-b17f-42db-a65f-6af1b03da380 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:04.260878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed83096-b17f-42db-a65f-6af1b03da380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:04.329253 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-9ed83096-b17f-42db-a65f-6af1b03da380 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:04.330428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9ed83096-b17f-42db-a65f-6af1b03da380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:04.434539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 672/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:04.711718 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cafb9-71b3-4213-a6ab-19d01668eba7 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:04.713274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-013cafb9-71b3-4213-a6ab-19d01668eba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:04.799750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:04.816989 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cafb9-71b3-4213-a6ab-19d01668eba7 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:04.912811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009bbb0-9811-4c3b-b631-1db620218ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:04.913583 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009bbb0-9811-4c3b-b631-1db620218ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:04.913751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009bbb0-9811-4c3b-b631-1db620218ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:04.914021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009bbb0-9811-4c3b-b631-1db620218ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:04.916032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-9009bbb0-9811-4c3b-b631-1db620218ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:05.037684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009bbb0-9811-4c3b-b631-1db620218ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:05.039180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009bbb0-9811-4c3b-b631-1db620218ab3 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:05.058034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 674/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:09.427871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320dd18-8794-4ad6-873c-dc99c56687f6 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:09.428404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320dd18-8794-4ad6-873c-dc99c56687f6 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:09.428404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320dd18-8794-4ad6-873c-dc99c56687f6 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:09.429758 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 673/1347] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:09.435706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347628e-4f91-4b66-9451-61ee29752c3a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:09.436082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347628e-4f91-4b66-9451-61ee29752c3a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:09.436255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347628e-4f91-4b66-9451-61ee29752c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:09.452251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:09.502679 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-5347628e-4f91-4b66-9451-61ee29752c3a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:09.503889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5347628e-4f91-4b66-9451-61ee29752c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:09.596766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 675/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:09.878822 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320dd18-8794-4ad6-873c-dc99c56687f6 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:09.880671 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0320dd18-8794-4ad6-873c-dc99c56687f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:09.942810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:09.988627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320dd18-8794-4ad6-873c-dc99c56687f6 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:10.059770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c063d1-83af-41c7-925e-21b6d7d7ecb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:10.060973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c063d1-83af-41c7-925e-21b6d7d7ecb2 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:10.061247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c063d1-83af-41c7-925e-21b6d7d7ecb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:10.061512 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c063d1-83af-41c7-925e-21b6d7d7ecb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:10.063125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-82c063d1-83af-41c7-925e-21b6d7d7ecb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:10.165937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:10.169145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c063d1-83af-41c7-925e-21b6d7d7ecb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:10.171416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c063d1-83af-41c7-925e-21b6d7d7ecb2 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:10.189508 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 674/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:15.067080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af5454-6afb-4168-85e6-ee7c672482f0 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:15.067080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af5454-6afb-4168-85e6-ee7c672482f0 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:15.067080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af5454-6afb-4168-85e6-ee7c672482f0 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:15.067080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 676/1350] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 05:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:15.067724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6e0e3-a0b7-4ad7-8184-7677680bbd0e None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:15.067724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6e0e3-a0b7-4ad7-8184-7677680bbd0e None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:15.067724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6e0e3-a0b7-4ad7-8184-7677680bbd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:15.209447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-4cd6e0e3-a0b7-4ad7-8184-7677680bbd0e None None] MFA Rules not processed for user `8ef60b27f5f545aa8ea063009ec66eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:15.210992 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4cd6e0e3-a0b7-4ad7-8184-7677680bbd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:15.348567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 675/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 05:27:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:19.460687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7538954-d30e-4b2a-886f-e70310688ca1 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:19.461198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7538954-d30e-4b2a-886f-e70310688ca1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:19.461479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7538954-d30e-4b2a-886f-e70310688ca1 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:19.463743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 677/1352] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 05:27:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:19.468820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a609c4f-2162-4ee7-8d82-ad55a0a2fa88 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:19.469253 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a609c4f-2162-4ee7-8d82-ad55a0a2fa88 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:19.469402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a609c4f-2162-4ee7-8d82-ad55a0a2fa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:19.528303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:19.553994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-0a609c4f-2162-4ee7-8d82-ad55a0a2fa88 None None] MFA Rules not processed for user `8ef60b27f5f545aa8ea063009ec66eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:19.555249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0a609c4f-2162-4ee7-8d82-ad55a0a2fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:19.595591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=59 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:19.666776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 676/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 05:27:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:20.921204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0db63-bcf7-458c-973f-ce83d6f44d0c None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:20.921726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0db63-bcf7-458c-973f-ce83d6f44d0c None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:20.921838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0db63-bcf7-458c-973f-ce83d6f44d0c None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:20.923436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 678/1354] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 05:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:20.928505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabd4f0-43bc-489b-8b47-9a5057ee1505 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:20.928926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabd4f0-43bc-489b-8b47-9a5057ee1505 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:20.929078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabd4f0-43bc-489b-8b47-9a5057ee1505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:21.007611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-4dabd4f0-43bc-489b-8b47-9a5057ee1505 None None] MFA Rules not processed for user `8ef60b27f5f545aa8ea063009ec66eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:21.008891 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4dabd4f0-43bc-489b-8b47-9a5057ee1505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:21.050300 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:21.115404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 677/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 05:27:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:27:24.778061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2fd61-851f-4d5e-be5a-69b197815565 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:24.778602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2fd61-851f-4d5e-be5a-69b197815565 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:24.778896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2fd61-851f-4d5e-be5a-69b197815565 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:24.780962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 679/1356] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:24.786257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e388c-8621-4239-b479-2c52df352c06 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:24.786732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e388c-8621-4239-b479-2c52df352c06 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:24.786818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e388c-8621-4239-b479-2c52df352c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:24.859613 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-dd2e388c-8621-4239-b479-2c52df352c06 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:24.861336 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-dd2e388c-8621-4239-b479-2c52df352c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:24.968392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 678/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:25.267563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273cba-072e-4b22-ba3f-f4e7d944bd57 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:25.267847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273cba-072e-4b22-ba3f-f4e7d944bd57 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:25.268119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273cba-072e-4b22-ba3f-f4e7d944bd57 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:25.269451 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 680/1358] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 16 05:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:25.276911 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f8c34-1068-4db4-8da9-66a02b081f76 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:25.277228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f8c34-1068-4db4-8da9-66a02b081f76 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:25.277486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f8c34-1068-4db4-8da9-66a02b081f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:25.299441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:25.369347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-0f0f8c34-1068-4db4-8da9-66a02b081f76 None None] MFA Rules not processed for user `515e548efd984b87bca742e26eec162a`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:25.370706 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0f0f8c34-1068-4db4-8da9-66a02b081f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:25.494613 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 679/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 16 05:27:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:25.502960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84273cba-072e-4b22-ba3f-f4e7d944bd57 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:25.504504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-84273cba-072e-4b22-ba3f-f4e7d944bd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:25.661196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84273cba-072e-4b22-ba3f-f4e7d944bd57 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:25.741884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:25.785337 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f036fb9-7886-4336-bb7e-9619e2c261f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:25.785970 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036fb9-7886-4336-bb7e-9619e2c261f2 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:25.786347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036fb9-7886-4336-bb7e-9619e2c261f2 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:25.786732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f036fb9-7886-4336-bb7e-9619e2c261f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:25.788408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5f036fb9-7886-4336-bb7e-9619e2c261f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:25.893913 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f036fb9-7886-4336-bb7e-9619e2c261f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:25.895753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f036fb9-7886-4336-bb7e-9619e2c261f2 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:25.917178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 681/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:28.316286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7f643-8027-4e96-bfbe-e5e6eb804887 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:28.316286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7f643-8027-4e96-bfbe-e5e6eb804887 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:28.316286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7f643-8027-4e96-bfbe-e5e6eb804887 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:28.321857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 680/1361] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:28.322745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4d804-cba9-4acf-9fe8-c39127502292 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:28.323188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4d804-cba9-4acf-9fe8-c39127502292 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:28.323372 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4d804-cba9-4acf-9fe8-c39127502292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:28.395290 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-dfa4d804-cba9-4acf-9fe8-c39127502292 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:28.396512 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-dfa4d804-cba9-4acf-9fe8-c39127502292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:28.436652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:28.504944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 682/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:28.797699 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7f643-8027-4e96-bfbe-e5e6eb804887 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:28.799267 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-40a7f643-8027-4e96-bfbe-e5e6eb804887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:28.875316 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:28.985241 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7f643-8027-4e96-bfbe-e5e6eb804887 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:29.109720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875c352-b105-468b-914d-2fe1a8ccc408 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:29.110328 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875c352-b105-468b-914d-2fe1a8ccc408 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:29.110637 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875c352-b105-468b-914d-2fe1a8ccc408 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:29.110914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875c352-b105-468b-914d-2fe1a8ccc408 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:29.112521 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0875c352-b105-468b-914d-2fe1a8ccc408 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:29.136480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:29.205615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875c352-b105-468b-914d-2fe1a8ccc408 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:29.207250 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875c352-b105-468b-914d-2fe1a8ccc408 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:29.225843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 681/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:31.688281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f9a58-fe02-44d6-a777-36328eb0fe9c None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:31.688720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f9a58-fe02-44d6-a777-36328eb0fe9c None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:31.688854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f9a58-fe02-44d6-a777-36328eb0fe9c None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:31.690331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 683/1364] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:31.695645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ed86-6c29-4b44-adc6-0347e0a85943 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:31.696066 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ed86-6c29-4b44-adc6-0347e0a85943 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:31.696266 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ed86-6c29-4b44-adc6-0347e0a85943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:31.780554 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8498ed86-6c29-4b44-adc6-0347e0a85943 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:31.781923 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8498ed86-6c29-4b44-adc6-0347e0a85943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:31.883617 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:31.886246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 682/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:27:32.179001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42dd77-a247-41f7-bef0-3cc35f3fc8e1 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:32.179408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42dd77-a247-41f7-bef0-3cc35f3fc8e1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:32.179779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42dd77-a247-41f7-bef0-3cc35f3fc8e1 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:32.181470 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 684/1366] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 16 05:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:32.188169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152a0c1-5466-42f2-aed2-384b29444f28 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:32.188459 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152a0c1-5466-42f2-aed2-384b29444f28 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:32.188875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152a0c1-5466-42f2-aed2-384b29444f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:32.272119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-4152a0c1-5466-42f2-aed2-384b29444f28 None None] MFA Rules not processed for user `515e548efd984b87bca742e26eec162a`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:32.273639 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4152a0c1-5466-42f2-aed2-384b29444f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:32.395310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 683/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 16 05:27:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:32.403482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42dd77-a247-41f7-bef0-3cc35f3fc8e1 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:32.405766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-7d42dd77-a247-41f7-bef0-3cc35f3fc8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:32.559597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42dd77-a247-41f7-bef0-3cc35f3fc8e1 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:32.582213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:32.685102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9d92c-190d-45d1-ad2b-56106cc68cb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:32.686357 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d92c-190d-45d1-ad2b-56106cc68cb1 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:32.687019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d92c-190d-45d1-ad2b-56106cc68cb1 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:32.687149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d92c-190d-45d1-ad2b-56106cc68cb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:32.688776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2ab9d92c-190d-45d1-ad2b-56106cc68cb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:32.786231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9d92c-190d-45d1-ad2b-56106cc68cb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:32.787949 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9d92c-190d-45d1-ad2b-56106cc68cb1 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:32.809257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 685/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:27:32.905044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea8611-ff5c-4110-9215-fc30447ae017 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:32.905589 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea8611-ff5c-4110-9215-fc30447ae017 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:32.905589 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea8611-ff5c-4110-9215-fc30447ae017 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:32.909353 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 684/1369] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:32.914933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaca65c-fc24-4b6e-a4b7-a8e5455a7086 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:32.915626 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaca65c-fc24-4b6e-a4b7-a8e5455a7086 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:32.915903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaca65c-fc24-4b6e-a4b7-a8e5455a7086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:32.956303 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:33.000614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-4aaca65c-fc24-4b6e-a4b7-a8e5455a7086 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:33.001905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4aaca65c-fc24-4b6e-a4b7-a8e5455a7086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:33.121249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 686/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:33.453818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38305a05-ba6d-495b-8e06-d1daa9e0af36 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:33.453818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38305a05-ba6d-495b-8e06-d1daa9e0af36 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:33.453818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38305a05-ba6d-495b-8e06-d1daa9e0af36 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:33.455004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 685/1371] 10.222.0.20 () {54 vars in 964 bytes} [Fri Sep 16 05:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:33.459158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da29c2b-91fe-47d1-99de-ac75b8dad6bd None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:33.459453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da29c2b-91fe-47d1-99de-ac75b8dad6bd None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:33.459732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da29c2b-91fe-47d1-99de-ac75b8dad6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:33.539330 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-9da29c2b-91fe-47d1-99de-ac75b8dad6bd None None] MFA Rules not processed for user `fc48962e649c40ca82cf3173ce9940e9`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:33.540155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-9da29c2b-91fe-47d1-99de-ac75b8dad6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:33.589517 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:33.622786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 687/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Sep 16 05:27:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:33.630531 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38305a05-ba6d-495b-8e06-d1daa9e0af36 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:33.632065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-38305a05-ba6d-495b-8e06-d1daa9e0af36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:33.685926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:33.746874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38305a05-ba6d-495b-8e06-d1daa9e0af36 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:33.833501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6b46-5581-4691-a5c8-5e5493a22fb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:33.834120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6b46-5581-4691-a5c8-5e5493a22fb4 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:33.834499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6b46-5581-4691-a5c8-5e5493a22fb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:33.834861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6b46-5581-4691-a5c8-5e5493a22fb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:33.836734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0d9b6b46-5581-4691-a5c8-5e5493a22fb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:33.974977 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:33.988882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b6b46-5581-4691-a5c8-5e5493a22fb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:33.990992 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b6b46-5581-4691-a5c8-5e5493a22fb4 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:34.011301 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 686/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:35.055511 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7254b1-50c8-4a5b-a643-b2f900b47201 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:35.056045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7254b1-50c8-4a5b-a643-b2f900b47201 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:35.056137 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7254b1-50c8-4a5b-a643-b2f900b47201 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:35.057420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 688/1374] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:35.063217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0f4e6-c111-4dfb-8a59-c3e0e0c25027 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:35.063688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0f4e6-c111-4dfb-8a59-c3e0e0c25027 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:35.063882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0f4e6-c111-4dfb-8a59-c3e0e0c25027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:35.129888 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-1ce0f4e6-c111-4dfb-8a59-c3e0e0c25027 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:35.131125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1ce0f4e6-c111-4dfb-8a59-c3e0e0c25027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:35.230160 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 687/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:35.530633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7254b1-50c8-4a5b-a643-b2f900b47201 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:35.532320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0c7254b1-50c8-4a5b-a643-b2f900b47201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:35.697832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7254b1-50c8-4a5b-a643-b2f900b47201 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:35.751058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:35.817456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a8131-1c07-4b61-b174-470fd5865c5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:35.818189 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a8131-1c07-4b61-b174-470fd5865c5f service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:35.818556 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a8131-1c07-4b61-b174-470fd5865c5f service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:35.818905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a8131-1c07-4b61-b174-470fd5865c5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:35.820840 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-440a8131-1c07-4b61-b174-470fd5865c5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:35.915340 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a8131-1c07-4b61-b174-470fd5865c5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:35.917621 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a8131-1c07-4b61-b174-470fd5865c5f service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:35.936904 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 689/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:38.160613 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c8ca9-d44d-4a31-a347-2440ab9e5b0d None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:38.161143 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c8ca9-d44d-4a31-a347-2440ab9e5b0d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:38.161402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c8ca9-d44d-4a31-a347-2440ab9e5b0d None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:38.162881 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 688/1377] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:38.168037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619de7ba-175f-4ba8-9f5b-80d48b609e48 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:38.168419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619de7ba-175f-4ba8-9f5b-80d48b609e48 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:38.168606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619de7ba-175f-4ba8-9f5b-80d48b609e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:38.244658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-619de7ba-175f-4ba8-9f5b-80d48b609e48 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:38.246093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-619de7ba-175f-4ba8-9f5b-80d48b609e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:38.254660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:38.361188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 690/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:38.652816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c8ca9-d44d-4a31-a347-2440ab9e5b0d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:38.655193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1d2c8ca9-d44d-4a31-a347-2440ab9e5b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:38.728086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:38.817394 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c8ca9-d44d-4a31-a347-2440ab9e5b0d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:38.943654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf00f4-0c9e-4516-993b-49d6c9f6b94b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:38.944368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf00f4-0c9e-4516-993b-49d6c9f6b94b service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:38.944824 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf00f4-0c9e-4516-993b-49d6c9f6b94b service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:38.945200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf00f4-0c9e-4516-993b-49d6c9f6b94b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:38.947363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-31bf00f4-0c9e-4516-993b-49d6c9f6b94b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:38.973416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:39.053378 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf00f4-0c9e-4516-993b-49d6c9f6b94b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:39.055180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf00f4-0c9e-4516-993b-49d6c9f6b94b service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:39.074741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 689/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:41.288035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814998b-c679-4273-9672-5923b5704e09 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:41.288617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814998b-c679-4273-9672-5923b5704e09 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:41.288617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814998b-c679-4273-9672-5923b5704e09 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:41.290076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 691/1380] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:41.296841 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb56009-bc15-4cbc-95c6-8c1ae2f3227a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:41.297317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb56009-bc15-4cbc-95c6-8c1ae2f3227a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:41.297402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb56009-bc15-4cbc-95c6-8c1ae2f3227a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:41.365398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-5fb56009-bc15-4cbc-95c6-8c1ae2f3227a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:41.366615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5fb56009-bc15-4cbc-95c6-8c1ae2f3227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:41.483428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:41.493207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 690/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:41.783575 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814998b-c679-4273-9672-5923b5704e09 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:41.785121 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1814998b-c679-4273-9672-5923b5704e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:41.935317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:41.947619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814998b-c679-4273-9672-5923b5704e09 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:42.084625 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69513433-c25b-4670-9f82-2eb36963b86e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:42.085245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69513433-c25b-4670-9f82-2eb36963b86e service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:42.085560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69513433-c25b-4670-9f82-2eb36963b86e service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:42.085824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69513433-c25b-4670-9f82-2eb36963b86e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:42.087560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-69513433-c25b-4670-9f82-2eb36963b86e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:42.178662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69513433-c25b-4670-9f82-2eb36963b86e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:42.180270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69513433-c25b-4670-9f82-2eb36963b86e service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:42.190363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:42.200490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 692/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:27:44.469239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d02319-68a1-47e2-a020-8ce48a28d824 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:44.469835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d02319-68a1-47e2-a020-8ce48a28d824 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:44.469835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d02319-68a1-47e2-a020-8ce48a28d824 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:44.471127 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 691/1383] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:44.476510 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57f752-039c-4788-967b-7c84121d417e None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:44.476987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57f752-039c-4788-967b-7c84121d417e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:44.477102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57f752-039c-4788-967b-7c84121d417e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:44.543224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-fb57f752-039c-4788-967b-7c84121d417e None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:44.544458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-fb57f752-039c-4788-967b-7c84121d417e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:44.643961 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 693/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:44.949236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d02319-68a1-47e2-a020-8ce48a28d824 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:44.950858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f2d02319-68a1-47e2-a020-8ce48a28d824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:45.099437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d02319-68a1-47e2-a020-8ce48a28d824 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:45.167691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:45.226216 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce251c96-3f51-4c74-acf8-dd2da7d96d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:45.227328 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce251c96-3f51-4c74-acf8-dd2da7d96d56 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:45.227673 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce251c96-3f51-4c74-acf8-dd2da7d96d56 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:45.228000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce251c96-3f51-4c74-acf8-dd2da7d96d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:45.230088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ce251c96-3f51-4c74-acf8-dd2da7d96d56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:45.340560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce251c96-3f51-4c74-acf8-dd2da7d96d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:45.343241 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce251c96-3f51-4c74-acf8-dd2da7d96d56 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:45.366764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 692/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:47.565971 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ab90-464c-44e2-a51d-b1e1e3627cb7 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:47.566607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ab90-464c-44e2-a51d-b1e1e3627cb7 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:47.566607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ab90-464c-44e2-a51d-b1e1e3627cb7 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:47.567894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 694/1386] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:47.573494 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad6c7c-32d1-484d-b6a9-dd1ec95cef43 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:47.573937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad6c7c-32d1-484d-b6a9-dd1ec95cef43 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:47.574037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad6c7c-32d1-484d-b6a9-dd1ec95cef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:47.642021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-b3ad6c7c-32d1-484d-b6a9-dd1ec95cef43 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:47.643270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b3ad6c7c-32d1-484d-b6a9-dd1ec95cef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:47.676498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:47.740731 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 693/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:48.034067 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553ab90-464c-44e2-a51d-b1e1e3627cb7 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:48.035638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c553ab90-464c-44e2-a51d-b1e1e3627cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:48.111039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:48.179931 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553ab90-464c-44e2-a51d-b1e1e3627cb7 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:48.297993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b273-a0a3-4790-8ba7-8af9d815e105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:48.298529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b273-a0a3-4790-8ba7-8af9d815e105 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:48.298824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b273-a0a3-4790-8ba7-8af9d815e105 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:48.299096 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b273-a0a3-4790-8ba7-8af9d815e105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:48.300714 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2455b273-a0a3-4790-8ba7-8af9d815e105 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:48.340660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:48.392638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455b273-a0a3-4790-8ba7-8af9d815e105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:48.394246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455b273-a0a3-4790-8ba7-8af9d815e105 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:48.412638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 695/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:49.255248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9d5e9-24e9-467e-938a-b6849f65e173 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:49.255749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9d5e9-24e9-467e-938a-b6849f65e173 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:49.255886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9d5e9-24e9-467e-938a-b6849f65e173 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:49.257886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 694/1389] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:27:49.262849 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05fdeb-2983-4b33-b832-3b389cc1540a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:49.263244 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05fdeb-2983-4b33-b832-3b389cc1540a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:49.263402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05fdeb-2983-4b33-b832-3b389cc1540a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:49.334337 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-3d05fdeb-2983-4b33-b832-3b389cc1540a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:49.335597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3d05fdeb-2983-4b33-b832-3b389cc1540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:49.433038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 696/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:49.731791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7c419-ca10-4899-b2d7-c87990227c9c None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:49.732093 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7c419-ca10-4899-b2d7-c87990227c9c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:49.732371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7c419-ca10-4899-b2d7-c87990227c9c None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:49.734216 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 695/1391] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 16 05:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:49.739497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b64f03-12bd-4e41-aa37-d73c41163d1e None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:49.739785 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b64f03-12bd-4e41-aa37-d73c41163d1e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:49.740056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b64f03-12bd-4e41-aa37-d73c41163d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:49.756323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:49.817439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-f7b64f03-12bd-4e41-aa37-d73c41163d1e None None] MFA Rules not processed for user `20d8e253a72c44f7a5a986f981660df2`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:49.818652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f7b64f03-12bd-4e41-aa37-d73c41163d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:49.893275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 697/1392] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 16 05:27:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:49.902400 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7c419-ca10-4899-b2d7-c87990227c9c None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:49.903930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-09c7c419-ca10-4899-b2d7-c87990227c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:50.009130 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7c419-ca10-4899-b2d7-c87990227c9c None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:50.071963 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:50.088413 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d8027-c7a0-472a-b7b4-adb88f2c9c2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20d8e253a72c44f7a5a986f981660df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:50.089013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d8027-c7a0-472a-b7b4-adb88f2c9c2d service glance] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:50.089288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d8027-c7a0-472a-b7b4-adb88f2c9c2d service glance] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:50.089556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d8027-c7a0-472a-b7b4-adb88f2c9c2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:50.091171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-635d8027-c7a0-472a-b7b4-adb88f2c9c2d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:50.199839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d8027-c7a0-472a-b7b4-adb88f2c9c2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:50.201285 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d8027-c7a0-472a-b7b4-adb88f2c9c2d service glance] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:50.220638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 696/1393] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:50.584040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf2224-1e08-40e0-9d05-5aa40d7a7dad None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:50.584601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf2224-1e08-40e0-9d05-5aa40d7a7dad None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:50.584601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf2224-1e08-40e0-9d05-5aa40d7a7dad None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:50.586929 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 698/1394] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:50.592148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbd4f8-73c9-426d-b049-14ccea86d64f None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:50.592592 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbd4f8-73c9-426d-b049-14ccea86d64f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:50.592759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbd4f8-73c9-426d-b049-14ccea86d64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:50.663751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-0afbd4f8-73c9-426d-b049-14ccea86d64f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:50.664912 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0afbd4f8-73c9-426d-b049-14ccea86d64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:50.707505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:50.770264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 697/1395] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:50.989245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7fc2e-d70a-45a9-adbd-b32534e2bdd9 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:50.989525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7fc2e-d70a-45a9-adbd-b32534e2bdd9 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:50.989799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7fc2e-d70a-45a9-adbd-b32534e2bdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:51.058676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-30d7fc2e-d70a-45a9-adbd-b32534e2bdd9 None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:51.060106 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-30d7fc2e-d70a-45a9-adbd-b32534e2bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:51.060268 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbd4f8-73c9-426d-b049-14ccea86d64f None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:51.061921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0afbd4f8-73c9-426d-b049-14ccea86d64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:51.119349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:51.152041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 699/1396] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:27:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:27:51.177115 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbd4f8-73c9-426d-b049-14ccea86d64f None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:51.198271 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d5c7f-6bb6-411a-b379-4e4e13530d04 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:51.198585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d5c7f-6bb6-411a-b379-4e4e13530d04 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:51.198853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d5c7f-6bb6-411a-b379-4e4e13530d04 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:51.200174 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 700/1397] 10.222.0.20 () {54 vars in 943 bytes} [Fri Sep 16 05:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:27:51.206787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ee64-e16e-417b-ad80-daa55af81c8f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:51.207075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ee64-e16e-417b-ad80-daa55af81c8f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:51.207348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ee64-e16e-417b-ad80-daa55af81c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:51.239652 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:51.285611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-2116ee64-e16e-417b-ad80-daa55af81c8f None None] MFA Rules not processed for user `bae43204e3984619b4fdb64f36ef47ea`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:51.286895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2116ee64-e16e-417b-ad80-daa55af81c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:51.300557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fc036-6026-4447-a36d-8ea772095ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:51.301170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fc036-6026-4447-a36d-8ea772095ef4 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:51.301443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fc036-6026-4447-a36d-8ea772095ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:51.301709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fc036-6026-4447-a36d-8ea772095ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:51.303332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c12fc036-6026-4447-a36d-8ea772095ef4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:51.394820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fc036-6026-4447-a36d-8ea772095ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:51.395350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 701/1398] 10.222.0.20 () {58 vars in 1040 bytes} [Fri Sep 16 05:27:51 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:27:51.396435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fc036-6026-4447-a36d-8ea772095ef4 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:51.405779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116ee64-e16e-417b-ad80-daa55af81c8f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:51.415269 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 698/1399] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:51.415536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116ee64-e16e-417b-ad80-daa55af81c8f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:51.448456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:51.540150 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb6700-4961-4a22-9328-0af47bd722e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:51.540768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb6700-4961-4a22-9328-0af47bd722e3 service swift] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:51.541044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb6700-4961-4a22-9328-0af47bd722e3 service swift] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:51.541310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb6700-4961-4a22-9328-0af47bd722e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:51.543099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a0eb6700-4961-4a22-9328-0af47bd722e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:51.638035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb6700-4961-4a22-9328-0af47bd722e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:51.639797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb6700-4961-4a22-9328-0af47bd722e3 service swift] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:51.648846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 702/1400] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:27:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 16 05:27:53.691496 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974452-06c3-419f-97e4-1502a875aa22 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:53.692345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974452-06c3-419f-97e4-1502a875aa22 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:53.692345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974452-06c3-419f-97e4-1502a875aa22 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:53.693623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 699/1401] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:53.699902 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd0637-a139-4881-987e-888693aea639 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:53.700842 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd0637-a139-4881-987e-888693aea639 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:53.701185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd0637-a139-4881-987e-888693aea639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:53.769890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-50dd0637-a139-4881-987e-888693aea639 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:53.771153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-50dd0637-a139-4881-987e-888693aea639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:53.777901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:53.878669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 703/1402] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:54.171039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8974452-06c3-419f-97e4-1502a875aa22 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:54.172740 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d8974452-06c3-419f-97e4-1502a875aa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:54.244906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:54.334354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8974452-06c3-419f-97e4-1502a875aa22 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:54.462117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad2ba-9127-4445-9ad6-0ebef6ac8e6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:54.462765 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad2ba-9127-4445-9ad6-0ebef6ac8e6d service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:54.463078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad2ba-9127-4445-9ad6-0ebef6ac8e6d service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:54.463303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad2ba-9127-4445-9ad6-0ebef6ac8e6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:54.465131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-52aad2ba-9127-4445-9ad6-0ebef6ac8e6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:54.492625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:54.564271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aad2ba-9127-4445-9ad6-0ebef6ac8e6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:54.566021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aad2ba-9127-4445-9ad6-0ebef6ac8e6d service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:54.585866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 700/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:27:56.788198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7483e-3086-4b1c-acbc-714e5ebdbddc None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:56.788759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7483e-3086-4b1c-acbc-714e5ebdbddc None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:56.788759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7483e-3086-4b1c-acbc-714e5ebdbddc None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:56.790267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 704/1404] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:56.796291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fb747-c6a4-4cd8-b31b-e6f3141dd535 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:56.796291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fb747-c6a4-4cd8-b31b-e6f3141dd535 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:56.796291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fb747-c6a4-4cd8-b31b-e6f3141dd535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:56.903591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c54fb747-c6a4-4cd8-b31b-e6f3141dd535 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:27:56.905556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c54fb747-c6a4-4cd8-b31b-e6f3141dd535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:57.019520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 701/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:27:57.319020 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7483e-3086-4b1c-acbc-714e5ebdbddc None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:27:57.320542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-51b7483e-3086-4b1c-acbc-714e5ebdbddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:57.473882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:57.484871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7483e-3086-4b1c-acbc-714e5ebdbddc None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:27:57.612325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754a165-ae04-42b1-89e2-0d2255fda26a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:27:57.612930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a165-ae04-42b1-89e2-0d2255fda26a service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:57.613207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a165-ae04-42b1-89e2-0d2255fda26a service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:57.613476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a165-ae04-42b1-89e2-0d2255fda26a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:57.615110 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b754a165-ae04-42b1-89e2-0d2255fda26a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:27:57.715604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754a165-ae04-42b1-89e2-0d2255fda26a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:27:57.717205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754a165-ae04-42b1-89e2-0d2255fda26a service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:27:57.729955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:27:57.741743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 705/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:27:59.946646 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b062193-e76e-4632-8e63-8846b29af5f1 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:59.947418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b062193-e76e-4632-8e63-8846b29af5f1 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:59.947418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b062193-e76e-4632-8e63-8846b29af5f1 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:27:59.948709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 702/1407] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:27:59.954762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d024364-240f-4aea-ae70-413069aba49f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:27:59.955194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d024364-240f-4aea-ae70-413069aba49f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:27:59.955391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d024364-240f-4aea-ae70-413069aba49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:00.025797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-3d024364-240f-4aea-ae70-413069aba49f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:00.027065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3d024364-240f-4aea-ae70-413069aba49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:00.132551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 706/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:00.423278 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b062193-e76e-4632-8e63-8846b29af5f1 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:00.427691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6b062193-e76e-4632-8e63-8846b29af5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:00.427860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:00.588685 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b062193-e76e-4632-8e63-8846b29af5f1 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:00.667855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:00.712767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33453011-7e57-4155-95b7-287ab7bc1736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:00.713484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33453011-7e57-4155-95b7-287ab7bc1736 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:00.713823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33453011-7e57-4155-95b7-287ab7bc1736 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:00.714159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33453011-7e57-4155-95b7-287ab7bc1736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:00.715916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-33453011-7e57-4155-95b7-287ab7bc1736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:00.825334 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33453011-7e57-4155-95b7-287ab7bc1736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:00.828104 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33453011-7e57-4155-95b7-287ab7bc1736 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:00.848480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 703/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:10.130675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=67 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:10.845991 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=61 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:14.575326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb56550-69c2-4bb1-86aa-47eb84706225 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:14.575876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb56550-69c2-4bb1-86aa-47eb84706225 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:14.575982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb56550-69c2-4bb1-86aa-47eb84706225 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:14.577926 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 707/1410] 10.222.0.20 () {54 vars in 918 bytes} [Fri Sep 16 05:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:14.582819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd45ed-891d-4421-9b85-d618a5495611 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:14.583247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd45ed-891d-4421-9b85-d618a5495611 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:14.583349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd45ed-891d-4421-9b85-d618a5495611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:14.656389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c2fd45ed-891d-4421-9b85-d618a5495611 None None] MFA Rules not processed for user `8ef60b27f5f545aa8ea063009ec66eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:14.657580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c2fd45ed-891d-4421-9b85-d618a5495611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:14.763179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 704/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Sep 16 05:28:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:14.777759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5908219-0d01-4afd-b62f-d8fac2f70864 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:14.778025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5908219-0d01-4afd-b62f-d8fac2f70864 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:14.778300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5908219-0d01-4afd-b62f-d8fac2f70864 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:14.779652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 708/1412] 10.222.0.20 () {54 vars in 918 bytes} [Fri Sep 16 05:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:14.784815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c18a7-a2d8-4158-bfed-53f753e18e1e None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:14.785102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c18a7-a2d8-4158-bfed-53f753e18e1e None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:14.785372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c18a7-a2d8-4158-bfed-53f753e18e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:14.857883 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:14.860767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-908c18a7-a2d8-4158-bfed-53f753e18e1e None None] MFA Rules not processed for user `515e548efd984b87bca742e26eec162a`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:14.862494 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-908c18a7-a2d8-4158-bfed-53f753e18e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:14.977530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 705/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Sep 16 05:28:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:17.524127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57d231-66e2-4fcd-9d16-49ec9325e37e None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:17.524662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57d231-66e2-4fcd-9d16-49ec9325e37e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:17.524662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57d231-66e2-4fcd-9d16-49ec9325e37e None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:17.525991 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:17.531839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea070aa-d147-4bc1-812b-fac2d88dadd9 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:17.532272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea070aa-d147-4bc1-812b-fac2d88dadd9 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:17.532367 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea070aa-d147-4bc1-812b-fac2d88dadd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:17.597830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-cea070aa-d147-4bc1-812b-fac2d88dadd9 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:17.599163 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-cea070aa-d147-4bc1-812b-fac2d88dadd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:17.652473 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:17.694591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:17.981179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57d231-66e2-4fcd-9d16-49ec9325e37e None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:17.982822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6b57d231-66e2-4fcd-9d16-49ec9325e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:18.127104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57d231-66e2-4fcd-9d16-49ec9325e37e None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:18.197601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:18.240775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc25fa1-131b-4e4c-be8d-f5766b294efd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:18.241337 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc25fa1-131b-4e4c-be8d-f5766b294efd service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:18.241614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc25fa1-131b-4e4c-be8d-f5766b294efd service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:18.241882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc25fa1-131b-4e4c-be8d-f5766b294efd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:18.243543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-7cc25fa1-131b-4e4c-be8d-f5766b294efd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:18.332631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc25fa1-131b-4e4c-be8d-f5766b294efd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:18.334237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc25fa1-131b-4e4c-be8d-f5766b294efd service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:18.351673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 710/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:19.474679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2625870-1d6c-48dc-afae-125115f26215 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:19.475237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2625870-1d6c-48dc-afae-125115f26215 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:19.475237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2625870-1d6c-48dc-afae-125115f26215 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:19.476541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 05:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:19.482611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6203d-dc6c-46b9-8c6e-62be26d4033b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:19.483069 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6203d-dc6c-46b9-8c6e-62be26d4033b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:19.483203 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6203d-dc6c-46b9-8c6e-62be26d4033b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:19.557280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-85d6203d-dc6c-46b9-8c6e-62be26d4033b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:19.558595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-85d6203d-dc6c-46b9-8c6e-62be26d4033b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:19.585552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:19.652792 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 05:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:19.801391 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2625870-1d6c-48dc-afae-125115f26215 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:19.802960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e2625870-1d6c-48dc-afae-125115f26215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:19.949467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2625870-1d6c-48dc-afae-125115f26215 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:19.990099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:20.063999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e1f64-15b5-4001-a86d-814bd8c06c09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:20.064607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e1f64-15b5-4001-a86d-814bd8c06c09 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:20.064884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e1f64-15b5-4001-a86d-814bd8c06c09 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:20.065154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e1f64-15b5-4001-a86d-814bd8c06c09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:20.066791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b11e1f64-15b5-4001-a86d-814bd8c06c09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:20.154226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e1f64-15b5-4001-a86d-814bd8c06c09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:20.155879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e1f64-15b5-4001-a86d-814bd8c06c09 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:20.173782 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 708/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:21.310190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb0db7-96de-4de2-aec3-f8599847b808 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:21.310733 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb0db7-96de-4de2-aec3-f8599847b808 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:21.310841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb0db7-96de-4de2-aec3-f8599847b808 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:21.312600 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 05:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:21.318705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7cd8c-2c71-4ca6-83fa-df7ec35dd9ba None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:21.319172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7cd8c-2c71-4ca6-83fa-df7ec35dd9ba None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:21.319270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7cd8c-2c71-4ca6-83fa-df7ec35dd9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:21.371732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:21.393951 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-75a7cd8c-2c71-4ca6-83fa-df7ec35dd9ba None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:21.395173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-75a7cd8c-2c71-4ca6-83fa-df7ec35dd9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:21.488912 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 05:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:21.646869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb0db7-96de-4de2-aec3-f8599847b808 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:21.648399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e8eb0db7-96de-4de2-aec3-f8599847b808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:21.794276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb0db7-96de-4de2-aec3-f8599847b808 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:21.806923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:21.910750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f7d71-736a-4628-be57-20cb69c05cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:21.911359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f7d71-736a-4628-be57-20cb69c05cf5 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:21.911632 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f7d71-736a-4628-be57-20cb69c05cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:21.911901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f7d71-736a-4628-be57-20cb69c05cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:21.913497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5b3f7d71-736a-4628-be57-20cb69c05cf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:22.002664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f7d71-736a-4628-be57-20cb69c05cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:22.004278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f7d71-736a-4628-be57-20cb69c05cf5 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:22.021513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 713/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:23.131850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a29da-e325-44ed-abff-5664ea46f16f None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:23.132369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a29da-e325-44ed-abff-5664ea46f16f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:23.132369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a29da-e325-44ed-abff-5664ea46f16f None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:23.133655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 05:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:23.140440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19975b3c-a89b-4f89-9211-2942cfdd35e3 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:23.140906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19975b3c-a89b-4f89-9211-2942cfdd35e3 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:23.141004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19975b3c-a89b-4f89-9211-2942cfdd35e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:23.160480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:23.215770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-19975b3c-a89b-4f89-9211-2942cfdd35e3 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:23.216968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-19975b3c-a89b-4f89-9211-2942cfdd35e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:23.312603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 05:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:23.460941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a29da-e325-44ed-abff-5664ea46f16f None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:23.462386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-fc1a29da-e325-44ed-abff-5664ea46f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:23.569460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:23.604721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a29da-e325-44ed-abff-5664ea46f16f None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:23.714109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079779d0-31c7-46a8-ae62-7dd51eac7213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:23.714737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079779d0-31c7-46a8-ae62-7dd51eac7213 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:23.715009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079779d0-31c7-46a8-ae62-7dd51eac7213 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:23.715273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079779d0-31c7-46a8-ae62-7dd51eac7213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:23.716858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-079779d0-31c7-46a8-ae62-7dd51eac7213 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:23.791610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:23.805836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079779d0-31c7-46a8-ae62-7dd51eac7213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:23.807498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079779d0-31c7-46a8-ae62-7dd51eac7213 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:23.825421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 711/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:24.946430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a0c77-b245-4706-992d-bf8100b5a45d None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:24.946995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a0c77-b245-4706-992d-bf8100b5a45d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:24.946995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a0c77-b245-4706-992d-bf8100b5a45d None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:24.948516 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 05:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:24.954743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f903d4-5325-4e8a-a1f8-83096a92e8e8 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:24.955141 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f903d4-5325-4e8a-a1f8-83096a92e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:24.955291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f903d4-5325-4e8a-a1f8-83096a92e8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:25.029486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-b6f903d4-5325-4e8a-a1f8-83096a92e8e8 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:25.031201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b6f903d4-5325-4e8a-a1f8-83096a92e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:25.126550 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 05:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:25.278949 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a0c77-b245-4706-992d-bf8100b5a45d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:25.281196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-612a0c77-b245-4706-992d-bf8100b5a45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:25.364807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:25.425953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a0c77-b245-4706-992d-bf8100b5a45d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:25.535939 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5e7c6-8469-492d-a809-28ebfb98bb9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:25.536468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5e7c6-8469-492d-a809-28ebfb98bb9f service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:25.536745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5e7c6-8469-492d-a809-28ebfb98bb9f service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:25.537012 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5e7c6-8469-492d-a809-28ebfb98bb9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:25.538730 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-92f5e7c6-8469-492d-a809-28ebfb98bb9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:25.597185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:25.636625 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5e7c6-8469-492d-a809-28ebfb98bb9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:25.638219 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5e7c6-8469-492d-a809-28ebfb98bb9f service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:25.656974 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 716/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:26.727202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967782ea-cc2d-4125-bcc8-095548acc4bc None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:26.727734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967782ea-cc2d-4125-bcc8-095548acc4bc None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:26.727843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967782ea-cc2d-4125-bcc8-095548acc4bc None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:26.729205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 05:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:26.736061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c40d9-4af0-4d02-91ec-dbddd1396f4d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:26.736507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c40d9-4af0-4d02-91ec-dbddd1396f4d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:26.736612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c40d9-4af0-4d02-91ec-dbddd1396f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:26.810499 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-fa2c40d9-4af0-4d02-91ec-dbddd1396f4d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:26.811748 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-fa2c40d9-4af0-4d02-91ec-dbddd1396f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:26.906837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 05:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:27.057417 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967782ea-cc2d-4125-bcc8-095548acc4bc None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:27.059003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-967782ea-cc2d-4125-bcc8-095548acc4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:27.107855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:27.203787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967782ea-cc2d-4125-bcc8-095548acc4bc None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:27.315525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6e02e-f1e4-4637-8c52-9c0d1c6b0050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:27.316053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e02e-f1e4-4637-8c52-9c0d1c6b0050 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:27.316324 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e02e-f1e4-4637-8c52-9c0d1c6b0050 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:27.316593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e02e-f1e4-4637-8c52-9c0d1c6b0050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:27.318176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9af6e02e-f1e4-4637-8c52-9c0d1c6b0050 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:27.325150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:27.407603 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6e02e-f1e4-4637-8c52-9c0d1c6b0050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:27.409199 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6e02e-f1e4-4637-8c52-9c0d1c6b0050 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:27.426935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 714/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:28.492422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb22a5-f841-47f0-91df-5b3cd48c6046 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:28.492996 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb22a5-f841-47f0-91df-5b3cd48c6046 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:28.492996 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb22a5-f841-47f0-91df-5b3cd48c6046 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:28.494363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 05:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:28.500692 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb007c8-baa8-4bd5-beb9-a80b1555f9d4 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:28.501156 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb007c8-baa8-4bd5-beb9-a80b1555f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:28.501261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb007c8-baa8-4bd5-beb9-a80b1555f9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:28.575594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-6eb007c8-baa8-4bd5-beb9-a80b1555f9d4 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:28.576805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6eb007c8-baa8-4bd5-beb9-a80b1555f9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:28.643883 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:28.673262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 05:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:28.824601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb22a5-f841-47f0-91df-5b3cd48c6046 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:28.826128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-dcdb22a5-f841-47f0-91df-5b3cd48c6046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:28.843771 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:28.975140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb22a5-f841-47f0-91df-5b3cd48c6046 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:29.059674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:29.086086 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03b0cc-db96-4bb7-af83-01c35a143ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:29.086656 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03b0cc-db96-4bb7-af83-01c35a143ffd service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:29.086934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03b0cc-db96-4bb7-af83-01c35a143ffd service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:29.087201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03b0cc-db96-4bb7-af83-01c35a143ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:29.088799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-bd03b0cc-db96-4bb7-af83-01c35a143ffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:29.176407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03b0cc-db96-4bb7-af83-01c35a143ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:29.177993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03b0cc-db96-4bb7-af83-01c35a143ffd service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:29.195151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 719/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:30.242037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058b895-9cb6-4723-97de-5a9db8e6e8fe None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:30.242495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058b895-9cb6-4723-97de-5a9db8e6e8fe None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:30.242644 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058b895-9cb6-4723-97de-5a9db8e6e8fe None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:30.243973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 05:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:30.250322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508a8e5-2644-4af7-a279-d007641ba2a6 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:30.250784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508a8e5-2644-4af7-a279-d007641ba2a6 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:30.250881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508a8e5-2644-4af7-a279-d007641ba2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:30.326374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-0508a8e5-2644-4af7-a279-d007641ba2a6 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:30.328216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0508a8e5-2644-4af7-a279-d007641ba2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:30.367852 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:30.422889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 05:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:30.574310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058b895-9cb6-4723-97de-5a9db8e6e8fe None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:30.575850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d058b895-9cb6-4723-97de-5a9db8e6e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:30.719009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058b895-9cb6-4723-97de-5a9db8e6e8fe None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:30.772448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:30.834081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6ae0d-3546-4388-82f0-f8c203e26533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:30.834645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ae0d-3546-4388-82f0-f8c203e26533 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:30.834924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ae0d-3546-4388-82f0-f8c203e26533 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:30.835194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ae0d-3546-4388-82f0-f8c203e26533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:30.836811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4bf6ae0d-3546-4388-82f0-f8c203e26533 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:30.926306 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6ae0d-3546-4388-82f0-f8c203e26533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:30.927924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6ae0d-3546-4388-82f0-f8c203e26533 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:30.946020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 717/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:31.996303 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27219e6e-85bb-4e6c-a008-674961c94ac0 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:31.996810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27219e6e-85bb-4e6c-a008-674961c94ac0 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:31.996810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27219e6e-85bb-4e6c-a008-674961c94ac0 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:31.998168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 05:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:32.004509 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901c4c7-c70b-48f5-b76a-e39520a264de None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:32.004967 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901c4c7-c70b-48f5-b76a-e39520a264de None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:32.005095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901c4c7-c70b-48f5-b76a-e39520a264de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:32.079923 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-1901c4c7-c70b-48f5-b76a-e39520a264de None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:32.081155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1901c4c7-c70b-48f5-b76a-e39520a264de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:32.083272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:32.176730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 05:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:32.326972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27219e6e-85bb-4e6c-a008-674961c94ac0 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:32.328999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-27219e6e-85bb-4e6c-a008-674961c94ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:32.470940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27219e6e-85bb-4e6c-a008-674961c94ac0 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:32.496995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:32.581172 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027480b2-8249-4a74-93e6-237ec2f429b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:32.581698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027480b2-8249-4a74-93e6-237ec2f429b3 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:32.581975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027480b2-8249-4a74-93e6-237ec2f429b3 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:32.582244 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027480b2-8249-4a74-93e6-237ec2f429b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:32.584153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-027480b2-8249-4a74-93e6-237ec2f429b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:32.670050 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027480b2-8249-4a74-93e6-237ec2f429b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:32.671755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027480b2-8249-4a74-93e6-237ec2f429b3 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:32.689506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 722/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:34.746584 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a629eb-5cc7-4d68-bf40-6ccdc25b6d66 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:34.747182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a629eb-5cc7-4d68-bf40-6ccdc25b6d66 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:34.747182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a629eb-5cc7-4d68-bf40-6ccdc25b6d66 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:34.748476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:34.754279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609f1eb-6186-4205-bc6c-cf555667e9bf None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:34.754751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609f1eb-6186-4205-bc6c-cf555667e9bf None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:34.754870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609f1eb-6186-4205-bc6c-cf555667e9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:34.794742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:34.820106 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b609f1eb-6186-4205-bc6c-cf555667e9bf None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:34.821294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b609f1eb-6186-4205-bc6c-cf555667e9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:34.915619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:35.210827 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a629eb-5cc7-4d68-bf40-6ccdc25b6d66 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:35.212366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b2a629eb-5cc7-4d68-bf40-6ccdc25b6d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:35.319293 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a629eb-5cc7-4d68-bf40-6ccdc25b6d66 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:35.351942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:35.392565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ce7bc-276c-4f74-a532-243a7ac82e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:35.393168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ce7bc-276c-4f74-a532-243a7ac82e9b service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:35.393447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ce7bc-276c-4f74-a532-243a7ac82e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:35.393718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ce7bc-276c-4f74-a532-243a7ac82e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:35.395346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-114ce7bc-276c-4f74-a532-243a7ac82e9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:35.501946 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ce7bc-276c-4f74-a532-243a7ac82e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:35.503321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ce7bc-276c-4f74-a532-243a7ac82e9b service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:35.521121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 720/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:37.786938 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d6060-d4ab-417a-98dd-61ff26b848d6 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:37.787489 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d6060-d4ab-417a-98dd-61ff26b848d6 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:37.787489 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d6060-d4ab-417a-98dd-61ff26b848d6 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:37.788806 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:37.794015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9e03-46e6-4a85-a834-6ee578fc0eb7 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:37.794400 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9e03-46e6-4a85-a834-6ee578fc0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:37.794591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9e03-46e6-4a85-a834-6ee578fc0eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:37.859683 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-cddb9e03-46e6-4a85-a834-6ee578fc0eb7 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:37.860891 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-cddb9e03-46e6-4a85-a834-6ee578fc0eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:37.873321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:37.958585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:38.240683 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d6060-d4ab-417a-98dd-61ff26b848d6 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:38.242235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-055d6060-d4ab-417a-98dd-61ff26b848d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:38.344190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d6060-d4ab-417a-98dd-61ff26b848d6 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:38.356792 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:38.417325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463923a1-de25-47ca-8455-9c7346900c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:38.417919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463923a1-de25-47ca-8455-9c7346900c62 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:38.418221 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463923a1-de25-47ca-8455-9c7346900c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:38.418488 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463923a1-de25-47ca-8455-9c7346900c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:38.420106 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-463923a1-de25-47ca-8455-9c7346900c62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:38.526381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463923a1-de25-47ca-8455-9c7346900c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:38.527876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463923a1-de25-47ca-8455-9c7346900c62 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:38.545860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 725/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:41.099517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaff23-c033-4d1b-af78-1161c02126b7 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:41.100083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaff23-c033-4d1b-af78-1161c02126b7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:41.100083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaff23-c033-4d1b-af78-1161c02126b7 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:41.101409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:41.106589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e3799-885e-44ff-88e6-96528179fc76 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:41.107039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e3799-885e-44ff-88e6-96528179fc76 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:41.107149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e3799-885e-44ff-88e6-96528179fc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:41.154910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:41.175083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-ce8e3799-885e-44ff-88e6-96528179fc76 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:41.176327 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ce8e3799-885e-44ff-88e6-96528179fc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:41.276294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:41.557002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaff23-c033-4d1b-af78-1161c02126b7 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:41.558587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-87aaff23-c033-4d1b-af78-1161c02126b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:41.663461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaff23-c033-4d1b-af78-1161c02126b7 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:41.712043 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:41.746961 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0767d-5594-438f-9b0b-855a4c5e5853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:41.747567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0767d-5594-438f-9b0b-855a4c5e5853 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:41.747845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0767d-5594-438f-9b0b-855a4c5e5853 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:41.748112 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0767d-5594-438f-9b0b-855a4c5e5853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:41.750193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-13d0767d-5594-438f-9b0b-855a4c5e5853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:41.856965 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0767d-5594-438f-9b0b-855a4c5e5853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:41.858311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0767d-5594-438f-9b0b-855a4c5e5853 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:41.876316 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 723/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:44.204302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aae221-ea6d-4344-9000-09301f0540b6 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:44.204869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aae221-ea6d-4344-9000-09301f0540b6 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:44.204869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aae221-ea6d-4344-9000-09301f0540b6 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:44.206221 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:28:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:44.211433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb76874-5f99-4e3e-a336-8a83a23f78b0 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:44.211822 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb76874-5f99-4e3e-a336-8a83a23f78b0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:44.211984 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb76874-5f99-4e3e-a336-8a83a23f78b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:44.277076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-dbb76874-5f99-4e3e-a336-8a83a23f78b0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:44.278271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-dbb76874-5f99-4e3e-a336-8a83a23f78b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:44.298487 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:44.374576 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:44.656602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aae221-ea6d-4344-9000-09301f0540b6 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:44.658143 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-44aae221-ea6d-4344-9000-09301f0540b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:44.759642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aae221-ea6d-4344-9000-09301f0540b6 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:44.779429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:44.833136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d50111-df28-45a9-868d-6765139e3dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:44.833732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d50111-df28-45a9-868d-6765139e3dae service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:44.834009 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d50111-df28-45a9-868d-6765139e3dae service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:44.834278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d50111-df28-45a9-868d-6765139e3dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:44.835911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-64d50111-df28-45a9-868d-6765139e3dae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:44.942732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d50111-df28-45a9-868d-6765139e3dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:44.944167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d50111-df28-45a9-868d-6765139e3dae service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:44.961862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 728/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:47.134769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed723851-928d-4e68-8f57-45585ce1defd None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:47.135303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed723851-928d-4e68-8f57-45585ce1defd None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:47.135303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed723851-928d-4e68-8f57-45585ce1defd None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:47.136699 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:47.142227 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb99279-4c0e-456a-8bb4-d3bcf94d7e56 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:47.142676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb99279-4c0e-456a-8bb4-d3bcf94d7e56 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:47.142888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb99279-4c0e-456a-8bb4-d3bcf94d7e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:47.206074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:47.208887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-acb99279-4c0e-456a-8bb4-d3bcf94d7e56 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:47.210671 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-acb99279-4c0e-456a-8bb4-d3bcf94d7e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:47.307193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:47.594834 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed723851-928d-4e68-8f57-45585ce1defd None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:47.596421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ed723851-928d-4e68-8f57-45585ce1defd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:47.697822 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed723851-928d-4e68-8f57-45585ce1defd None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:47.748018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:47.773423 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd3e84-345e-4cdf-81e2-ab2e90d966f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:47.774018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3e84-345e-4cdf-81e2-ab2e90d966f1 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:47.774292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3e84-345e-4cdf-81e2-ab2e90d966f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:47.774583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3e84-345e-4cdf-81e2-ab2e90d966f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:47.776172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5bfd3e84-345e-4cdf-81e2-ab2e90d966f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:47.882116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd3e84-345e-4cdf-81e2-ab2e90d966f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:47.883495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd3e84-345e-4cdf-81e2-ab2e90d966f1 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:47.901843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 726/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:50.086801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a878b-57f4-4c17-b6ac-aaaa1164db41 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:50.087377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a878b-57f4-4c17-b6ac-aaaa1164db41 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:50.087377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a878b-57f4-4c17-b6ac-aaaa1164db41 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:50.088694 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:28:50.094407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5b196-7435-4c80-a144-a955aea1dc9b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:50.094833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5b196-7435-4c80-a144-a955aea1dc9b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:50.094988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5b196-7435-4c80-a144-a955aea1dc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:50.159521 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f7f5b196-7435-4c80-a144-a955aea1dc9b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:50.160729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f7f5b196-7435-4c80-a144-a955aea1dc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:50.189205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:50.256162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:50.540015 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a878b-57f4-4c17-b6ac-aaaa1164db41 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:50.541548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b33a878b-57f4-4c17-b6ac-aaaa1164db41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:50.643697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a878b-57f4-4c17-b6ac-aaaa1164db41 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:50.670869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:50.715514 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674ed04-c331-4e50-b005-aac9ca914a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:50.716104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674ed04-c331-4e50-b005-aac9ca914a39 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:50.716378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674ed04-c331-4e50-b005-aac9ca914a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:50.716644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674ed04-c331-4e50-b005-aac9ca914a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:50.718317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5674ed04-c331-4e50-b005-aac9ca914a39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:50.827274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674ed04-c331-4e50-b005-aac9ca914a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:50.829300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674ed04-c331-4e50-b005-aac9ca914a39 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:50.847002 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 731/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:53.075732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6c2c7-ce86-4a83-8830-c131a7e78aef None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:53.076312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6c2c7-ce86-4a83-8830-c131a7e78aef None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:53.076312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6c2c7-ce86-4a83-8830-c131a7e78aef None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:53.077660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:53.083086 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9b72d-1f28-419c-b86f-276c2e512126 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:53.083507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9b72d-1f28-419c-b86f-276c2e512126 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:53.083628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9b72d-1f28-419c-b86f-276c2e512126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:53.147445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-efd9b72d-1f28-419c-b86f-276c2e512126 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:53.148574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-efd9b72d-1f28-419c-b86f-276c2e512126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:53.157583 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:53.245578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:53.528850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6c2c7-ce86-4a83-8830-c131a7e78aef None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:53.530404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e2d6c2c7-ce86-4a83-8830-c131a7e78aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:53.633760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6c2c7-ce86-4a83-8830-c131a7e78aef None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:53.689349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:53.707624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93d949-435d-4e12-be09-4392510e9d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:53.708222 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d949-435d-4e12-be09-4392510e9d88 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:53.708497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d949-435d-4e12-be09-4392510e9d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:53.708767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d949-435d-4e12-be09-4392510e9d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:53.710341 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-bf93d949-435d-4e12-be09-4392510e9d88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:53.936657 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93d949-435d-4e12-be09-4392510e9d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:53.938147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93d949-435d-4e12-be09-4392510e9d88 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:53.956685 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 729/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:56.176673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263a706-8294-4d2a-8344-0c226202e531 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:56.177239 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263a706-8294-4d2a-8344-0c226202e531 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:56.177239 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263a706-8294-4d2a-8344-0c226202e531 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:56.178583 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:56.183955 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb105283-2ca0-495a-a638-e3cddb24e89c None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:56.184380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb105283-2ca0-495a-a638-e3cddb24e89c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:56.184494 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb105283-2ca0-495a-a638-e3cddb24e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:56.252459 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-bb105283-2ca0-495a-a638-e3cddb24e89c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:56.253671 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-bb105283-2ca0-495a-a638-e3cddb24e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:56.290260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:56.348519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:56.631593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263a706-8294-4d2a-8344-0c226202e531 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:56.633143 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2263a706-8294-4d2a-8344-0c226202e531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:56.745749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263a706-8294-4d2a-8344-0c226202e531 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:56.784753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:56.820395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70238ad4-992a-4aad-846f-e262b224aead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:56.821001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238ad4-992a-4aad-846f-e262b224aead service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:56.821274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238ad4-992a-4aad-846f-e262b224aead service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:56.821539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238ad4-992a-4aad-846f-e262b224aead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:56.823164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-70238ad4-992a-4aad-846f-e262b224aead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:56.929779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70238ad4-992a-4aad-846f-e262b224aead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:56.931191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70238ad4-992a-4aad-846f-e262b224aead service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:56.948483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 734/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:28:59.116396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee4477-6a78-4a52-9b47-cce563f3b776 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:59.116961 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee4477-6a78-4a52-9b47-cce563f3b776 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:59.116961 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee4477-6a78-4a52-9b47-cce563f3b776 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:59.118239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:28:59.123658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f118494-d706-4aa9-b5a7-120d157fc706 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:59.124075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f118494-d706-4aa9-b5a7-120d157fc706 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:59.124210 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f118494-d706-4aa9-b5a7-120d157fc706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:59.189389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-6f118494-d706-4aa9-b5a7-120d157fc706 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:28:59.190626 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6f118494-d706-4aa9-b5a7-120d157fc706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:59.208784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:59.286770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:28:59.569234 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee4477-6a78-4a52-9b47-cce563f3b776 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:28:59.570793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3aee4477-6a78-4a52-9b47-cce563f3b776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:59.670278 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee4477-6a78-4a52-9b47-cce563f3b776 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:28:59.735291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:28:59.742320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3283bd8-5160-46d5-b10b-58f5b9e949ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:28:59.742964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283bd8-5160-46d5-b10b-58f5b9e949ee service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:28:59.743238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283bd8-5160-46d5-b10b-58f5b9e949ee service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:28:59.743527 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283bd8-5160-46d5-b10b-58f5b9e949ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:28:59.745164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f3283bd8-5160-46d5-b10b-58f5b9e949ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:28:59.852982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3283bd8-5160-46d5-b10b-58f5b9e949ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:28:59.854330 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3283bd8-5160-46d5-b10b-58f5b9e949ee service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:28:59.871726 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 732/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:29:02.024364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418caab-751f-4016-b5c0-9cff25a7ec9d None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:02.024866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418caab-751f-4016-b5c0-9cff25a7ec9d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:02.024866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418caab-751f-4016-b5c0-9cff25a7ec9d None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:02.026164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:29:02.031918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb329a-3c3a-43d6-bd1a-204e4aa1e734 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:02.032299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb329a-3c3a-43d6-bd1a-204e4aa1e734 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:02.032459 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb329a-3c3a-43d6-bd1a-204e4aa1e734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:02.097350 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-21bb329a-3c3a-43d6-bd1a-204e4aa1e734 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:29:02.098584 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-21bb329a-3c3a-43d6-bd1a-204e4aa1e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:02.145650 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:02.193315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:29:02.480364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418caab-751f-4016-b5c0-9cff25a7ec9d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:29:02.481922 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8418caab-751f-4016-b5c0-9cff25a7ec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:02.584453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418caab-751f-4016-b5c0-9cff25a7ec9d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:29:02.632753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:02.658124 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e51d40-b0dc-4cd7-a73b-5d5f1e562e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:29:02.658761 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e51d40-b0dc-4cd7-a73b-5d5f1e562e54 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:02.659062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e51d40-b0dc-4cd7-a73b-5d5f1e562e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:02.659331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e51d40-b0dc-4cd7-a73b-5d5f1e562e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:02.660925 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e9e51d40-b0dc-4cd7-a73b-5d5f1e562e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:02.767797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e51d40-b0dc-4cd7-a73b-5d5f1e562e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:29:02.769202 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e51d40-b0dc-4cd7-a73b-5d5f1e562e54 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:29:02.787379 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 737/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:29:12.191807 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=22 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:12.785123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=66 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:22.705804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebdc17-b73c-490b-9cc7-06aa12afed4a None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:22.706365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebdc17-b73c-490b-9cc7-06aa12afed4a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:22.706365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebdc17-b73c-490b-9cc7-06aa12afed4a None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:22.708369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 734/1471] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:29:22.713803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05843d-acd9-439f-a4e6-3220096a533c None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:22.714249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05843d-acd9-439f-a4e6-3220096a533c None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:22.714369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05843d-acd9-439f-a4e6-3220096a533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:22.779681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-4d05843d-acd9-439f-a4e6-3220096a533c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:29:22.781512 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4d05843d-acd9-439f-a4e6-3220096a533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:22.878185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 738/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:29:23.180729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5d7b2-9d3a-4eb0-bdfd-299f4f58cfa7 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:23.181008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5d7b2-9d3a-4eb0-bdfd-299f4f58cfa7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:23.181283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5d7b2-9d3a-4eb0-bdfd-299f4f58cfa7 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:23.182624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 735/1473] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 16 05:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:29:23.188274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ea888-d265-437d-932f-6e4d206887c2 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:23.188558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ea888-d265-437d-932f-6e4d206887c2 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:23.188826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ea888-d265-437d-932f-6e4d206887c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:23.263471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-ee4ea888-d265-437d-932f-6e4d206887c2 None None] MFA Rules not processed for user `20d8e253a72c44f7a5a986f981660df2`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:29:23.264677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ee4ea888-d265-437d-932f-6e4d206887c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:23.284580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:23.339104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 739/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 16 05:29:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:29:23.346780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5d7b2-9d3a-4eb0-bdfd-299f4f58cfa7 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:29:23.348298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e2f5d7b2-9d3a-4eb0-bdfd-299f4f58cfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:23.448308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5d7b2-9d3a-4eb0-bdfd-299f4f58cfa7 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:29:23.519994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bc6cb-e903-4cd5-8b10-091960fe0d67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20d8e253a72c44f7a5a986f981660df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:29:23.520586 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bc6cb-e903-4cd5-8b10-091960fe0d67 service glance] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:23.520860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bc6cb-e903-4cd5-8b10-091960fe0d67 service glance] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:23.521125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bc6cb-e903-4cd5-8b10-091960fe0d67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:23.522741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-657bc6cb-e903-4cd5-8b10-091960fe0d67 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:23.576588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:23.631305 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bc6cb-e903-4cd5-8b10-091960fe0d67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:29:23.632733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bc6cb-e903-4cd5-8b10-091960fe0d67 service glance] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:29:23.650419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 736/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:29:25.879682 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e383f6-40a0-49af-a419-2b4e94792137 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:25.880237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e383f6-40a0-49af-a419-2b4e94792137 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:25.880237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e383f6-40a0-49af-a419-2b4e94792137 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:25.881551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 740/1476] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:29:25.886907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc500c7-63bf-45ab-8ad4-cfaf686de520 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:25.887349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc500c7-63bf-45ab-8ad4-cfaf686de520 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:25.887458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc500c7-63bf-45ab-8ad4-cfaf686de520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:25.953498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8cc500c7-63bf-45ab-8ad4-cfaf686de520 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:29:25.954724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8cc500c7-63bf-45ab-8ad4-cfaf686de520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:26.050664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 737/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:29:26.354657 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e383f6-40a0-49af-a419-2b4e94792137 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:29:26.356188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-27e383f6-40a0-49af-a419-2b4e94792137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:26.483471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e383f6-40a0-49af-a419-2b4e94792137 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:29:26.542813 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:26.588837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4b0e7-b365-48d8-b724-ceb015dad525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:29:26.589455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4b0e7-b365-48d8-b724-ceb015dad525 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:26.589736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4b0e7-b365-48d8-b724-ceb015dad525 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:26.590004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4b0e7-b365-48d8-b724-ceb015dad525 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:26.590669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4b0e7-b365-48d8-b724-ceb015dad525 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:29:26.592474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: WARNING py.warnings [None req-3cb4b0e7-b365-48d8-b724-ceb015dad525 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:29:26.592474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: warnings.warn(msg) Sep 16 05:29:26.592474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: Sep 16 05:29:26.593628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4b0e7-b365-48d8-b724-ceb015dad525 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:29:26.612603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 741/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 05:29:26 2022] GET /identity/v3/projects => generated 2553 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:29:28.785821 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6047741-b0e5-40a2-8eb7-75909886775e None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:28.786396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6047741-b0e5-40a2-8eb7-75909886775e None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:28.786396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6047741-b0e5-40a2-8eb7-75909886775e None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:28.787713 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 738/1479] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:29:28.794314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2713d-f977-41b5-b3ff-d6f124ed9554 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:28.794830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2713d-f977-41b5-b3ff-d6f124ed9554 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:28.794930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2713d-f977-41b5-b3ff-d6f124ed9554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:28.860019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-a5e2713d-f977-41b5-b3ff-d6f124ed9554 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:29:28.861219 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a5e2713d-f977-41b5-b3ff-d6f124ed9554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:28.957143 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 742/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:29:29.250844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6047741-b0e5-40a2-8eb7-75909886775e None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:29:29.252401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d6047741-b0e5-40a2-8eb7-75909886775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:29.262392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:29.395182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6047741-b0e5-40a2-8eb7-75909886775e None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:29:29.474264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:29.506008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be6924-b472-4a54-a45d-fa4a3a0509b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:29:29.506570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be6924-b472-4a54-a45d-fa4a3a0509b7 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:29.506849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be6924-b472-4a54-a45d-fa4a3a0509b7 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:29.507117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be6924-b472-4a54-a45d-fa4a3a0509b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:29.508705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-86be6924-b472-4a54-a45d-fa4a3a0509b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:29.597019 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be6924-b472-4a54-a45d-fa4a3a0509b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:29:29.598610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be6924-b472-4a54-a45d-fa4a3a0509b7 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:29:29.616044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 739/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:29:31.934108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b47b2-8aee-4208-a925-cb1c0af938aa None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:31.934676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b47b2-8aee-4208-a925-cb1c0af938aa None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:31.934801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b47b2-8aee-4208-a925-cb1c0af938aa None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:31.936058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 743/1482] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:29:31.941252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f363f-6014-438a-bff0-1e445ba71ecb None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:31.941627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f363f-6014-438a-bff0-1e445ba71ecb None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:31.941786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f363f-6014-438a-bff0-1e445ba71ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:32.007009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-695f363f-6014-438a-bff0-1e445ba71ecb None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:29:32.008128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-695f363f-6014-438a-bff0-1e445ba71ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:32.054046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:32.104303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 740/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:29:32.386671 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b47b2-8aee-4208-a925-cb1c0af938aa None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:29:32.388223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-af0b47b2-8aee-4208-a925-cb1c0af938aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:32.412441 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:32.491257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b47b2-8aee-4208-a925-cb1c0af938aa None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:29:32.566121 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823e968-981a-4842-99da-930e5768dfcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:29:32.566759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823e968-981a-4842-99da-930e5768dfcd service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:32.567042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823e968-981a-4842-99da-930e5768dfcd service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:32.567309 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823e968-981a-4842-99da-930e5768dfcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:32.568932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a823e968-981a-4842-99da-930e5768dfcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:32.641979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:32.675454 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823e968-981a-4842-99da-930e5768dfcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:29:32.676886 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823e968-981a-4842-99da-930e5768dfcd service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:29:32.694644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 744/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:29:34.882239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68c10-270f-45a0-8203-f99c9d490983 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:34.882925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68c10-270f-45a0-8203-f99c9d490983 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:34.882925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68c10-270f-45a0-8203-f99c9d490983 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:34.884198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 741/1485] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:29:34.889680 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcab01-203f-4511-b4f2-d5ba11eaa25c None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:34.890776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcab01-203f-4511-b4f2-d5ba11eaa25c None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:34.890886 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcab01-203f-4511-b4f2-d5ba11eaa25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:34.955301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-53bcab01-203f-4511-b4f2-d5ba11eaa25c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:29:34.956499 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-53bcab01-203f-4511-b4f2-d5ba11eaa25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:35.049623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 745/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:29:35.342793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d68c10-270f-45a0-8203-f99c9d490983 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:29:35.344363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d0d68c10-270f-45a0-8203-f99c9d490983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:35.446077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d68c10-270f-45a0-8203-f99c9d490983 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:29:35.516733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:35.518185 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06464d4-7c0d-4308-9e0f-2b0a8ef533af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:29:35.518831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06464d4-7c0d-4308-9e0f-2b0a8ef533af service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:35.519294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06464d4-7c0d-4308-9e0f-2b0a8ef533af service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:35.519604 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06464d4-7c0d-4308-9e0f-2b0a8ef533af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:35.521559 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-a06464d4-7c0d-4308-9e0f-2b0a8ef533af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:35.630086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06464d4-7c0d-4308-9e0f-2b0a8ef533af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:29:35.631560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06464d4-7c0d-4308-9e0f-2b0a8ef533af service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:29:35.649292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 742/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:29:37.945648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020a538-3d0e-4ffd-b497-872cd0048ee1 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:37.946202 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020a538-3d0e-4ffd-b497-872cd0048ee1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:37.946202 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020a538-3d0e-4ffd-b497-872cd0048ee1 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:37.949379 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 746/1488] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:29:37.953980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b79f99-1557-4158-88e5-546511406458 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:37.954440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b79f99-1557-4158-88e5-546511406458 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:37.954574 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b79f99-1557-4158-88e5-546511406458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:38.020444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-40b79f99-1557-4158-88e5-546511406458 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:29:38.021695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-40b79f99-1557-4158-88e5-546511406458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:38.073254 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:38.117473 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 743/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:29:38.403772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020a538-3d0e-4ffd-b497-872cd0048ee1 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:29:38.405337 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a020a538-3d0e-4ffd-b497-872cd0048ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:38.442012 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:38.510021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020a538-3d0e-4ffd-b497-872cd0048ee1 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:29:38.582196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91b95f-1ae6-4686-a68e-b892dbee618e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:29:38.582818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91b95f-1ae6-4686-a68e-b892dbee618e service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:38.583088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91b95f-1ae6-4686-a68e-b892dbee618e service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:38.583350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91b95f-1ae6-4686-a68e-b892dbee618e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:38.584933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ab91b95f-1ae6-4686-a68e-b892dbee618e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:38.661873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:38.690388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91b95f-1ae6-4686-a68e-b892dbee618e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:29:38.691861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91b95f-1ae6-4686-a68e-b892dbee618e service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:29:38.709793 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 747/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:29:41.105107 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45d237-fdc1-4ca2-ab0e-dc102cf9264f None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:41.105657 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45d237-fdc1-4ca2-ab0e-dc102cf9264f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:41.105774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45d237-fdc1-4ca2-ab0e-dc102cf9264f None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:41.107092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 744/1491] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 05:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:29:41.112963 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47f41b-8d45-4772-b5f9-e3a48999bd1f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:41.113380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47f41b-8d45-4772-b5f9-e3a48999bd1f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:41.113542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47f41b-8d45-4772-b5f9-e3a48999bd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:41.177736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-ff47f41b-8d45-4772-b5f9-e3a48999bd1f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:29:41.179027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ff47f41b-8d45-4772-b5f9-e3a48999bd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:41.278906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 748/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 05:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:29:41.570006 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45d237-fdc1-4ca2-ab0e-dc102cf9264f None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:29:41.571571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3b45d237-fdc1-4ca2-ab0e-dc102cf9264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:41.671668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45d237-fdc1-4ca2-ab0e-dc102cf9264f None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:29:41.744207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8a282-e9f0-4f0e-99d6-3087bdd861ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:29:41.744797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8a282-e9f0-4f0e-99d6-3087bdd861ec service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:29:41.745068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8a282-e9f0-4f0e-99d6-3087bdd861ec service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:29:41.745333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8a282-e9f0-4f0e-99d6-3087bdd861ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:29:41.746942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-22b8a282-e9f0-4f0e-99d6-3087bdd861ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:29:41.755697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:41.867289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8a282-e9f0-4f0e-99d6-3087bdd861ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:29:41.869251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8a282-e9f0-4f0e-99d6-3087bdd861ec service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:29:41.892506 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 745/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:29:51.277361 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=82 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:29:51.889540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=50 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:31:01.743579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cb6cb-87d3-4c71-97d1-a0011635d9ad None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:01.744168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cb6cb-87d3-4c71-97d1-a0011635d9ad None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:01.744168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cb6cb-87d3-4c71-97d1-a0011635d9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:01.819611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-228cb6cb-87d3-4c71-97d1-a0011635d9ad None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:31:01.820804 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-228cb6cb-87d3-4c71-97d1-a0011635d9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:01.914810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 749/1494] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:31:01.922783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63b86d-7f77-4aa3-bd2f-67bb5ef0a4b0 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:01.923352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63b86d-7f77-4aa3-bd2f-67bb5ef0a4b0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:01.923352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63b86d-7f77-4aa3-bd2f-67bb5ef0a4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:01.998166 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-4d63b86d-7f77-4aa3-bd2f-67bb5ef0a4b0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:31:01.999335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4d63b86d-7f77-4aa3-bd2f-67bb5ef0a4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:02.093983 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 746/1495] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:31:02.098534 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cb6cb-87d3-4c71-97d1-a0011635d9ad None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:31:02.099774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-228cb6cb-87d3-4c71-97d1-a0011635d9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:02.111492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cb6cb-87d3-4c71-97d1-a0011635d9ad None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:31:02.170568 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:31:02.204237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4a499-fbde-4100-82a4-c0e1c51c6280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:31:02.204835 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4a499-fbde-4100-82a4-c0e1c51c6280 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:02.205108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4a499-fbde-4100-82a4-c0e1c51c6280 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:02.205372 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4a499-fbde-4100-82a4-c0e1c51c6280 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:02.205997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4a499-fbde-4100-82a4-c0e1c51c6280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:31:02.206295 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4a499-fbde-4100-82a4-c0e1c51c6280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:31:02.207363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: WARNING py.warnings [None req-d3a4a499-fbde-4100-82a4-c0e1c51c6280 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:31:02.207363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: warnings.warn(msg) Sep 16 05:31:02.207363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: Sep 16 05:31:02.208234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4a499-fbde-4100-82a4-c0e1c51c6280 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:31:02.219052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 750/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:31:02.227501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63b86d-7f77-4aa3-bd2f-67bb5ef0a4b0 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:31:02.237718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63b86d-7f77-4aa3-bd2f-67bb5ef0a4b0 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:31:02.299376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:31:02.333431 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707adfb6-c133-41c6-8baa-5edb2955d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:31:02.334019 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707adfb6-c133-41c6-8baa-5edb2955d28f admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:02.334288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707adfb6-c133-41c6-8baa-5edb2955d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:02.334573 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707adfb6-c133-41c6-8baa-5edb2955d28f admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:02.335206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707adfb6-c133-41c6-8baa-5edb2955d28f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:31:02.336926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: WARNING py.warnings [None req-707adfb6-c133-41c6-8baa-5edb2955d28f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:31:02.336926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: warnings.warn(msg) Sep 16 05:31:02.336926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: Sep 16 05:31:02.338100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707adfb6-c133-41c6-8baa-5edb2955d28f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:31:02.392660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 747/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:31:02 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:31:02.396985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4a499-fbde-4100-82a4-c0e1c51c6280 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:31:02.398592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d3a4a499-fbde-4100-82a4-c0e1c51c6280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:02.431506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4a499-fbde-4100-82a4-c0e1c51c6280 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:31:02.523854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d79894-888d-47a7-a110-ce11b943ec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:31:02.524485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d79894-888d-47a7-a110-ce11b943ec19 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:02.524761 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d79894-888d-47a7-a110-ce11b943ec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:02.525040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d79894-888d-47a7-a110-ce11b943ec19 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:02.525665 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d79894-888d-47a7-a110-ce11b943ec19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:31:02.526744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: WARNING py.warnings [None req-61d79894-888d-47a7-a110-ce11b943ec19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:31:02.526744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: warnings.warn(msg) Sep 16 05:31:02.526744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: Sep 16 05:31:02.527940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d79894-888d-47a7-a110-ce11b943ec19 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:31:02.569843 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 751/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:31:02 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:31:02.573898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707adfb6-c133-41c6-8baa-5edb2955d28f admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:31:02.575481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-707adfb6-c133-41c6-8baa-5edb2955d28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:02.638293 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707adfb6-c133-41c6-8baa-5edb2955d28f admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:31:02.721289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:31:02.732274 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44d55a-44d9-449e-aa38-95e0ff8652bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:31:02.732868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d55a-44d9-449e-aa38-95e0ff8652bb admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:02.733145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d55a-44d9-449e-aa38-95e0ff8652bb admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:02.733426 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d55a-44d9-449e-aa38-95e0ff8652bb admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:02.734052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44d55a-44d9-449e-aa38-95e0ff8652bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:31:02.735084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: WARNING py.warnings [None req-cf44d55a-44d9-449e-aa38-95e0ff8652bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:31:02.735084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: warnings.warn(msg) Sep 16 05:31:02.735084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: Sep 16 05:31:02.736507 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44d55a-44d9-449e-aa38-95e0ff8652bb admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:31:02.748555 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 748/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:31:02.752571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d79894-888d-47a7-a110-ce11b943ec19 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:31:02.754119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-61d79894-888d-47a7-a110-ce11b943ec19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:02.765599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d79894-888d-47a7-a110-ce11b943ec19 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:31:02.790315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:31:02.859159 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5dda2-82b0-4615-814f-8ce40c647299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:31:02.859694 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5dda2-82b0-4615-814f-8ce40c647299 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:02.859972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5dda2-82b0-4615-814f-8ce40c647299 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:02.860240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5dda2-82b0-4615-814f-8ce40c647299 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:02.861473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5dda2-82b0-4615-814f-8ce40c647299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:31:02.862494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: WARNING py.warnings [None req-40b5dda2-82b0-4615-814f-8ce40c647299 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:31:02.862494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: warnings.warn(msg) Sep 16 05:31:02.862494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: Sep 16 05:31:02.863397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5dda2-82b0-4615-814f-8ce40c647299 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:31:02.875334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 752/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:31:02.879494 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44d55a-44d9-449e-aa38-95e0ff8652bb admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:31:02.881068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-cf44d55a-44d9-449e-aa38-95e0ff8652bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:02.914161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44d55a-44d9-449e-aa38-95e0ff8652bb admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:31:03.004595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015299d-6ad6-4082-a848-38f30cb7090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:31:03.005260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015299d-6ad6-4082-a848-38f30cb7090e admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:03.005497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015299d-6ad6-4082-a848-38f30cb7090e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:03.005770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015299d-6ad6-4082-a848-38f30cb7090e admin admin] PATH_INFO: `/v3/projects/f80ae935430f4abaab14f6edd780872e/users/7e81cfc658304023b7cc6c8ef73a2502/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:03.028200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015299d-6ad6-4082-a848-38f30cb7090e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80ae935430f4abaab14f6edd780872e, user_id=7e81cfc658304023b7cc6c8ef73a2502, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:31:03.029217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: WARNING py.warnings [None req-7015299d-6ad6-4082-a848-38f30cb7090e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:31:03.029217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: warnings.warn(msg) Sep 16 05:31:03.029217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: Sep 16 05:31:03.031162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015299d-6ad6-4082-a848-38f30cb7090e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:31:03.055771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 749/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:31:02 2022] PUT /identity/v3/projects/f80ae935430f4abaab14f6edd780872e/users/7e81cfc658304023b7cc6c8ef73a2502/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:31:03.067883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432a452-e2a2-41d8-85f7-0be30d388962 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:03.068173 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432a452-e2a2-41d8-85f7-0be30d388962 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:03.068449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432a452-e2a2-41d8-85f7-0be30d388962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:03.127029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-0432a452-e2a2-41d8-85f7-0be30d388962 None None] MFA Rules not processed for user `7e81cfc658304023b7cc6c8ef73a2502`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:31:03.128265 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0432a452-e2a2-41d8-85f7-0be30d388962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:03.208369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 753/1502] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:31:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:31:03.222482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4224422-849f-4aa1-809f-847b347d4507 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:03.222903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4224422-849f-4aa1-809f-847b347d4507 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:03.223279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4224422-849f-4aa1-809f-847b347d4507 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:03.224784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 750/1503] 10.222.0.20 () {54 vars in 964 bytes} [Fri Sep 16 05:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:31:03.230499 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113f07-8f7d-4e01-a59e-eea677b6d098 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:03.230798 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113f07-8f7d-4e01-a59e-eea677b6d098 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:03.231068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113f07-8f7d-4e01-a59e-eea677b6d098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:03.382739 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:31:03.426163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-0d113f07-8f7d-4e01-a59e-eea677b6d098 None None] MFA Rules not processed for user `fc48962e649c40ca82cf3173ce9940e9`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:31:03.427373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0d113f07-8f7d-4e01-a59e-eea677b6d098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:03.502980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 754/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Sep 16 05:31:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:31:03.510902 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4224422-849f-4aa1-809f-847b347d4507 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:31:03.513468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b4224422-849f-4aa1-809f-847b347d4507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:03.566516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:31:03.619384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4224422-849f-4aa1-809f-847b347d4507 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:31:03.691548 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831f1f0-cfbc-4bc0-8a45-3c620d28a006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:31:03.692075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831f1f0-cfbc-4bc0-8a45-3c620d28a006 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:03.692349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831f1f0-cfbc-4bc0-8a45-3c620d28a006 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:03.692612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831f1f0-cfbc-4bc0-8a45-3c620d28a006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:03.694197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3831f1f0-cfbc-4bc0-8a45-3c620d28a006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:03.790255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831f1f0-cfbc-4bc0-8a45-3c620d28a006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:31:03.791712 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831f1f0-cfbc-4bc0-8a45-3c620d28a006 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:31:03.795183 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:31:03.810498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 751/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:31:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:31:03.855745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40b02c-5158-491e-81f5-c2317e5e4818 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:03.856142 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40b02c-5158-491e-81f5-c2317e5e4818 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:03.856308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40b02c-5158-491e-81f5-c2317e5e4818 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:03.857535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 755/1506] 10.222.0.20 () {52 vars in 830 bytes} [Fri Sep 16 05:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:31:03.861556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831f1f0-cfbc-4bc0-8a45-3c620d28a006 service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:31:03.862790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3831f1f0-cfbc-4bc0-8a45-3c620d28a006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:03.959345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831f1f0-cfbc-4bc0-8a45-3c620d28a006 service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:31:04.050949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:31:04.051587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:04.051824 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:04.052090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] PATH_INFO: `/v3/users/7e81cfc658304023b7cc6c8ef73a2502` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:04.065134 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e81cfc658304023b7cc6c8ef73a2502)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:31:04.066146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: WARNING py.warnings [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:31:04.066146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: warnings.warn(msg) Sep 16 05:31:04.066146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: Sep 16 05:31:04.067390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:31:04.076761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:31:04.133816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e81cfc658304023b7cc6c8ef73a2502'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:31:04.134347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e81cfc658304023b7cc6c8ef73a2502'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:31:04.147668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e81cfc658304023b7cc6c8ef73a2502'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:31:04.156201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e81cfc658304023b7cc6c8ef73a2502'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:31:04.156637 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e81cfc658304023b7cc6c8ef73a2502'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:31:04.185853 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 752/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:31:03 2022] DELETE /identity/v3/users/7e81cfc658304023b7cc6c8ef73a2502 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:31:04.190141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76866f-d628-46df-86e4-52cf7f145d49 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:04.190424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76866f-d628-46df-86e4-52cf7f145d49 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:04.190724 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76866f-d628-46df-86e4-52cf7f145d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:04.251056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-5d76866f-d628-46df-86e4-52cf7f145d49 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:31:04.252252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5d76866f-d628-46df-86e4-52cf7f145d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:04.325525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:31:04.338623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 756/1508] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:31:04.349377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:31:04.350745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:04.450913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fe988-6fcc-4c68-81fb-cfc7dcf71268 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:31:04.505383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:31:04.526619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80eb15-98bd-4657-b1da-f1de77c764d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:31:04.527230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80eb15-98bd-4657-b1da-f1de77c764d3 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:04.527506 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80eb15-98bd-4657-b1da-f1de77c764d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:04.527774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80eb15-98bd-4657-b1da-f1de77c764d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:04.529431 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ac80eb15-98bd-4657-b1da-f1de77c764d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:04.635108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80eb15-98bd-4657-b1da-f1de77c764d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:31:04.636534 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80eb15-98bd-4657-b1da-f1de77c764d3 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:31:04.654837 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 753/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:31:04.999390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76866f-d628-46df-86e4-52cf7f145d49 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:31:05.000652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5d76866f-d628-46df-86e4-52cf7f145d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:31:05.012469 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76866f-d628-46df-86e4-52cf7f145d49 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:31:05.113080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544394f8-2522-4058-bfa3-680f71b0ee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:31:05.113705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544394f8-2522-4058-bfa3-680f71b0ee5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:31:05.113982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544394f8-2522-4058-bfa3-680f71b0ee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:31:05.114252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544394f8-2522-4058-bfa3-680f71b0ee5c admin admin] PATH_INFO: `/v3/projects/f80ae935430f4abaab14f6edd780872e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:31:05.124670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544394f8-2522-4058-bfa3-680f71b0ee5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80ae935430f4abaab14f6edd780872e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:31:05.125709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: WARNING py.warnings [None req-544394f8-2522-4058-bfa3-680f71b0ee5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:31:05.125709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: warnings.warn(msg) Sep 16 05:31:05.125709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: Sep 16 05:31:05.127510 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544394f8-2522-4058-bfa3-680f71b0ee5c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:31:05.184250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-544394f8-2522-4058-bfa3-680f71b0ee5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80ae935430f4abaab14f6edd780872e', 'request_id': 'req-544394f8-2522-4058-bfa3-680f71b0ee5c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:31:05.191050 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-544394f8-2522-4058-bfa3-680f71b0ee5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80ae935430f4abaab14f6edd780872e', 'request_id': 'req-544394f8-2522-4058-bfa3-680f71b0ee5c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:31:05.200976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-544394f8-2522-4058-bfa3-680f71b0ee5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80ae935430f4abaab14f6edd780872e', 'request_id': 'req-544394f8-2522-4058-bfa3-680f71b0ee5c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:31:05.231037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-544394f8-2522-4058-bfa3-680f71b0ee5c admin admin] The token cache is being invalidate because project f80ae935430f4abaab14f6edd780872e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:31:05.231322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-544394f8-2522-4058-bfa3-680f71b0ee5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:31:05.231746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-544394f8-2522-4058-bfa3-680f71b0ee5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:31:05.233130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 757/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:31:04 2022] DELETE /identity/v3/projects/f80ae935430f4abaab14f6edd780872e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:31:14.652610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=62 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:31:15.228854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:32:39.449910 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5ee66-3b6d-488f-acf3-5fa87ad12786 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:39.450545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5ee66-3b6d-488f-acf3-5fa87ad12786 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:39.450545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5ee66-3b6d-488f-acf3-5fa87ad12786 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:39.451867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 05:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:32:39.457649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab845e-b9ad-4f1b-8c11-fdb605bfeb1b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:39.458082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab845e-b9ad-4f1b-8c11-fdb605bfeb1b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:39.458192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab845e-b9ad-4f1b-8c11-fdb605bfeb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:39.537541 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-08ab845e-b9ad-4f1b-8c11-fdb605bfeb1b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:32:39.538690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-08ab845e-b9ad-4f1b-8c11-fdb605bfeb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:32:39.637982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 05:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:32:39.790951 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5ee66-3b6d-488f-acf3-5fa87ad12786 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:32:39.793016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-52a5ee66-3b6d-488f-acf3-5fa87ad12786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:32:39.912113 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5ee66-3b6d-488f-acf3-5fa87ad12786 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:32:39.917666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681931b4-9945-44b6-b610-53d660d10013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:32:39.918270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681931b4-9945-44b6-b610-53d660d10013 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:39.918579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681931b4-9945-44b6-b610-53d660d10013 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:39.918859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681931b4-9945-44b6-b610-53d660d10013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:39.929213 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681931b4-9945-44b6-b610-53d660d10013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:32:39.930852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681931b4-9945-44b6-b610-53d660d10013 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:32:39.940310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 755/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:32:41.069353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999ae03-7784-4365-b072-7ace21acd3e2 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:41.069953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999ae03-7784-4365-b072-7ace21acd3e2 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:41.070059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999ae03-7784-4365-b072-7ace21acd3e2 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:41.071406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 05:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:32:41.079443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857c0f5-159f-450c-a89b-cef8a86d8bad None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:41.081693 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857c0f5-159f-450c-a89b-cef8a86d8bad None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:41.081961 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857c0f5-159f-450c-a89b-cef8a86d8bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:41.102571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-3857c0f5-159f-450c-a89b-cef8a86d8bad None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:32:41.103797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3857c0f5-159f-450c-a89b-cef8a86d8bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:32:41.111698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 05:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:32:41.116647 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70b270-3091-42db-9f75-39e9594c70cb None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:41.116933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70b270-3091-42db-9f75-39e9594c70cb None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:41.117208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70b270-3091-42db-9f75-39e9594c70cb None None] PATH_INFO: `/v3` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:41.118596 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 760/1516] 10.222.0.16 () {54 vars in 925 bytes} [Fri Sep 16 05:32:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:32:41.125089 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3a3cf-2387-4ceb-ab35-20a771875569 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:41.125371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3a3cf-2387-4ceb-ab35-20a771875569 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:41.125642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3a3cf-2387-4ceb-ab35-20a771875569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:41.189806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-89c3a3cf-2387-4ceb-ab35-20a771875569 None None] MFA Rules not processed for user `8ef60b27f5f545aa8ea063009ec66eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:32:41.191060 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-89c3a3cf-2387-4ceb-ab35-20a771875569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:32:41.247838 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:32:41.268081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 757/1517] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Sep 16 05:32:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:32:41.269973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70b270-3091-42db-9f75-39e9594c70cb None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:32:41.284897 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70b270-3091-42db-9f75-39e9594c70cb None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:32:41.290402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6de393-0043-408f-b105-b79ba6664847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:32:41.290959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6de393-0043-408f-b105-b79ba6664847 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:41.291238 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6de393-0043-408f-b105-b79ba6664847 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:41.291511 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6de393-0043-408f-b105-b79ba6664847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:41.299701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6de393-0043-408f-b105-b79ba6664847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:32:41.301309 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6de393-0043-408f-b105-b79ba6664847 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:32:41.310490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 761/1518] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:32:49.906340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac9b18-9e2b-46fb-b822-f1aa1c8d0b81 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:49.906909 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac9b18-9e2b-46fb-b822-f1aa1c8d0b81 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:49.906909 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac9b18-9e2b-46fb-b822-f1aa1c8d0b81 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:49.908332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 758/1519] 10.222.0.20 () {54 vars in 961 bytes} [Fri Sep 16 05:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:32:49.913438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5134-f51e-4c45-a7ea-f071ad25c989 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:49.913871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5134-f51e-4c45-a7ea-f071ad25c989 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:49.913982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5134-f51e-4c45-a7ea-f071ad25c989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:49.934544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-70fb5134-f51e-4c45-a7ea-f071ad25c989 None None] MFA Rules not processed for user `8ef60b27f5f545aa8ea063009ec66eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:32:49.935928 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-70fb5134-f51e-4c45-a7ea-f071ad25c989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:32:49.944948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 762/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 16 05:32:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:32:49.952577 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac9b18-9e2b-46fb-b822-f1aa1c8d0b81 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:32:49.966145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac9b18-9e2b-46fb-b822-f1aa1c8d0b81 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:32:49.972541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275f30a-117f-44f7-8178-a0834672cc54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef60b27f5f545aa8ea063009ec66eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:32:49.973142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275f30a-117f-44f7-8178-a0834672cc54 service placement] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:49.973437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275f30a-117f-44f7-8178-a0834672cc54 service placement] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:49.973924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275f30a-117f-44f7-8178-a0834672cc54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:49.984724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275f30a-117f-44f7-8178-a0834672cc54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:32:49.986333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275f30a-117f-44f7-8178-a0834672cc54 service placement] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:32:49.995862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 759/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:32:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:32:52.774586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27267c7-7e53-4428-9cd8-b121e14ded71 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:52.775154 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27267c7-7e53-4428-9cd8-b121e14ded71 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:52.775154 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27267c7-7e53-4428-9cd8-b121e14ded71 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:52.776463 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 05:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:32:52.782526 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741bed-850c-4c61-b994-dc0a38fb5478 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:52.782958 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741bed-850c-4c61-b994-dc0a38fb5478 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:52.783108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741bed-850c-4c61-b994-dc0a38fb5478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:52.803409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-88741bed-850c-4c61-b994-dc0a38fb5478 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:32:52.804618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-88741bed-850c-4c61-b994-dc0a38fb5478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:32:52.812936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 05:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:32:52.975972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27267c7-7e53-4428-9cd8-b121e14ded71 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:32:52.990007 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27267c7-7e53-4428-9cd8-b121e14ded71 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:32:52.995271 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172c44a-cb65-4350-8de3-e81fb1588c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:32:52.995859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172c44a-cb65-4350-8de3-e81fb1588c42 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:52.996135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172c44a-cb65-4350-8de3-e81fb1588c42 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:52.996407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172c44a-cb65-4350-8de3-e81fb1588c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:53.004727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172c44a-cb65-4350-8de3-e81fb1588c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:32:53.006302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172c44a-cb65-4350-8de3-e81fb1588c42 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:32:53.016222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 764/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:32:54.087874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd598c-ab9f-4f39-881a-b1ede5540ee0 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:54.088460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd598c-ab9f-4f39-881a-b1ede5540ee0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:54.088460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd598c-ab9f-4f39-881a-b1ede5540ee0 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:54.089774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 05:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:32:54.096544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3efa72-d830-4c08-8eb7-3516713bc30e None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:54.097004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3efa72-d830-4c08-8eb7-3516713bc30e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:54.097114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3efa72-d830-4c08-8eb7-3516713bc30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:54.116524 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-0c3efa72-d830-4c08-8eb7-3516713bc30e None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:32:54.117668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0c3efa72-d830-4c08-8eb7-3516713bc30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:32:54.125530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 05:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:32:54.278148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd598c-ab9f-4f39-881a-b1ede5540ee0 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:32:54.292390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd598c-ab9f-4f39-881a-b1ede5540ee0 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:32:54.297778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf8be6-2659-497a-855f-d2d5be358136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:32:54.298356 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf8be6-2659-497a-855f-d2d5be358136 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:54.298664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf8be6-2659-497a-855f-d2d5be358136 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:54.298935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf8be6-2659-497a-855f-d2d5be358136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:54.306846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf8be6-2659-497a-855f-d2d5be358136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:32:54.308411 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf8be6-2659-497a-855f-d2d5be358136 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:32:54.318042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 762/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:32:58.254312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f82abc-6260-4ad2-8a85-6f4cc6e373b1 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:58.254818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f82abc-6260-4ad2-8a85-6f4cc6e373b1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:58.254911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f82abc-6260-4ad2-8a85-6f4cc6e373b1 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:58.256231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:32:58.261724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095098e-ce57-42c6-b6f3-3bfc551e683d None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:58.262159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095098e-ce57-42c6-b6f3-3bfc551e683d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:58.262265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095098e-ce57-42c6-b6f3-3bfc551e683d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:58.281979 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-0095098e-ce57-42c6-b6f3-3bfc551e683d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:32:58.283199 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0095098e-ce57-42c6-b6f3-3bfc551e683d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:32:58.291193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:32:58.579234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f82abc-6260-4ad2-8a85-6f4cc6e373b1 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:32:58.581165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e1f82abc-6260-4ad2-8a85-6f4cc6e373b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:32:58.615164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:32:58.660343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f82abc-6260-4ad2-8a85-6f4cc6e373b1 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:32:58.663907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe9b31-a6ec-436a-bacd-99c1988d342c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:32:58.664501 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe9b31-a6ec-436a-bacd-99c1988d342c service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:32:58.664778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe9b31-a6ec-436a-bacd-99c1988d342c service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:32:58.665046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe9b31-a6ec-436a-bacd-99c1988d342c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:32:58.673671 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe9b31-a6ec-436a-bacd-99c1988d342c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:32:58.675140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe9b31-a6ec-436a-bacd-99c1988d342c service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:32:58.684249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 767/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:33:00.802786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f460-050c-4079-b07c-0e584bf8628d None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:33:00.803303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f460-050c-4079-b07c-0e584bf8628d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:33:00.803422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f460-050c-4079-b07c-0e584bf8628d None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:33:00.804711 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:33:00.809987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347ecd-6804-42e7-8edc-26a6e5627340 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:33:00.810409 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347ecd-6804-42e7-8edc-26a6e5627340 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:33:00.810568 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347ecd-6804-42e7-8edc-26a6e5627340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:33:00.831716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-1e347ecd-6804-42e7-8edc-26a6e5627340 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:33:00.832930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1e347ecd-6804-42e7-8edc-26a6e5627340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:33:00.840747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:33:01.127880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f460-050c-4079-b07c-0e584bf8628d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:33:01.138420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f460-050c-4079-b07c-0e584bf8628d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:33:01.143808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849521c7-2b3a-4b21-aabf-2cbe33cf590b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:33:01.144389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849521c7-2b3a-4b21-aabf-2cbe33cf590b service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:33:01.144660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849521c7-2b3a-4b21-aabf-2cbe33cf590b service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:33:01.144925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849521c7-2b3a-4b21-aabf-2cbe33cf590b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:33:01.153647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849521c7-2b3a-4b21-aabf-2cbe33cf590b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:33:01.155103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849521c7-2b3a-4b21-aabf-2cbe33cf590b service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:33:01.164887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 765/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:33:04.747264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59c620-d159-48f5-b5f1-23b61a7fd84d None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:33:04.747834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59c620-d159-48f5-b5f1-23b61a7fd84d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:33:04.747834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59c620-d159-48f5-b5f1-23b61a7fd84d None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:33:04.749657 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:33:04.755001 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b6681-932d-4b01-b333-b744998c019b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:33:04.755405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b6681-932d-4b01-b333-b744998c019b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:33:04.755526 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b6681-932d-4b01-b333-b744998c019b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:33:04.775554 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f53b6681-932d-4b01-b333-b744998c019b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:33:04.776738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f53b6681-932d-4b01-b333-b744998c019b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:33:04.784503 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:33:05.097545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59c620-d159-48f5-b5f1-23b61a7fd84d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:33:05.099253 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5b59c620-d159-48f5-b5f1-23b61a7fd84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:33:05.175889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59c620-d159-48f5-b5f1-23b61a7fd84d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:33:05.179447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4a391-e076-4e08-b607-d6d38708ede1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:33:05.180027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4a391-e076-4e08-b607-d6d38708ede1 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:33:05.180310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4a391-e076-4e08-b607-d6d38708ede1 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:33:05.180584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4a391-e076-4e08-b607-d6d38708ede1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:33:05.189992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4a391-e076-4e08-b607-d6d38708ede1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:33:05.191462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4a391-e076-4e08-b607-d6d38708ede1 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:33:05.203056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 770/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:33:07.313567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c0fe2-1aeb-4de5-9668-7267818114f9 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:33:07.314053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c0fe2-1aeb-4de5-9668-7267818114f9 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:33:07.314167 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c0fe2-1aeb-4de5-9668-7267818114f9 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:33:07.315474 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 05:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:33:07.320670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47e932-4152-4dc6-a6ab-1c6053d2a17f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:33:07.321086 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47e932-4152-4dc6-a6ab-1c6053d2a17f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:33:07.321223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47e932-4152-4dc6-a6ab-1c6053d2a17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:33:07.341147 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-bc47e932-4152-4dc6-a6ab-1c6053d2a17f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:33:07.342352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-bc47e932-4152-4dc6-a6ab-1c6053d2a17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:33:07.350771 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 05:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:33:07.650681 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c0fe2-1aeb-4de5-9668-7267818114f9 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:33:07.652331 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-df4c0fe2-1aeb-4de5-9668-7267818114f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:33:07.665482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c0fe2-1aeb-4de5-9668-7267818114f9 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:33:07.668948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73c355-d090-4402-95e9-84dcd4bbf871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:33:07.669557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73c355-d090-4402-95e9-84dcd4bbf871 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:33:07.669813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73c355-d090-4402-95e9-84dcd4bbf871 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:33:07.670079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73c355-d090-4402-95e9-84dcd4bbf871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:33:07.678660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73c355-d090-4402-95e9-84dcd4bbf871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:33:07.680070 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73c355-d090-4402-95e9-84dcd4bbf871 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:33:07.689129 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 768/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:33:17.336300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=63 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:33:17.685131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=37 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:35.129195 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be620305-86c3-4e64-9a3a-8b5a296722ab None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.130973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be620305-86c3-4e64-9a3a-8b5a296722ab None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.131745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be620305-86c3-4e64-9a3a-8b5a296722ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.160154 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-be620305-86c3-4e64-9a3a-8b5a296722ab None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.161395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-be620305-86c3-4e64-9a3a-8b5a296722ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.180311 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 772/1540] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.190001 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60882c8-9ea0-416b-a048-10ea3f397b40 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.191028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60882c8-9ea0-416b-a048-10ea3f397b40 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.191525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60882c8-9ea0-416b-a048-10ea3f397b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.226729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f60882c8-9ea0-416b-a048-10ea3f397b40 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.228025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f60882c8-9ea0-416b-a048-10ea3f397b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.254949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 769/1541] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.260873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be620305-86c3-4e64-9a3a-8b5a296722ab None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:35.277565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be620305-86c3-4e64-9a3a-8b5a296722ab None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:35.287683 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590dc45-30a4-4929-a2a7-2b2d72ae46e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:35.288311 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590dc45-30a4-4929-a2a7-2b2d72ae46e2 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.288591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590dc45-30a4-4929-a2a7-2b2d72ae46e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.288862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590dc45-30a4-4929-a2a7-2b2d72ae46e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.289521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590dc45-30a4-4929-a2a7-2b2d72ae46e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:34:35.289826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590dc45-30a4-4929-a2a7-2b2d72ae46e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:35.291484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590dc45-30a4-4929-a2a7-2b2d72ae46e2 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:35.310284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 773/1542] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:34:35.319362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60882c8-9ea0-416b-a048-10ea3f397b40 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:35.332416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60882c8-9ea0-416b-a048-10ea3f397b40 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:35.337768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f30d2-f062-467a-8dbc-8ffe4326e228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:35.338780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f30d2-f062-467a-8dbc-8ffe4326e228 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.339326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f30d2-f062-467a-8dbc-8ffe4326e228 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.339842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f30d2-f062-467a-8dbc-8ffe4326e228 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.340695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f30d2-f062-467a-8dbc-8ffe4326e228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:35.347199 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f30d2-f062-467a-8dbc-8ffe4326e228 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:35.401571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 770/1543] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:35.405833 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590dc45-30a4-4929-a2a7-2b2d72ae46e2 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:35.421700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590dc45-30a4-4929-a2a7-2b2d72ae46e2 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:35.428018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5667b2a-5a04-4a5f-97dc-68a9733d4bd2 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.428676 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5667b2a-5a04-4a5f-97dc-68a9733d4bd2 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.429192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5667b2a-5a04-4a5f-97dc-68a9733d4bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.452814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-d5667b2a-5a04-4a5f-97dc-68a9733d4bd2 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.454500 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d5667b2a-5a04-4a5f-97dc-68a9733d4bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.525030 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 771/1544] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:34:35.527293 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0322603-193e-4afd-8536-f5b1feefe56a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.527831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0322603-193e-4afd-8536-f5b1feefe56a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.528333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0322603-193e-4afd-8536-f5b1feefe56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.528469 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b201c-8145-42b2-8ed8-85af8b896d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:35.528988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b201c-8145-42b2-8ed8-85af8b896d7d admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.529267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b201c-8145-42b2-8ed8-85af8b896d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.529536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b201c-8145-42b2-8ed8-85af8b896d7d admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.534564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b201c-8145-42b2-8ed8-85af8b896d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:35.534564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b201c-8145-42b2-8ed8-85af8b896d7d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:35.559842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-e0322603-193e-4afd-8536-f5b1feefe56a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.562599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e0322603-193e-4afd-8536-f5b1feefe56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.575924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 772/1545] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.577911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 774/1546] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:35.578841 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff1329-5dd7-4361-8777-81a86943b63d None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.579266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b40a-4401-4117-a886-a8b93e2234ac None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.579551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b40a-4401-4117-a886-a8b93e2234ac None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.579826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b40a-4401-4117-a886-a8b93e2234ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.580294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff1329-5dd7-4361-8777-81a86943b63d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.581222 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff1329-5dd7-4361-8777-81a86943b63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.605275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-6798b40a-4401-4117-a886-a8b93e2234ac None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.606683 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6798b40a-4401-4117-a886-a8b93e2234ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.610408 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-28ff1329-5dd7-4361-8777-81a86943b63d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.611622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-28ff1329-5dd7-4361-8777-81a86943b63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.615920 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 775/1547] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.617238 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef9f0d-a29c-4afc-834d-09ef0f9e563b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.617523 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef9f0d-a29c-4afc-834d-09ef0f9e563b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.617791 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef9f0d-a29c-4afc-834d-09ef0f9e563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.625331 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 773/1548] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.626606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2891db2-5264-4a9d-9758-27f618dc1f1c None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.626890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2891db2-5264-4a9d-9758-27f618dc1f1c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.627211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2891db2-5264-4a9d-9758-27f618dc1f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.638695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-24ef9f0d-a29c-4afc-834d-09ef0f9e563b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.639945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-24ef9f0d-a29c-4afc-834d-09ef0f9e563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.646875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-e2891db2-5264-4a9d-9758-27f618dc1f1c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.647780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 776/1549] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.648097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e2891db2-5264-4a9d-9758-27f618dc1f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.648978 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633e0d-aa43-45de-88b9-9a44ff45d6b6 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.649222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633e0d-aa43-45de-88b9-9a44ff45d6b6 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.649494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633e0d-aa43-45de-88b9-9a44ff45d6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.656895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 774/1550] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.657584 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2891db2-5264-4a9d-9758-27f618dc1f1c None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:35.667598 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2891db2-5264-4a9d-9758-27f618dc1f1c None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:35.672730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab4f7b-37aa-4c9f-ae6d-3ce9f6c4590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:35.673321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab4f7b-37aa-4c9f-ae6d-3ce9f6c4590b admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.673599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab4f7b-37aa-4c9f-ae6d-3ce9f6c4590b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.673729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-cb633e0d-aa43-45de-88b9-9a44ff45d6b6 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.673872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab4f7b-37aa-4c9f-ae6d-3ce9f6c4590b admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.674532 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab4f7b-37aa-4c9f-ae6d-3ce9f6c4590b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:35.674909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-cb633e0d-aa43-45de-88b9-9a44ff45d6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.676118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab4f7b-37aa-4c9f-ae6d-3ce9f6c4590b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:35.682808 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 777/1551] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.684041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af3a87-8e83-476f-81dc-2d62925c6898 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.684323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af3a87-8e83-476f-81dc-2d62925c6898 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.684594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af3a87-8e83-476f-81dc-2d62925c6898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.689126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 775/1552] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:35.689126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e29d5-6f88-4fad-b11e-ea9758cb4fe5 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.689126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e29d5-6f88-4fad-b11e-ea9758cb4fe5 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.689126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e29d5-6f88-4fad-b11e-ea9758cb4fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.703691 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-08af3a87-8e83-476f-81dc-2d62925c6898 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.704885 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-08af3a87-8e83-476f-81dc-2d62925c6898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.706932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-5f3e29d5-6f88-4fad-b11e-ea9758cb4fe5 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.708096 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5f3e29d5-6f88-4fad-b11e-ea9758cb4fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.713241 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 778/1553] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.714558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f03a2-3a31-411f-9f76-43fb9fdcdffa None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.714991 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f03a2-3a31-411f-9f76-43fb9fdcdffa None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.715269 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f03a2-3a31-411f-9f76-43fb9fdcdffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.716195 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 776/1554] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.720105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a117aa7-cb1a-4065-8aa9-28f3cff3d6ca None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.720634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a117aa7-cb1a-4065-8aa9-28f3cff3d6ca None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.721094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a117aa7-cb1a-4065-8aa9-28f3cff3d6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.736292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-7d8f03a2-3a31-411f-9f76-43fb9fdcdffa None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.737543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-7d8f03a2-3a31-411f-9f76-43fb9fdcdffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.741938 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-1a117aa7-cb1a-4065-8aa9-28f3cff3d6ca None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.743125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1a117aa7-cb1a-4065-8aa9-28f3cff3d6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.745872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 779/1555] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.746465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f03a2-3a31-411f-9f76-43fb9fdcdffa None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:35.753893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 777/1556] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.755178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a253de2-b6d8-4fcb-acfe-998250701271 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.755459 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a253de2-b6d8-4fcb-acfe-998250701271 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.755741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a253de2-b6d8-4fcb-acfe-998250701271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.759634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f03a2-3a31-411f-9f76-43fb9fdcdffa None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:35.764211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f081bb6-53f9-4979-a706-295a30e641c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:35.765324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081bb6-53f9-4979-a706-295a30e641c6 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.765595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081bb6-53f9-4979-a706-295a30e641c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.765858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081bb6-53f9-4979-a706-295a30e641c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.766489 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f081bb6-53f9-4979-a706-295a30e641c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:34:35.766810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f081bb6-53f9-4979-a706-295a30e641c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:35.768415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f081bb6-53f9-4979-a706-295a30e641c6 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:35.776289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-2a253de2-b6d8-4fcb-acfe-998250701271 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.777487 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-2a253de2-b6d8-4fcb-acfe-998250701271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.786131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 780/1557] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:34:35.786131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f081bb6-53f9-4979-a706-295a30e641c6 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:35.795583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 778/1558] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.796445 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a253de2-b6d8-4fcb-acfe-998250701271 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:35.798352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f081bb6-53f9-4979-a706-295a30e641c6 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:35.805089 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4fbab-a0a5-4d17-b982-11f037d2acd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:35.805763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4fbab-a0a5-4d17-b982-11f037d2acd0 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.806041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4fbab-a0a5-4d17-b982-11f037d2acd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.806306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4fbab-a0a5-4d17-b982-11f037d2acd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.806988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4fbab-a0a5-4d17-b982-11f037d2acd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:34:35.807277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4fbab-a0a5-4d17-b982-11f037d2acd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:35.807479 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a253de2-b6d8-4fcb-acfe-998250701271 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:35.808878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4fbab-a0a5-4d17-b982-11f037d2acd0 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:35.812142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917545a-bb93-4938-9337-9a8caa363ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:35.812736 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917545a-bb93-4938-9337-9a8caa363ebb admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.813126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917545a-bb93-4938-9337-9a8caa363ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.813403 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917545a-bb93-4938-9337-9a8caa363ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.814044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917545a-bb93-4938-9337-9a8caa363ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:35.815650 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917545a-bb93-4938-9337-9a8caa363ebb admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:35.821299 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 781/1559] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:34:35.822160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4fbab-a0a5-4d17-b982-11f037d2acd0 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:35.827846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 779/1560] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:35.829096 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43ebd4-6eff-4c5a-a6a9-e99662d89294 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.829379 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43ebd4-6eff-4c5a-a6a9-e99662d89294 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.829652 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43ebd4-6eff-4c5a-a6a9-e99662d89294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.835710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4fbab-a0a5-4d17-b982-11f037d2acd0 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:35.840294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb33b1-b6a4-4fc7-9bc5-cfdacff4e0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:35.840888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb33b1-b6a4-4fc7-9bc5-cfdacff4e0ee admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.841168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb33b1-b6a4-4fc7-9bc5-cfdacff4e0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.841439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb33b1-b6a4-4fc7-9bc5-cfdacff4e0ee admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.842070 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb33b1-b6a4-4fc7-9bc5-cfdacff4e0ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:34:35.842370 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb33b1-b6a4-4fc7-9bc5-cfdacff4e0ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:35.844602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb33b1-b6a4-4fc7-9bc5-cfdacff4e0ee admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:35.849462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-2e43ebd4-6eff-4c5a-a6a9-e99662d89294 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.850692 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-2e43ebd4-6eff-4c5a-a6a9-e99662d89294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.855986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 782/1561] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:34:35.857203 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43319972-69ec-4f53-9e82-0683ba6e898c None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.857547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43319972-69ec-4f53-9e82-0683ba6e898c None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.857754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43319972-69ec-4f53-9e82-0683ba6e898c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.859962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 780/1562] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.864772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43ebd4-6eff-4c5a-a6a9-e99662d89294 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:35.876738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43ebd4-6eff-4c5a-a6a9-e99662d89294 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:35.880962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-43319972-69ec-4f53-9e82-0683ba6e898c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:35.882368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da53ee-102e-4134-999e-5fb688f74e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:35.882542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-43319972-69ec-4f53-9e82-0683ba6e898c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:35.883050 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da53ee-102e-4134-999e-5fb688f74e55 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.883331 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da53ee-102e-4134-999e-5fb688f74e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.883603 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da53ee-102e-4134-999e-5fb688f74e55 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.884290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da53ee-102e-4134-999e-5fb688f74e55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:34:35.884585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da53ee-102e-4134-999e-5fb688f74e55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:35.885612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: WARNING py.warnings [None req-b5da53ee-102e-4134-999e-5fb688f74e55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:34:35.885612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: warnings.warn(msg) Sep 16 05:34:35.885612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: Sep 16 05:34:35.886489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da53ee-102e-4134-999e-5fb688f74e55 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:35.891611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 783/1563] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:35.892475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43319972-69ec-4f53-9e82-0683ba6e898c None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:35.902072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43319972-69ec-4f53-9e82-0683ba6e898c None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:35.903999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 781/1564] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:34:35.905801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da53ee-102e-4134-999e-5fb688f74e55 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:35.913114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549eaec-02d3-48c0-9dbe-490e806ee367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:35.913637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549eaec-02d3-48c0-9dbe-490e806ee367 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.913910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549eaec-02d3-48c0-9dbe-490e806ee367 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.914203 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549eaec-02d3-48c0-9dbe-490e806ee367 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.914869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549eaec-02d3-48c0-9dbe-490e806ee367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:35.915892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: WARNING py.warnings [None req-7549eaec-02d3-48c0-9dbe-490e806ee367 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:34:35.915892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: warnings.warn(msg) Sep 16 05:34:35.915892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: Sep 16 05:34:35.917161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549eaec-02d3-48c0-9dbe-490e806ee367 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:35.919840 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da53ee-102e-4134-999e-5fb688f74e55 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:35.926277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff3781-edc6-41b2-baf9-9f88d8f826e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:35.927150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff3781-edc6-41b2-baf9-9f88d8f826e3 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:35.927587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff3781-edc6-41b2-baf9-9f88d8f826e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:35.929286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff3781-edc6-41b2-baf9-9f88d8f826e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:35.930335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff3781-edc6-41b2-baf9-9f88d8f826e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:34:35.930714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff3781-edc6-41b2-baf9-9f88d8f826e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:35.932877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff3781-edc6-41b2-baf9-9f88d8f826e3 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:35.944522 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 784/1565] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:35.945760 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549eaec-02d3-48c0-9dbe-490e806ee367 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:35.948595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 782/1566] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:34:35.949472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff3781-edc6-41b2-baf9-9f88d8f826e3 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:35.964233 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff3781-edc6-41b2-baf9-9f88d8f826e3 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:35.979213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:35.991856 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:36.009896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549eaec-02d3-48c0-9dbe-490e806ee367 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.015100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1fcbf-6955-46d8-8612-e6ed89a918ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.015761 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1fcbf-6955-46d8-8612-e6ed89a918ff admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.016034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1fcbf-6955-46d8-8612-e6ed89a918ff admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.016305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1fcbf-6955-46d8-8612-e6ed89a918ff admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.016973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1fcbf-6955-46d8-8612-e6ed89a918ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.018917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1fcbf-6955-46d8-8612-e6ed89a918ff admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.024271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc9213-c2e3-413e-8bf4-f38eb77b8ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.024936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc9213-c2e3-413e-8bf4-f38eb77b8ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.025218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc9213-c2e3-413e-8bf4-f38eb77b8ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.025490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc9213-c2e3-413e-8bf4-f38eb77b8ac1 admin admin] PATH_INFO: `/v3/projects/3c7cfd7efbc54bbd90963f2e07af47de/users/2d34a9b82f0b40eba62454a690761bb0/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.041318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc9213-c2e3-413e-8bf4-f38eb77b8ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7cfd7efbc54bbd90963f2e07af47de, user_id=2d34a9b82f0b40eba62454a690761bb0, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.044131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc9213-c2e3-413e-8bf4-f38eb77b8ac1 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.045171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 785/1567] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:35 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:36.046097 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1fcbf-6955-46d8-8612-e6ed89a918ff admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.060856 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 783/1568] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:35 2022] PUT /identity/v3/projects/3c7cfd7efbc54bbd90963f2e07af47de/users/2d34a9b82f0b40eba62454a690761bb0/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:36.071222 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc9213-c2e3-413e-8bf4-f38eb77b8ac1 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.108451 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1fcbf-6955-46d8-8612-e6ed89a918ff admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.132578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc9213-c2e3-413e-8bf4-f38eb77b8ac1 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.137455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c937d-d2ab-4bb3-8b9d-6d2b57d4ba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.138062 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c937d-d2ab-4bb3-8b9d-6d2b57d4ba3e admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.138375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c937d-d2ab-4bb3-8b9d-6d2b57d4ba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.138655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c937d-d2ab-4bb3-8b9d-6d2b57d4ba3e admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.139326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c937d-d2ab-4bb3-8b9d-6d2b57d4ba3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.141935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c937d-d2ab-4bb3-8b9d-6d2b57d4ba3e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.165859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff59cc-d18f-4daa-81a5-6b4309ed8617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.166404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff59cc-d18f-4daa-81a5-6b4309ed8617 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.166690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff59cc-d18f-4daa-81a5-6b4309ed8617 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.166966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff59cc-d18f-4daa-81a5-6b4309ed8617 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.167622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff59cc-d18f-4daa-81a5-6b4309ed8617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:34:36.167913 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff59cc-d18f-4daa-81a5-6b4309ed8617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.169547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff59cc-d18f-4daa-81a5-6b4309ed8617 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.169847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 784/1569] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/projects => generated 355 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:36.170635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c937d-d2ab-4bb3-8b9d-6d2b57d4ba3e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.181985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 786/1570] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:34:36.183366 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff59cc-d18f-4daa-81a5-6b4309ed8617 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.194806 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff59cc-d18f-4daa-81a5-6b4309ed8617 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.250477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:36.258396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c937d-d2ab-4bb3-8b9d-6d2b57d4ba3e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.258946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09607a86-0afe-4c34-8216-c62d476e2067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.259411 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607a86-0afe-4c34-8216-c62d476e2067 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.259693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607a86-0afe-4c34-8216-c62d476e2067 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.259966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607a86-0afe-4c34-8216-c62d476e2067 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.260595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09607a86-0afe-4c34-8216-c62d476e2067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.262625 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09607a86-0afe-4c34-8216-c62d476e2067 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.263264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951e7bc-7724-444b-a1b4-59c51b251702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.263868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951e7bc-7724-444b-a1b4-59c51b251702 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.264151 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951e7bc-7724-444b-a1b4-59c51b251702 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.264489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951e7bc-7724-444b-a1b4-59c51b251702 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.265653 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951e7bc-7724-444b-a1b4-59c51b251702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:34:36.265957 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951e7bc-7724-444b-a1b4-59c51b251702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.267594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951e7bc-7724-444b-a1b4-59c51b251702 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.279199 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 785/1571] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:34:36.280007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951e7bc-7724-444b-a1b4-59c51b251702 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.293716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951e7bc-7724-444b-a1b4-59c51b251702 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.300644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 787/1572] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:36.300800 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf718684-680e-4a9a-92c5-5e6dfface663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.300930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09607a86-0afe-4c34-8216-c62d476e2067 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.301027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf718684-680e-4a9a-92c5-5e6dfface663 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.301027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf718684-680e-4a9a-92c5-5e6dfface663 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.301027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf718684-680e-4a9a-92c5-5e6dfface663 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.301027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf718684-680e-4a9a-92c5-5e6dfface663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.301377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: WARNING py.warnings [None req-bf718684-680e-4a9a-92c5-5e6dfface663 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:34:36.301377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: warnings.warn(msg) Sep 16 05:34:36.301377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: Sep 16 05:34:36.302331 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf718684-680e-4a9a-92c5-5e6dfface663 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.325983 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 786/1573] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:36.327700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf718684-680e-4a9a-92c5-5e6dfface663 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.337304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf718684-680e-4a9a-92c5-5e6dfface663 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.346109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:36.365011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09607a86-0afe-4c34-8216-c62d476e2067 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.369871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30fd73-75f2-49aa-89dc-9bd690aa0037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.370479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fd73-75f2-49aa-89dc-9bd690aa0037 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.370840 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fd73-75f2-49aa-89dc-9bd690aa0037 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.371728 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fd73-75f2-49aa-89dc-9bd690aa0037 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.372361 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30fd73-75f2-49aa-89dc-9bd690aa0037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.374846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30fd73-75f2-49aa-89dc-9bd690aa0037 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.395235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc524d9-4698-4a8c-8ad7-0ac2dd5b3a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.395853 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc524d9-4698-4a8c-8ad7-0ac2dd5b3a68 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.396143 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc524d9-4698-4a8c-8ad7-0ac2dd5b3a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.396418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc524d9-4698-4a8c-8ad7-0ac2dd5b3a68 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.397049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc524d9-4698-4a8c-8ad7-0ac2dd5b3a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.399075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc524d9-4698-4a8c-8ad7-0ac2dd5b3a68 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.401689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 788/1574] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:36.402958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b6f11-217b-4ab3-8ee5-002fd6b3dec8 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.403247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b6f11-217b-4ab3-8ee5-002fd6b3dec8 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.403542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b6f11-217b-4ab3-8ee5-002fd6b3dec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.422595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 787/1575] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:36.423302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc524d9-4698-4a8c-8ad7-0ac2dd5b3a68 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.432313 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-2c2b6f11-217b-4ab3-8ee5-002fd6b3dec8 None None] MFA Rules not processed for user `2d34a9b82f0b40eba62454a690761bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:36.433522 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2c2b6f11-217b-4ab3-8ee5-002fd6b3dec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:36.435021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc524d9-4698-4a8c-8ad7-0ac2dd5b3a68 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.503716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066a40f-f012-4ae0-840f-08cdc6cdd012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.504200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066a40f-f012-4ae0-840f-08cdc6cdd012 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.504476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066a40f-f012-4ae0-840f-08cdc6cdd012 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.504743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066a40f-f012-4ae0-840f-08cdc6cdd012 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.505493 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066a40f-f012-4ae0-840f-08cdc6cdd012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.507481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066a40f-f012-4ae0-840f-08cdc6cdd012 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.508992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 789/1576] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:36.510403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b6f11-217b-4ab3-8ee5-002fd6b3dec8 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.524598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b6f11-217b-4ab3-8ee5-002fd6b3dec8 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.531811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a7751-b932-43a7-8c20-67a564bec297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.532836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7751-b932-43a7-8c20-67a564bec297 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.533335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7751-b932-43a7-8c20-67a564bec297 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.533947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7751-b932-43a7-8c20-67a564bec297 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.535135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a7751-b932-43a7-8c20-67a564bec297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.537494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a7751-b932-43a7-8c20-67a564bec297 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.538010 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 788/1577] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/users => generated 278 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:36.538971 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066a40f-f012-4ae0-840f-08cdc6cdd012 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.554015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066a40f-f012-4ae0-840f-08cdc6cdd012 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.559489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c60866-83ca-4b99-87c5-6cfd968e53cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.560178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c60866-83ca-4b99-87c5-6cfd968e53cf admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.560524 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c60866-83ca-4b99-87c5-6cfd968e53cf admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.560774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c60866-83ca-4b99-87c5-6cfd968e53cf admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.562239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c60866-83ca-4b99-87c5-6cfd968e53cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.564291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c60866-83ca-4b99-87c5-6cfd968e53cf admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.571382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 790/1578] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/projects => generated 393 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:36.572538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a7751-b932-43a7-8c20-67a564bec297 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.595238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 789/1579] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:36.596805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c60866-83ca-4b99-87c5-6cfd968e53cf admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.610029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:36.638446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a7751-b932-43a7-8c20-67a564bec297 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.661026 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c60866-83ca-4b99-87c5-6cfd968e53cf admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.665667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9581675-d51a-4ac4-aa3f-a9e4da3328e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.666268 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9581675-d51a-4ac4-aa3f-a9e4da3328e6 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.666575 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9581675-d51a-4ac4-aa3f-a9e4da3328e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.666853 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9581675-d51a-4ac4-aa3f-a9e4da3328e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.667618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9581675-d51a-4ac4-aa3f-a9e4da3328e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.669077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9581675-d51a-4ac4-aa3f-a9e4da3328e6 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.679257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 790/1580] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:36.679955 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9581675-d51a-4ac4-aa3f-a9e4da3328e6 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.689785 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9581675-d51a-4ac4-aa3f-a9e4da3328e6 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.694330 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b117024-e8cc-4d16-96ff-08b4ed7a9895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.694921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b117024-e8cc-4d16-96ff-08b4ed7a9895 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.695206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b117024-e8cc-4d16-96ff-08b4ed7a9895 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.695477 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b117024-e8cc-4d16-96ff-08b4ed7a9895 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.696091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b117024-e8cc-4d16-96ff-08b4ed7a9895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.697952 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b117024-e8cc-4d16-96ff-08b4ed7a9895 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.698483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4f152-80c1-4017-a09a-5b3827de5e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.699161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4f152-80c1-4017-a09a-5b3827de5e0f admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.699440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4f152-80c1-4017-a09a-5b3827de5e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.699727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4f152-80c1-4017-a09a-5b3827de5e0f admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.700345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4f152-80c1-4017-a09a-5b3827de5e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.702267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4f152-80c1-4017-a09a-5b3827de5e0f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.706080 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:36.721281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 791/1581] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/users => generated 294 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:36.722154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b117024-e8cc-4d16-96ff-08b4ed7a9895 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.727442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 791/1582] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:36.728810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4f152-80c1-4017-a09a-5b3827de5e0f admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.731772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b117024-e8cc-4d16-96ff-08b4ed7a9895 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.736924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f549ce0-a671-4c77-9d02-be1a7cdb307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.737513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f549ce0-a671-4c77-9d02-be1a7cdb307b admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.737791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f549ce0-a671-4c77-9d02-be1a7cdb307b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.738174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f549ce0-a671-4c77-9d02-be1a7cdb307b admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.738871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f549ce0-a671-4c77-9d02-be1a7cdb307b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.739165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4f152-80c1-4017-a09a-5b3827de5e0f admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.740460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f549ce0-a671-4c77-9d02-be1a7cdb307b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.743741 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f670d21-b0d3-4b35-896c-8cb5fdf06ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.744322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f670d21-b0d3-4b35-896c-8cb5fdf06ebf admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.744599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f670d21-b0d3-4b35-896c-8cb5fdf06ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.744865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f670d21-b0d3-4b35-896c-8cb5fdf06ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.745490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f670d21-b0d3-4b35-896c-8cb5fdf06ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.747097 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f670d21-b0d3-4b35-896c-8cb5fdf06ebf admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.752671 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 792/1583] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:36.754131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b1087-da92-4cb2-a3b0-a0f4dde15062 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.754577 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b1087-da92-4cb2-a3b0-a0f4dde15062 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.754855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b1087-da92-4cb2-a3b0-a0f4dde15062 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.756280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 793/1584] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 16 05:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:34:36.757014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b1087-da92-4cb2-a3b0-a0f4dde15062 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.760976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 792/1585] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:36.760976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f670d21-b0d3-4b35-896c-8cb5fdf06ebf admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.769441 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f670d21-b0d3-4b35-896c-8cb5fdf06ebf admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.771960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b1087-da92-4cb2-a3b0-a0f4dde15062 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.774216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2df40-7f8f-46a5-b5ca-828f23cc80e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.774843 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2df40-7f8f-46a5-b5ca-828f23cc80e3 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.775123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2df40-7f8f-46a5-b5ca-828f23cc80e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.775410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2df40-7f8f-46a5-b5ca-828f23cc80e3 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.776031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2df40-7f8f-46a5-b5ca-828f23cc80e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.776478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67dd41-7609-4ace-878b-4ca56b9c7999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.777039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67dd41-7609-4ace-878b-4ca56b9c7999 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.777312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67dd41-7609-4ace-878b-4ca56b9c7999 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.777579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67dd41-7609-4ace-878b-4ca56b9c7999 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.777940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2df40-7f8f-46a5-b5ca-828f23cc80e3 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.778190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67dd41-7609-4ace-878b-4ca56b9c7999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.780131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67dd41-7609-4ace-878b-4ca56b9c7999 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.801505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 793/1586] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:36.801707 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 794/1587] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:36.802566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67dd41-7609-4ace-878b-4ca56b9c7999 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.805559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2df40-7f8f-46a5-b5ca-828f23cc80e3 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.812667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67dd41-7609-4ace-878b-4ca56b9c7999 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.815889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2df40-7f8f-46a5-b5ca-828f23cc80e3 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.817233 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f81bcd-1e42-41d0-9f82-14f5d987a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.817811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f81bcd-1e42-41d0-9f82-14f5d987a4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.818089 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f81bcd-1e42-41d0-9f82-14f5d987a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.818359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f81bcd-1e42-41d0-9f82-14f5d987a4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.819078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f81bcd-1e42-41d0-9f82-14f5d987a4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.820642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9e30f-bbea-404f-be08-5b763e12bbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.820781 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f81bcd-1e42-41d0-9f82-14f5d987a4a2 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.821226 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9e30f-bbea-404f-be08-5b763e12bbfa admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.821505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9e30f-bbea-404f-be08-5b763e12bbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.821774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9e30f-bbea-404f-be08-5b763e12bbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.822405 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9e30f-bbea-404f-be08-5b763e12bbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.824025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9e30f-bbea-404f-be08-5b763e12bbfa admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.831185 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 795/1588] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:36.831980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f81bcd-1e42-41d0-9f82-14f5d987a4a2 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.834622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 794/1589] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:36.835565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9e30f-bbea-404f-be08-5b763e12bbfa admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.841391 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f81bcd-1e42-41d0-9f82-14f5d987a4a2 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.846028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774eebd-b244-4ef2-a93c-28e928403da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.846654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774eebd-b244-4ef2-a93c-28e928403da5 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.846785 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9e30f-bbea-404f-be08-5b763e12bbfa admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.846941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774eebd-b244-4ef2-a93c-28e928403da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.847217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774eebd-b244-4ef2-a93c-28e928403da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.847843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774eebd-b244-4ef2-a93c-28e928403da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.849646 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774eebd-b244-4ef2-a93c-28e928403da5 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.851625 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ef69c-762b-4dbd-a425-a1fe3f2e5c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.852234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ef69c-762b-4dbd-a425-a1fe3f2e5c83 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.852497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ef69c-762b-4dbd-a425-a1fe3f2e5c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.852760 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ef69c-762b-4dbd-a425-a1fe3f2e5c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.853385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ef69c-762b-4dbd-a425-a1fe3f2e5c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.855039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ef69c-762b-4dbd-a425-a1fe3f2e5c83 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.863520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 796/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:36.866721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83342361-9750-40b4-9941-6410387fc945 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.866721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83342361-9750-40b4-9941-6410387fc945 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.866721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83342361-9750-40b4-9941-6410387fc945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.870679 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 795/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:36.871618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ef69c-762b-4dbd-a425-a1fe3f2e5c83 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.882637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ef69c-762b-4dbd-a425-a1fe3f2e5c83 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.887197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3963ac-63a0-431e-a985-dbb18035a65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.887788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3963ac-63a0-431e-a985-dbb18035a65e admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.888171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3963ac-63a0-431e-a985-dbb18035a65e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.888445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3963ac-63a0-431e-a985-dbb18035a65e admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.889072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3963ac-63a0-431e-a985-dbb18035a65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.890688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3963ac-63a0-431e-a985-dbb18035a65e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.900719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 796/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:36.901572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3963ac-63a0-431e-a985-dbb18035a65e admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.903052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-83342361-9750-40b4-9941-6410387fc945 None None] MFA Rules not processed for user `515e548efd984b87bca742e26eec162a`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:36.904267 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-83342361-9750-40b4-9941-6410387fc945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:36.913234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3963ac-63a0-431e-a985-dbb18035a65e admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.917794 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fb748-6420-4717-b309-3400f3aff345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.918368 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fb748-6420-4717-b309-3400f3aff345 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.918676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fb748-6420-4717-b309-3400f3aff345 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.918945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fb748-6420-4717-b309-3400f3aff345 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.919558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fb748-6420-4717-b309-3400f3aff345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.921706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fb748-6420-4717-b309-3400f3aff345 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.931646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 797/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:36.932218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fb748-6420-4717-b309-3400f3aff345 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.941912 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fb748-6420-4717-b309-3400f3aff345 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.947171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2b76b-e160-42cd-9fc2-95939628177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.947808 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2b76b-e160-42cd-9fc2-95939628177b admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.948115 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2b76b-e160-42cd-9fc2-95939628177b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.948383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2b76b-e160-42cd-9fc2-95939628177b admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.949059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2b76b-e160-42cd-9fc2-95939628177b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.950697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2b76b-e160-42cd-9fc2-95939628177b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.961552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 798/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:36.962406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2b76b-e160-42cd-9fc2-95939628177b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.973637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2b76b-e160-42cd-9fc2-95939628177b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.975484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 797/1595] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 16 05:34:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:36.976159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83342361-9750-40b4-9941-6410387fc945 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:36.978336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83616868-2ef6-4008-b30b-73b3334ba24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.978933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83616868-2ef6-4008-b30b-73b3334ba24b admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.979206 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83616868-2ef6-4008-b30b-73b3334ba24b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.979471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83616868-2ef6-4008-b30b-73b3334ba24b admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.980079 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83616868-2ef6-4008-b30b-73b3334ba24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:36.981636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83616868-2ef6-4008-b30b-73b3334ba24b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:36.986494 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83342361-9750-40b4-9941-6410387fc945 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:36.991737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da9dfb-afce-411c-8895-433294318e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:36.992378 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da9dfb-afce-411c-8895-433294318e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:36.992607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 799/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:36.992871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da9dfb-afce-411c-8895-433294318e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:36.993153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da9dfb-afce-411c-8895-433294318e43 admin admin] PATH_INFO: `/v3/projects/3c2d7c2e992c419b8fbd81229447ba47/users/18fafa4f50b14af297d8c8adf49c2925/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:36.993439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83616868-2ef6-4008-b30b-73b3334ba24b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.002705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83616868-2ef6-4008-b30b-73b3334ba24b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.007247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d19c0-e363-45ba-9f57-87b1941dadd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.007808 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d19c0-e363-45ba-9f57-87b1941dadd1 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.008082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d19c0-e363-45ba-9f57-87b1941dadd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.008346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d19c0-e363-45ba-9f57-87b1941dadd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.008747 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da9dfb-afce-411c-8895-433294318e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2d7c2e992c419b8fbd81229447ba47, user_id=18fafa4f50b14af297d8c8adf49c2925, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.008957 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d19c0-e363-45ba-9f57-87b1941dadd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.010500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d19c0-e363-45ba-9f57-87b1941dadd1 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.011476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da9dfb-afce-411c-8895-433294318e43 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.020893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 800/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:37.021817 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d19c0-e363-45ba-9f57-87b1941dadd1 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.026044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 798/1598] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:36 2022] PUT /identity/v3/projects/3c2d7c2e992c419b8fbd81229447ba47/users/18fafa4f50b14af297d8c8adf49c2925/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:37.026718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da9dfb-afce-411c-8895-433294318e43 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.032283 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d19c0-e363-45ba-9f57-87b1941dadd1 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.053347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:37.081870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:37.091336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac8223-1399-45a2-b1c7-109e9fd2a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.091998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8223-1399-45a2-b1c7-109e9fd2a85d admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.092279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8223-1399-45a2-b1c7-109e9fd2a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.093249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8223-1399-45a2-b1c7-109e9fd2a85d admin admin] PATH_INFO: `/v3/projects/701132ccdb8c4ca4a53e1efc960f3b55/users/b7897df779fd4d30a1b8962aa644f5a9/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.093513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da9dfb-afce-411c-8895-433294318e43 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.098431 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8b95f-1311-4e0a-a24b-f20b305b0bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.099108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8b95f-1311-4e0a-a24b-f20b305b0bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.099384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8b95f-1311-4e0a-a24b-f20b305b0bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.099649 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8b95f-1311-4e0a-a24b-f20b305b0bdd admin admin] PATH_INFO: `/v3/projects/2dc7f939e90847b5b8c79088a7198faa/users/32c0eee4a5824c0db0d86aefa8bffd3c/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.107542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac8223-1399-45a2-b1c7-109e9fd2a85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=701132ccdb8c4ca4a53e1efc960f3b55, user_id=b7897df779fd4d30a1b8962aa644f5a9, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.109209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: WARNING py.warnings [None req-d1ac8223-1399-45a2-b1c7-109e9fd2a85d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:34:37.109209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: warnings.warn(msg) Sep 16 05:34:37.109209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: Sep 16 05:34:37.111186 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac8223-1399-45a2-b1c7-109e9fd2a85d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.114238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8b95f-1311-4e0a-a24b-f20b305b0bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc7f939e90847b5b8c79088a7198faa, user_id=32c0eee4a5824c0db0d86aefa8bffd3c, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.117322 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8b95f-1311-4e0a-a24b-f20b305b0bdd admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.127227 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 801/1599] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:37 2022] PUT /identity/v3/projects/701132ccdb8c4ca4a53e1efc960f3b55/users/b7897df779fd4d30a1b8962aa644f5a9/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:37.128382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac8223-1399-45a2-b1c7-109e9fd2a85d admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.130301 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 799/1600] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:37 2022] PUT /identity/v3/projects/2dc7f939e90847b5b8c79088a7198faa/users/32c0eee4a5824c0db0d86aefa8bffd3c/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:37.131221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8b95f-1311-4e0a-a24b-f20b305b0bdd admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.193722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8b95f-1311-4e0a-a24b-f20b305b0bdd admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.196362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac8223-1399-45a2-b1c7-109e9fd2a85d admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.198343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6282658-12fc-4d8f-8623-58c40e839d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.198987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282658-12fc-4d8f-8623-58c40e839d77 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.199255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282658-12fc-4d8f-8623-58c40e839d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.199525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282658-12fc-4d8f-8623-58c40e839d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.200163 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6282658-12fc-4d8f-8623-58c40e839d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.200923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17c3d1-1242-43b6-8f21-ead4e6dcf59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.201525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17c3d1-1242-43b6-8f21-ead4e6dcf59e admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.201756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6282658-12fc-4d8f-8623-58c40e839d77 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.201886 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17c3d1-1242-43b6-8f21-ead4e6dcf59e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.202090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17c3d1-1242-43b6-8f21-ead4e6dcf59e admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.202949 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17c3d1-1242-43b6-8f21-ead4e6dcf59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.205001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17c3d1-1242-43b6-8f21-ead4e6dcf59e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.212125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 800/1601] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:37.212729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6282658-12fc-4d8f-8623-58c40e839d77 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.219182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 802/1602] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:37.219948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17c3d1-1242-43b6-8f21-ead4e6dcf59e admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.232566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17c3d1-1242-43b6-8f21-ead4e6dcf59e admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.239358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc5a75-4bf6-4886-8a05-9f7893b88579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.240098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc5a75-4bf6-4886-8a05-9f7893b88579 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.240435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc5a75-4bf6-4886-8a05-9f7893b88579 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.240779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc5a75-4bf6-4886-8a05-9f7893b88579 admin admin] PATH_INFO: `/v3/projects/a3ef615467f74f0ba9718bee8e388766/users/fa478cd622a949d58a2f0eb4bb437368/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.256866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc5a75-4bf6-4886-8a05-9f7893b88579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ef615467f74f0ba9718bee8e388766, user_id=fa478cd622a949d58a2f0eb4bb437368, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.259633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc5a75-4bf6-4886-8a05-9f7893b88579 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.273057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 803/1603] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:37 2022] PUT /identity/v3/projects/a3ef615467f74f0ba9718bee8e388766/users/fa478cd622a949d58a2f0eb4bb437368/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:37.276904 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc5a75-4bf6-4886-8a05-9f7893b88579 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.286708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6282658-12fc-4d8f-8623-58c40e839d77 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.337330 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc5a75-4bf6-4886-8a05-9f7893b88579 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.343382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c9091-fbfa-47d1-86e6-1658400a87ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.344026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c9091-fbfa-47d1-86e6-1658400a87ec admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.344296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c9091-fbfa-47d1-86e6-1658400a87ec admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.344562 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c9091-fbfa-47d1-86e6-1658400a87ec admin admin] PATH_INFO: `/v3/projects/42b02de7fd24469c92f9bff55e67d254/users/445f041ccc3f4da8bc7ba279b1711f09/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.353946 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32134a89-e062-489a-8e15-480ffc208bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.354602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32134a89-e062-489a-8e15-480ffc208bd1 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.355221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32134a89-e062-489a-8e15-480ffc208bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.355492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32134a89-e062-489a-8e15-480ffc208bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.359264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c9091-fbfa-47d1-86e6-1658400a87ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b02de7fd24469c92f9bff55e67d254, user_id=445f041ccc3f4da8bc7ba279b1711f09, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.360847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:37.361935 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c9091-fbfa-47d1-86e6-1658400a87ec admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.375986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 804/1604] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:37 2022] PUT /identity/v3/projects/42b02de7fd24469c92f9bff55e67d254/users/445f041ccc3f4da8bc7ba279b1711f09/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:37.377494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395caa8b-4dac-4f43-8cc1-95a9ffece0da None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.377778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395caa8b-4dac-4f43-8cc1-95a9ffece0da None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.378042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395caa8b-4dac-4f43-8cc1-95a9ffece0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.384709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:37.399132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-395caa8b-4dac-4f43-8cc1-95a9ffece0da None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:37.400334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-395caa8b-4dac-4f43-8cc1-95a9ffece0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:37.427950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32134a89-e062-489a-8e15-480ffc208bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.429539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32134a89-e062-489a-8e15-480ffc208bd1 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.438427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 801/1605] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:37.439797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d26801-b5bc-46d0-b485-eb592dc55181 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.440076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d26801-b5bc-46d0-b485-eb592dc55181 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.440351 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d26801-b5bc-46d0-b485-eb592dc55181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.463665 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 805/1606] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:37.464768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5e715-33fd-45bd-97d6-6f0a0c410e08 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.465117 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5e715-33fd-45bd-97d6-6f0a0c410e08 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.465495 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5e715-33fd-45bd-97d6-6f0a0c410e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.469807 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-78d26801-b5bc-46d0-b485-eb592dc55181 None None] MFA Rules not processed for user `32c0eee4a5824c0db0d86aefa8bffd3c`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:37.471103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-78d26801-b5bc-46d0-b485-eb592dc55181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:37.496108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-daa5e715-33fd-45bd-97d6-6f0a0c410e08 None None] MFA Rules not processed for user `b7897df779fd4d30a1b8962aa644f5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:37.497416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-daa5e715-33fd-45bd-97d6-6f0a0c410e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:37.542137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 802/1607] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:37.543360 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d26801-b5bc-46d0-b485-eb592dc55181 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.555477 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d26801-b5bc-46d0-b485-eb592dc55181 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.560959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfc9aa-9acd-4df1-a2b5-5ddbff21362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.561833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfc9aa-9acd-4df1-a2b5-5ddbff21362c admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.562650 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfc9aa-9acd-4df1-a2b5-5ddbff21362c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.563075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfc9aa-9acd-4df1-a2b5-5ddbff21362c admin admin] PATH_INFO: `/v3/projects/67f39dbf6876461cbcaef600569015fe/users/7079422a25134eaa83102f970cc2b287/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.568184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 806/1608] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:37 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:37.569240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5e715-33fd-45bd-97d6-6f0a0c410e08 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.580033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfc9aa-9acd-4df1-a2b5-5ddbff21362c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f39dbf6876461cbcaef600569015fe, user_id=7079422a25134eaa83102f970cc2b287, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.582433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5e715-33fd-45bd-97d6-6f0a0c410e08 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.583095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfc9aa-9acd-4df1-a2b5-5ddbff21362c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.587639 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28e230-09ad-4080-a3ab-a4271e5eded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.588629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28e230-09ad-4080-a3ab-a4271e5eded6 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.588969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28e230-09ad-4080-a3ab-a4271e5eded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.589281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28e230-09ad-4080-a3ab-a4271e5eded6 admin admin] PATH_INFO: `/v3/projects/16dd41e007f046179da570ff48e6a5d7/users/946827404b58485daed0fc22a6da379a/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.598724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 803/1609] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:37 2022] PUT /identity/v3/projects/67f39dbf6876461cbcaef600569015fe/users/7079422a25134eaa83102f970cc2b287/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:37.600207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bb16f-e502-4b27-83fe-21da614bdd32 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.600866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bb16f-e502-4b27-83fe-21da614bdd32 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.601014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bb16f-e502-4b27-83fe-21da614bdd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.607169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28e230-09ad-4080-a3ab-a4271e5eded6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16dd41e007f046179da570ff48e6a5d7, user_id=946827404b58485daed0fc22a6da379a, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.609934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28e230-09ad-4080-a3ab-a4271e5eded6 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.621052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-156bb16f-e502-4b27-83fe-21da614bdd32 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:37.622250 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-156bb16f-e502-4b27-83fe-21da614bdd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:37.629310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 807/1610] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:37 2022] PUT /identity/v3/projects/16dd41e007f046179da570ff48e6a5d7/users/946827404b58485daed0fc22a6da379a/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:37.629310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf9cf8-1a26-4149-9311-2cb869662551 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.629310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf9cf8-1a26-4149-9311-2cb869662551 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.629310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf9cf8-1a26-4149-9311-2cb869662551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.665529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-7fcf9cf8-1a26-4149-9311-2cb869662551 None None] MFA Rules not processed for user `445f041ccc3f4da8bc7ba279b1711f09`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:37.666778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-7fcf9cf8-1a26-4149-9311-2cb869662551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:37.684092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 804/1611] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:37.685003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bb16f-e502-4b27-83fe-21da614bdd32 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.704680 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:37.730706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:37.737194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 808/1612] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:37.740010 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf9cf8-1a26-4149-9311-2cb869662551 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.749711 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bb16f-e502-4b27-83fe-21da614bdd32 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.751321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf9cf8-1a26-4149-9311-2cb869662551 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.753509 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46ab6f-6e09-4c44-9842-767cca0c18b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.754219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46ab6f-6e09-4c44-9842-767cca0c18b8 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.754597 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46ab6f-6e09-4c44-9842-767cca0c18b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.754942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46ab6f-6e09-4c44-9842-767cca0c18b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.756752 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f7104-0a34-4a88-b806-e9f9f6d557fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.757353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f7104-0a34-4a88-b806-e9f9f6d557fc admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.757753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f7104-0a34-4a88-b806-e9f9f6d557fc admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.757956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f7104-0a34-4a88-b806-e9f9f6d557fc admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.758694 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f7104-0a34-4a88-b806-e9f9f6d557fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.760461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f7104-0a34-4a88-b806-e9f9f6d557fc admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.765683 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46ab6f-6e09-4c44-9842-767cca0c18b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.767147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46ab6f-6e09-4c44-9842-767cca0c18b8 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.779515 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 805/1613] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:37.780365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46ab6f-6e09-4c44-9842-767cca0c18b8 service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.789457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46ab6f-6e09-4c44-9842-767cca0c18b8 service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.795589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 809/1614] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:37 2022] POST /identity/v3/projects => generated 357 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:37.795589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368271-9cb8-44a6-a6ef-2a330f8b0b04 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.795589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368271-9cb8-44a6-a6ef-2a330f8b0b04 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.795589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368271-9cb8-44a6-a6ef-2a330f8b0b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.798259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608d50c-2974-43a9-8f58-414e6ce0068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.798967 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608d50c-2974-43a9-8f58-414e6ce0068d admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.799364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608d50c-2974-43a9-8f58-414e6ce0068d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.799733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608d50c-2974-43a9-8f58-414e6ce0068d admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.800477 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608d50c-2974-43a9-8f58-414e6ce0068d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.802476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608d50c-2974-43a9-8f58-414e6ce0068d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.816189 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-16368271-9cb8-44a6-a6ef-2a330f8b0b04 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:37.817262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-16368271-9cb8-44a6-a6ef-2a330f8b0b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:37.835355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 806/1615] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:37 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:37.837098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdf81c-5444-44a9-b252-cad1237960b5 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.837880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdf81c-5444-44a9-b252-cad1237960b5 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.838415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdf81c-5444-44a9-b252-cad1237960b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.861013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-effdf81c-5444-44a9-b252-cad1237960b5 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:37.862580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-effdf81c-5444-44a9-b252-cad1237960b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:37.891523 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 810/1616] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:37.893238 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b05894-ba6b-4fbf-b3cd-ab40ec73d3ad None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.893529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b05894-ba6b-4fbf-b3cd-ab40ec73d3ad None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.893801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b05894-ba6b-4fbf-b3cd-ab40ec73d3ad None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.895633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 811/1617] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 16 05:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:34:37.896867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b05894-ba6b-4fbf-b3cd-ab40ec73d3ad None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.962201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 807/1618] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:37.963510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d7adb-b373-4dcd-be61-04cbd632cdaa None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.963819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d7adb-b373-4dcd-be61-04cbd632cdaa None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.964068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d7adb-b373-4dcd-be61-04cbd632cdaa None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.967096 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 808/1619] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 16 05:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:34:37.967096 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d7adb-b373-4dcd-be61-04cbd632cdaa None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:37.972872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b05894-ba6b-4fbf-b3cd-ab40ec73d3ad None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.976738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687775-b273-4fa7-8613-44e64be061af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.977909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687775-b273-4fa7-8613-44e64be061af service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.977909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687775-b273-4fa7-8613-44e64be061af service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.977909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687775-b273-4fa7-8613-44e64be061af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.980406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d7adb-b373-4dcd-be61-04cbd632cdaa None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:37.986465 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7bff6-92c7-4555-83d8-54748e0a12f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:37.987222 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7bff6-92c7-4555-83d8-54748e0a12f4 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:37.987666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7bff6-92c7-4555-83d8-54748e0a12f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:37.988252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7bff6-92c7-4555-83d8-54748e0a12f4 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:37.988858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7bff6-92c7-4555-83d8-54748e0a12f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.990557 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22687775-b273-4fa7-8613-44e64be061af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:37.991265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7bff6-92c7-4555-83d8-54748e0a12f4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:37.992087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22687775-b273-4fa7-8613-44e64be061af service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.002904 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 812/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:38.003732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687775-b273-4fa7-8613-44e64be061af service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.017415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687775-b273-4fa7-8613-44e64be061af service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:38.021565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 809/1621] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:37 2022] POST /identity/v3/users => generated 285 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:38.021565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974ab18-b720-40ea-9035-d1c3fe55f733 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.021565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974ab18-b720-40ea-9035-d1c3fe55f733 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.021565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974ab18-b720-40ea-9035-d1c3fe55f733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.026148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3179a-daa5-4551-b9ce-149ab5f0a6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:38.027240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3179a-daa5-4551-b9ce-149ab5f0a6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.027538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3179a-daa5-4551-b9ce-149ab5f0a6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.027845 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3179a-daa5-4551-b9ce-149ab5f0a6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.028482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3179a-daa5-4551-b9ce-149ab5f0a6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:38.030695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3179a-daa5-4551-b9ce-149ab5f0a6f0 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.043192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-d974ab18-b720-40ea-9035-d1c3fe55f733 None None] MFA Rules not processed for user `515e548efd984b87bca742e26eec162a`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:38.043373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d974ab18-b720-40ea-9035-d1c3fe55f733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:38.066287 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 813/1622] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:38 2022] POST /identity/v3/users => generated 308 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:38.067296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3179a-daa5-4551-b9ce-149ab5f0a6f0 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.069134 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-98e3179a-daa5-4551-b9ce-149ab5f0a6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:38.083436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3179a-daa5-4551-b9ce-149ab5f0a6f0 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:38.087635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30707e39-9686-4903-933b-e200989b989a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:38.088235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707e39-9686-4903-933b-e200989b989a service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.088517 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707e39-9686-4903-933b-e200989b989a service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.088791 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707e39-9686-4903-933b-e200989b989a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.100145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30707e39-9686-4903-933b-e200989b989a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:38.101801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30707e39-9686-4903-933b-e200989b989a service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.114792 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 814/1623] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:38.116012 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c020682-c00b-4ce6-8240-bdd6cb74edac None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.116437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c020682-c00b-4ce6-8240-bdd6cb74edac None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.116849 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c020682-c00b-4ce6-8240-bdd6cb74edac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.140959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-1c020682-c00b-4ce6-8240-bdd6cb74edac None None] MFA Rules not processed for user `515e548efd984b87bca742e26eec162a`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:38.142820 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1c020682-c00b-4ce6-8240-bdd6cb74edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:38.148360 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 810/1624] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:34:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:38.149663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974ab18-b720-40ea-9035-d1c3fe55f733 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.163399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 815/1625] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 16 05:34:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:38.164919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c020682-c00b-4ce6-8240-bdd6cb74edac None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.173309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974ab18-b720-40ea-9035-d1c3fe55f733 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:38.179552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364542c9-268b-444b-9fd1-829dc42db0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:38.180271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364542c9-268b-444b-9fd1-829dc42db0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.180751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364542c9-268b-444b-9fd1-829dc42db0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.181098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364542c9-268b-444b-9fd1-829dc42db0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.182138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c020682-c00b-4ce6-8240-bdd6cb74edac None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:38.190064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78830ef2-f262-48e0-ad82-01ca0907b51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:38.191204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78830ef2-f262-48e0-ad82-01ca0907b51e admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.191456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:38.191885 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78830ef2-f262-48e0-ad82-01ca0907b51e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.192770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78830ef2-f262-48e0-ad82-01ca0907b51e admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.194549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78830ef2-f262-48e0-ad82-01ca0907b51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:38.195509 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364542c9-268b-444b-9fd1-829dc42db0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:38.197938 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78830ef2-f262-48e0-ad82-01ca0907b51e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.198647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364542c9-268b-444b-9fd1-829dc42db0e4 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.217712 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 811/1626] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:38.218881 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364542c9-268b-444b-9fd1-829dc42db0e4 service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.220272 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 816/1627] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:38.221641 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78830ef2-f262-48e0-ad82-01ca0907b51e admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.232703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364542c9-268b-444b-9fd1-829dc42db0e4 service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:38.241565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e3b42-b2b7-4502-88ee-ed9b3a6f9368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:38.242339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e3b42-b2b7-4502-88ee-ed9b3a6f9368 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.242686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e3b42-b2b7-4502-88ee-ed9b3a6f9368 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.243022 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e3b42-b2b7-4502-88ee-ed9b3a6f9368 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.243657 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e3b42-b2b7-4502-88ee-ed9b3a6f9368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:38.245268 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e3b42-b2b7-4502-88ee-ed9b3a6f9368 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.261692 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 812/1628] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:38.263008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e3b42-b2b7-4502-88ee-ed9b3a6f9368 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.270404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:38.284170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e3b42-b2b7-4502-88ee-ed9b3a6f9368 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:38.293475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2547ff-c079-4575-bd6a-53404a270c9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:38.294410 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2547ff-c079-4575-bd6a-53404a270c9d service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.294920 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2547ff-c079-4575-bd6a-53404a270c9d service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.295372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2547ff-c079-4575-bd6a-53404a270c9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.301494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78830ef2-f262-48e0-ad82-01ca0907b51e admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:38.306697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7a646-8054-43d2-a98c-c0c0401cc02a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:38.307425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7a646-8054-43d2-a98c-c0c0401cc02a service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.307782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7a646-8054-43d2-a98c-c0c0401cc02a service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.308121 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7a646-8054-43d2-a98c-c0c0401cc02a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.322601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7a646-8054-43d2-a98c-c0c0401cc02a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:38.324411 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7a646-8054-43d2-a98c-c0c0401cc02a service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.340670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 817/1629] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:38.341698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7a646-8054-43d2-a98c-c0c0401cc02a service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.356584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7a646-8054-43d2-a98c-c0c0401cc02a service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:38.363156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f487100-5b12-4a3e-b241-7dedf13bf0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:38.363914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487100-5b12-4a3e-b241-7dedf13bf0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.364656 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487100-5b12-4a3e-b241-7dedf13bf0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.364656 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487100-5b12-4a3e-b241-7dedf13bf0b3 admin admin] PATH_INFO: `/v3/projects/900e2a59b58f451bafc11da404edf8a9/users/77f27489966746c28cb6e2fc6bc9513f/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.384383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2547ff-c079-4575-bd6a-53404a270c9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:38.388148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2547ff-c079-4575-bd6a-53404a270c9d service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.402139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f487100-5b12-4a3e-b241-7dedf13bf0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=900e2a59b58f451bafc11da404edf8a9, user_id=77f27489966746c28cb6e2fc6bc9513f, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:38.409893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f487100-5b12-4a3e-b241-7dedf13bf0b3 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.418368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 813/1630] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:38.419887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2547ff-c079-4575-bd6a-53404a270c9d service nova] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.447513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2547ff-c079-4575-bd6a-53404a270c9d service nova] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:38.449588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 818/1631] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:38 2022] PUT /identity/v3/projects/900e2a59b58f451bafc11da404edf8a9/users/77f27489966746c28cb6e2fc6bc9513f/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:38.456173 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f487100-5b12-4a3e-b241-7dedf13bf0b3 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.571748 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f487100-5b12-4a3e-b241-7dedf13bf0b3 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:38.578551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c01b8f-31b7-4dd2-9a2f-42c4b828d1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:38.579330 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c01b8f-31b7-4dd2-9a2f-42c4b828d1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.579716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c01b8f-31b7-4dd2-9a2f-42c4b828d1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.579998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c01b8f-31b7-4dd2-9a2f-42c4b828d1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.581411 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c01b8f-31b7-4dd2-9a2f-42c4b828d1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:38.583338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c01b8f-31b7-4dd2-9a2f-42c4b828d1a9 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.601592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 819/1632] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:38.602858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c01b8f-31b7-4dd2-9a2f-42c4b828d1a9 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.604475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bbefe-f5e8-4daa-a846-f9334060d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:38.605160 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bbefe-f5e8-4daa-a846-f9334060d7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.605443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bbefe-f5e8-4daa-a846-f9334060d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.605720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bbefe-f5e8-4daa-a846-f9334060d7a1 admin admin] PATH_INFO: `/v3/projects/f397d095af2d42d2960d44517431e9a8/users/4fbf9440c5f6443f9c754beb5b30cbbc/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.618176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c01b8f-31b7-4dd2-9a2f-42c4b828d1a9 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:38.624802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6376685-8a4c-4ac8-8156-18070ec393b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:38.625690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376685-8a4c-4ac8-8156-18070ec393b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.626205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376685-8a4c-4ac8-8156-18070ec393b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.626620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376685-8a4c-4ac8-8156-18070ec393b6 admin admin] PATH_INFO: `/v3/projects/900e2a59b58f451bafc11da404edf8a9/users/77f27489966746c28cb6e2fc6bc9513f/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.629152 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6376685-8a4c-4ac8-8156-18070ec393b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=900e2a59b58f451bafc11da404edf8a9, user_id=77f27489966746c28cb6e2fc6bc9513f, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:38.632437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6376685-8a4c-4ac8-8156-18070ec393b6 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.648440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bbefe-f5e8-4daa-a846-f9334060d7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f397d095af2d42d2960d44517431e9a8, user_id=4fbf9440c5f6443f9c754beb5b30cbbc, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:38.653204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bbefe-f5e8-4daa-a846-f9334060d7a1 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.656917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 820/1633] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:38 2022] PUT /identity/v3/projects/900e2a59b58f451bafc11da404edf8a9/users/77f27489966746c28cb6e2fc6bc9513f/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:38.658397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732394b-be5c-4454-8560-929e2faa7e91 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.658737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732394b-be5c-4454-8560-929e2faa7e91 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.659094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732394b-be5c-4454-8560-929e2faa7e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.685913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 814/1634] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:38 2022] PUT /identity/v3/projects/f397d095af2d42d2960d44517431e9a8/users/4fbf9440c5f6443f9c754beb5b30cbbc/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:38.688826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bbefe-f5e8-4daa-a846-f9334060d7a1 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.709922 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-4732394b-be5c-4454-8560-929e2faa7e91 None None] MFA Rules not processed for user `77f27489966746c28cb6e2fc6bc9513f`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:38.711207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4732394b-be5c-4454-8560-929e2faa7e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:38.832729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bbefe-f5e8-4daa-a846-f9334060d7a1 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:38.846811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea9d89-ae0a-4556-aa93-45d7214dd090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:38.847559 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9d89-ae0a-4556-aa93-45d7214dd090 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.847978 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9d89-ae0a-4556-aa93-45d7214dd090 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.848341 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9d89-ae0a-4556-aa93-45d7214dd090 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.850558 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea9d89-ae0a-4556-aa93-45d7214dd090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:38.852310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea9d89-ae0a-4556-aa93-45d7214dd090 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.864014 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 821/1635] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:38.871976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732394b-be5c-4454-8560-929e2faa7e91 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.884776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 815/1636] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:38.896309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea9d89-ae0a-4556-aa93-45d7214dd090 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:38.904959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:38.906375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:38.920400 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea9d89-ae0a-4556-aa93-45d7214dd090 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:38.939584 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc65ec4-2d25-4142-9e19-5758e1dbce8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:38.940624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65ec4-2d25-4142-9e19-5758e1dbce8e admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:38.941104 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65ec4-2d25-4142-9e19-5758e1dbce8e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:38.941705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65ec4-2d25-4142-9e19-5758e1dbce8e admin admin] PATH_INFO: `/v3/projects/f397d095af2d42d2960d44517431e9a8/users/4fbf9440c5f6443f9c754beb5b30cbbc/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:38.945566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc65ec4-2d25-4142-9e19-5758e1dbce8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f397d095af2d42d2960d44517431e9a8, user_id=4fbf9440c5f6443f9c754beb5b30cbbc, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:38.950640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc65ec4-2d25-4142-9e19-5758e1dbce8e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:38.987871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 816/1637] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:38 2022] PUT /identity/v3/projects/f397d095af2d42d2960d44517431e9a8/users/4fbf9440c5f6443f9c754beb5b30cbbc/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:38.999877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e9421-8ce2-43ef-afa3-af2c905c06d1 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:39.000991 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e9421-8ce2-43ef-afa3-af2c905c06d1 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:39.001731 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e9421-8ce2-43ef-afa3-af2c905c06d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:39.018925 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732394b-be5c-4454-8560-929e2faa7e91 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:39.050981 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-fc4e9421-8ce2-43ef-afa3-af2c905c06d1 None None] MFA Rules not processed for user `4fbf9440c5f6443f9c754beb5b30cbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:39.055096 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-fc4e9421-8ce2-43ef-afa3-af2c905c06d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:39.163837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55884c3b-8104-40bf-bc87-8dff0175821e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:39.166581 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55884c3b-8104-40bf-bc87-8dff0175821e service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:39.166881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55884c3b-8104-40bf-bc87-8dff0175821e service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:39.168370 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55884c3b-8104-40bf-bc87-8dff0175821e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:39.247194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 817/1638] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:38 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:39.247194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e84fa-4796-4ee6-84ca-9cc15ed57026 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:39.247194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e84fa-4796-4ee6-84ca-9cc15ed57026 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:39.248172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e84fa-4796-4ee6-84ca-9cc15ed57026 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:39.250549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 818/1639] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 16 05:34:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:34:39.259889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647b529-f479-4720-92ba-571bd9549828 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:39.260316 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647b529-f479-4720-92ba-571bd9549828 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:39.260753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647b529-f479-4720-92ba-571bd9549828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:39.312621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-7647b529-f479-4720-92ba-571bd9549828 None None] MFA Rules not processed for user `515e548efd984b87bca742e26eec162a`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:39.314258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7647b529-f479-4720-92ba-571bd9549828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:39.341695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55884c3b-8104-40bf-bc87-8dff0175821e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:39.343652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55884c3b-8104-40bf-bc87-8dff0175821e service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:39.375128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 822/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:39.475775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55884c3b-8104-40bf-bc87-8dff0175821e service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:39.488727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55884c3b-8104-40bf-bc87-8dff0175821e service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:39.501306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e6514-a709-4d9b-a3da-86bbac825499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:39.502581 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e6514-a709-4d9b-a3da-86bbac825499 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:39.503173 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e6514-a709-4d9b-a3da-86bbac825499 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:39.504066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e6514-a709-4d9b-a3da-86bbac825499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:39.527121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 819/1641] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:34:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:39.535315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e6514-a709-4d9b-a3da-86bbac825499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:39.541199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e6514-a709-4d9b-a3da-86bbac825499 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:39.567490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 823/1642] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:39 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:34:39.718059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647b529-f479-4720-92ba-571bd9549828 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:39.728517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647b529-f479-4720-92ba-571bd9549828 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:39.732327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53b10e-5e79-48b7-9f4f-c0be9aa43786 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:39.732944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53b10e-5e79-48b7-9f4f-c0be9aa43786 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:39.733736 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53b10e-5e79-48b7-9f4f-c0be9aa43786 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:39.734002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53b10e-5e79-48b7-9f4f-c0be9aa43786 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:39.746878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53b10e-5e79-48b7-9f4f-c0be9aa43786 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:39.748551 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53b10e-5e79-48b7-9f4f-c0be9aa43786 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:39.770748 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 820/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:39.821704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e6514-a709-4d9b-a3da-86bbac825499 service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:39.832140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e6514-a709-4d9b-a3da-86bbac825499 service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:39.846134 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ef14f-2502-44aa-a32d-320bf90506ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:39.848445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ef14f-2502-44aa-a32d-320bf90506ea service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:39.850893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ef14f-2502-44aa-a32d-320bf90506ea service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:39.851576 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ef14f-2502-44aa-a32d-320bf90506ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:39.970272 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ef14f-2502-44aa-a32d-320bf90506ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:39.971401 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ef14f-2502-44aa-a32d-320bf90506ea service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:39.982773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 824/1644] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:40.200627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53b10e-5e79-48b7-9f4f-c0be9aa43786 service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:40.302239 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ef14f-2502-44aa-a32d-320bf90506ea service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:40.317376 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:40.377194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:40.419133 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53b10e-5e79-48b7-9f4f-c0be9aa43786 service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:40.432884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a50965-f7bf-44aa-aa6c-ba460c9d1b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:40.433886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a50965-f7bf-44aa-aa6c-ba460c9d1b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:40.434449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a50965-f7bf-44aa-aa6c-ba460c9d1b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:40.434766 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a50965-f7bf-44aa-aa6c-ba460c9d1b3b admin admin] PATH_INFO: `/v3/users/445f041ccc3f4da8bc7ba279b1711f09` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:40.437914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a50965-f7bf-44aa-aa6c-ba460c9d1b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=445f041ccc3f4da8bc7ba279b1711f09)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:40.446425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a50965-f7bf-44aa-aa6c-ba460c9d1b3b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:40.491309 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ef14f-2502-44aa-a32d-320bf90506ea service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:40.512134 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021d18e-2395-4f27-b0d1-257074304f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:40.512795 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021d18e-2395-4f27-b0d1-257074304f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:40.513078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021d18e-2395-4f27-b0d1-257074304f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:40.513351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021d18e-2395-4f27-b0d1-257074304f8f admin admin] PATH_INFO: `/v3/users/b7897df779fd4d30a1b8962aa644f5a9` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:40.516040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021d18e-2395-4f27-b0d1-257074304f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7897df779fd4d30a1b8962aa644f5a9)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:40.527655 dv-cinder-857528-3-smb devstack@keystone.service[104772]: WARNING py.warnings [None req-3021d18e-2395-4f27-b0d1-257074304f8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:34:40.527655 dv-cinder-857528-3-smb devstack@keystone.service[104772]: warnings.warn(msg) Sep 16 05:34:40.527655 dv-cinder-857528-3-smb devstack@keystone.service[104772]: Sep 16 05:34:40.531857 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021d18e-2395-4f27-b0d1-257074304f8f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:40.596552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f9a50965-f7bf-44aa-aa6c-ba460c9d1b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445f041ccc3f4da8bc7ba279b1711f09'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:40.599869 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f9a50965-f7bf-44aa-aa6c-ba460c9d1b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445f041ccc3f4da8bc7ba279b1711f09'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:40.624332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f9a50965-f7bf-44aa-aa6c-ba460c9d1b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445f041ccc3f4da8bc7ba279b1711f09'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:40.647191 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f9a50965-f7bf-44aa-aa6c-ba460c9d1b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445f041ccc3f4da8bc7ba279b1711f09'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:40.648142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f9a50965-f7bf-44aa-aa6c-ba460c9d1b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445f041ccc3f4da8bc7ba279b1711f09'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:40.691906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3021d18e-2395-4f27-b0d1-257074304f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7897df779fd4d30a1b8962aa644f5a9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:40.694375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3021d18e-2395-4f27-b0d1-257074304f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7897df779fd4d30a1b8962aa644f5a9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:40.710349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 821/1645] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:34:40 2022] DELETE /identity/v3/users/445f041ccc3f4da8bc7ba279b1711f09 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:40.716267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3021d18e-2395-4f27-b0d1-257074304f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7897df779fd4d30a1b8962aa644f5a9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:40.717491 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3021d18e-2395-4f27-b0d1-257074304f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7897df779fd4d30a1b8962aa644f5a9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:40.720732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c80874-6fa5-4a7e-ae97-90a7aa2bee37 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:40.721377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c80874-6fa5-4a7e-ae97-90a7aa2bee37 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:40.722641 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c80874-6fa5-4a7e-ae97-90a7aa2bee37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:40.781526 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-13c80874-6fa5-4a7e-ae97-90a7aa2bee37 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:40.783561 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-13c80874-6fa5-4a7e-ae97-90a7aa2bee37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:40.785386 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3021d18e-2395-4f27-b0d1-257074304f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7897df779fd4d30a1b8962aa644f5a9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:40.813879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 825/1646] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:34:40 2022] DELETE /identity/v3/users/b7897df779fd4d30a1b8962aa644f5a9 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:34:40.818037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ca179-c235-4887-85a1-f6a3fea37c91 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:40.818453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ca179-c235-4887-85a1-f6a3fea37c91 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:40.819191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ca179-c235-4887-85a1-f6a3fea37c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:40.857107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-086ca179-c235-4887-85a1-f6a3fea37c91 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:40.859198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-086ca179-c235-4887-85a1-f6a3fea37c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:40.939338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 822/1647] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:40.957777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c80874-6fa5-4a7e-ae97-90a7aa2bee37 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:40.960610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-13c80874-6fa5-4a7e-ae97-90a7aa2bee37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:41.000485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 826/1648] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:34:41.036399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ca179-c235-4887-85a1-f6a3fea37c91 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:41.037959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-086ca179-c235-4887-85a1-f6a3fea37c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:41.101411 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:41.141106 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c80874-6fa5-4a7e-ae97-90a7aa2bee37 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:41.189958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ca179-c235-4887-85a1-f6a3fea37c91 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:41.201058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b52b48-e0ce-4ca0-8647-2b811ea7e70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:41.203616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b52b48-e0ce-4ca0-8647-2b811ea7e70d service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:41.203966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b52b48-e0ce-4ca0-8647-2b811ea7e70d service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:41.206763 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:41.213458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b52b48-e0ce-4ca0-8647-2b811ea7e70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:41.242256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b52b48-e0ce-4ca0-8647-2b811ea7e70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:41.247227 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b52b48-e0ce-4ca0-8647-2b811ea7e70d service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:41.253826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e933c76-5f1a-4a62-8e99-f77b06fee803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:41.254464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e933c76-5f1a-4a62-8e99-f77b06fee803 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:41.254788 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e933c76-5f1a-4a62-8e99-f77b06fee803 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:41.255060 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e933c76-5f1a-4a62-8e99-f77b06fee803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:41.275669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 827/1649] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:34:41.282065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e933c76-5f1a-4a62-8e99-f77b06fee803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:41.283784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e933c76-5f1a-4a62-8e99-f77b06fee803 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:41.301123 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 823/1650] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:34:42.314245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b52b48-e0ce-4ca0-8647-2b811ea7e70d service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:42.318585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-98b52b48-e0ce-4ca0-8647-2b811ea7e70d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:42.342304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b52b48-e0ce-4ca0-8647-2b811ea7e70d service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:42.351880 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99173389-0aee-4fa1-bcea-fb7bf08d5462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:42.352830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99173389-0aee-4fa1-bcea-fb7bf08d5462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:42.353274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99173389-0aee-4fa1-bcea-fb7bf08d5462 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:42.353715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99173389-0aee-4fa1-bcea-fb7bf08d5462 admin admin] PATH_INFO: `/v3/projects/42b02de7fd24469c92f9bff55e67d254` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:42.355194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99173389-0aee-4fa1-bcea-fb7bf08d5462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b02de7fd24469c92f9bff55e67d254)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:42.357285 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99173389-0aee-4fa1-bcea-fb7bf08d5462 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:42.466317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-99173389-0aee-4fa1-bcea-fb7bf08d5462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b02de7fd24469c92f9bff55e67d254', 'request_id': 'req-99173389-0aee-4fa1-bcea-fb7bf08d5462'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:42.509540 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-99173389-0aee-4fa1-bcea-fb7bf08d5462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b02de7fd24469c92f9bff55e67d254', 'request_id': 'req-99173389-0aee-4fa1-bcea-fb7bf08d5462'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:42.527945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-99173389-0aee-4fa1-bcea-fb7bf08d5462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b02de7fd24469c92f9bff55e67d254', 'request_id': 'req-99173389-0aee-4fa1-bcea-fb7bf08d5462'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:42.562470 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-99173389-0aee-4fa1-bcea-fb7bf08d5462 admin admin] The token cache is being invalidate because project 42b02de7fd24469c92f9bff55e67d254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:34:42.562959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-99173389-0aee-4fa1-bcea-fb7bf08d5462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:42.564083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-99173389-0aee-4fa1-bcea-fb7bf08d5462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:42.570212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 828/1651] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:34:42 2022] DELETE /identity/v3/projects/42b02de7fd24469c92f9bff55e67d254 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:42.572031 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e4148-f579-41b4-93b5-13944a8c15cc None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:42.572544 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e4148-f579-41b4-93b5-13944a8c15cc None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:42.576105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e4148-f579-41b4-93b5-13944a8c15cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:42.622170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8f1e4148-f579-41b4-93b5-13944a8c15cc None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:42.624398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8f1e4148-f579-41b4-93b5-13944a8c15cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:42.808974 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 824/1652] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:42.820207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd38166-b67f-4ca0-9a76-e57fe1d20d60 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:42.820634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd38166-b67f-4ca0-9a76-e57fe1d20d60 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:42.822268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd38166-b67f-4ca0-9a76-e57fe1d20d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:42.860267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-5bd38166-b67f-4ca0-9a76-e57fe1d20d60 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:42.861958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5bd38166-b67f-4ca0-9a76-e57fe1d20d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:42.886103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e4148-f579-41b4-93b5-13944a8c15cc None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:42.893275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 829/1653] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:42.899444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e4148-f579-41b4-93b5-13944a8c15cc None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:42.915034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33f87c-3fc8-4032-9cff-fffbceac2a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:42.916049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33f87c-3fc8-4032-9cff-fffbceac2a86 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:42.916437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33f87c-3fc8-4032-9cff-fffbceac2a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:42.916815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33f87c-3fc8-4032-9cff-fffbceac2a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:42.918384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33f87c-3fc8-4032-9cff-fffbceac2a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:34:42.919115 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33f87c-3fc8-4032-9cff-fffbceac2a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:42.926369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33f87c-3fc8-4032-9cff-fffbceac2a86 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:42.964348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd38166-b67f-4ca0-9a76-e57fe1d20d60 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:42.986947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 825/1654] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:34:42.987788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd38166-b67f-4ca0-9a76-e57fe1d20d60 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:42.996901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba37c1-40d2-4cad-9991-d733fbf1db7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:42.997759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba37c1-40d2-4cad-9991-d733fbf1db7c admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:42.998115 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba37c1-40d2-4cad-9991-d733fbf1db7c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:42.998459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba37c1-40d2-4cad-9991-d733fbf1db7c admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:42.999268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba37c1-40d2-4cad-9991-d733fbf1db7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:43.001927 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba37c1-40d2-4cad-9991-d733fbf1db7c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:43.044425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33f87c-3fc8-4032-9cff-fffbceac2a86 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:43.055535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 830/1655] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:42 2022] POST /identity/v3/projects => generated 403 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:43.080218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33f87c-3fc8-4032-9cff-fffbceac2a86 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:43.325647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8b86d-f37f-4ecc-934b-2a1883cffbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:43.326279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8b86d-f37f-4ecc-934b-2a1883cffbce admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:43.326580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8b86d-f37f-4ecc-934b-2a1883cffbce admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:43.326883 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8b86d-f37f-4ecc-934b-2a1883cffbce admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:43.327528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8b86d-f37f-4ecc-934b-2a1883cffbce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:43.332274 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8b86d-f37f-4ecc-934b-2a1883cffbce admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:43.402115 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 826/1656] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:43 2022] POST /identity/v3/users => generated 302 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:43.405852 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba37c1-40d2-4cad-9991-d733fbf1db7c admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:43.419180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba37c1-40d2-4cad-9991-d733fbf1db7c admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:43.426545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2756492-b284-4e32-9df9-8aecfb025ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:43.427922 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756492-b284-4e32-9df9-8aecfb025ebe admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:43.428414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756492-b284-4e32-9df9-8aecfb025ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:43.429090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756492-b284-4e32-9df9-8aecfb025ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:43.430581 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2756492-b284-4e32-9df9-8aecfb025ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:43.443705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2756492-b284-4e32-9df9-8aecfb025ebe admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:43.480897 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 831/1657] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:43.485519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8b86d-f37f-4ecc-934b-2a1883cffbce admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:43.504126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8b86d-f37f-4ecc-934b-2a1883cffbce admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:43.525370 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3870bd-232f-45ef-9211-ca083134ddfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:43.528938 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3870bd-232f-45ef-9211-ca083134ddfc admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:43.531947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3870bd-232f-45ef-9211-ca083134ddfc admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:43.532707 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3870bd-232f-45ef-9211-ca083134ddfc admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:43.535176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3870bd-232f-45ef-9211-ca083134ddfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:43.540021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3870bd-232f-45ef-9211-ca083134ddfc admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:43.577797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 827/1658] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:43.579982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2756492-b284-4e32-9df9-8aecfb025ebe admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:43.602684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2756492-b284-4e32-9df9-8aecfb025ebe admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:43.634866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264971bf-95ab-4824-8019-89f13baf492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:43.636761 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264971bf-95ab-4824-8019-89f13baf492b admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:43.637440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264971bf-95ab-4824-8019-89f13baf492b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:43.637737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264971bf-95ab-4824-8019-89f13baf492b admin admin] PATH_INFO: `/v3/projects/aac6a0d133ef45b38eeaed0a5766bf43/users/264331d460b3498ca88603a380ea61ce/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:43.700832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264971bf-95ab-4824-8019-89f13baf492b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac6a0d133ef45b38eeaed0a5766bf43, user_id=264331d460b3498ca88603a380ea61ce, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:43.706634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264971bf-95ab-4824-8019-89f13baf492b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:43.741132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 832/1659] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:43 2022] PUT /identity/v3/projects/aac6a0d133ef45b38eeaed0a5766bf43/users/264331d460b3498ca88603a380ea61ce/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:43.746387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03932c-3ff8-4f9d-b893-ea6687e9ad58 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:43.746765 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03932c-3ff8-4f9d-b893-ea6687e9ad58 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:43.747171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03932c-3ff8-4f9d-b893-ea6687e9ad58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:43.803647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-1f03932c-3ff8-4f9d-b893-ea6687e9ad58 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:43.812720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1f03932c-3ff8-4f9d-b893-ea6687e9ad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:43.898796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:44.017449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 828/1660] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:34:44.048702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264971bf-95ab-4824-8019-89f13baf492b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:44.050898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-264971bf-95ab-4824-8019-89f13baf492b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:44.242750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264971bf-95ab-4824-8019-89f13baf492b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:44.252296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5bcc-92c4-4bb5-822a-33a064e5a530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:44.252937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5bcc-92c4-4bb5-822a-33a064e5a530 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:44.253268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5bcc-92c4-4bb5-822a-33a064e5a530 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:44.253579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5bcc-92c4-4bb5-822a-33a064e5a530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:44.266916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:44.284958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f5bcc-92c4-4bb5-822a-33a064e5a530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:44.286740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f5bcc-92c4-4bb5-822a-33a064e5a530 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:44.345933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 833/1661] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:44.520096 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03932c-3ff8-4f9d-b893-ea6687e9ad58 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:44.523165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1f03932c-3ff8-4f9d-b893-ea6687e9ad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:44.557125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03932c-3ff8-4f9d-b893-ea6687e9ad58 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:44.585941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:44.589152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:44.591960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:44.593563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] PATH_INFO: `/v3/projects/701132ccdb8c4ca4a53e1efc960f3b55` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:44.602140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=701132ccdb8c4ca4a53e1efc960f3b55)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:44.603497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: WARNING py.warnings [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 05:34:44.603497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: warnings.warn(msg) Sep 16 05:34:44.603497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: Sep 16 05:34:44.604743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:44.776104 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701132ccdb8c4ca4a53e1efc960f3b55', 'request_id': 'req-2af19172-258d-44a5-96a3-04baf6061922'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:44.797864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701132ccdb8c4ca4a53e1efc960f3b55', 'request_id': 'req-2af19172-258d-44a5-96a3-04baf6061922'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:44.814353 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701132ccdb8c4ca4a53e1efc960f3b55', 'request_id': 'req-2af19172-258d-44a5-96a3-04baf6061922'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:44.882438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] The token cache is being invalidate because project 701132ccdb8c4ca4a53e1efc960f3b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:34:44.883872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:44.887465 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:44.890309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 829/1662] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:34:44 2022] DELETE /identity/v3/projects/701132ccdb8c4ca4a53e1efc960f3b55 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:44.894082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5bcc-92c4-4bb5-822a-33a064e5a530 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:44.909027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5bcc-92c4-4bb5-822a-33a064e5a530 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:45.017094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27c431-f768-4347-a334-ed7973cb774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:45.021332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27c431-f768-4347-a334-ed7973cb774c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:45.021934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27c431-f768-4347-a334-ed7973cb774c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:45.022362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27c431-f768-4347-a334-ed7973cb774c admin admin] PATH_INFO: `/v3/users/4fbf9440c5f6443f9c754beb5b30cbbc` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:45.024072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27c431-f768-4347-a334-ed7973cb774c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fbf9440c5f6443f9c754beb5b30cbbc)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:45.027870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27c431-f768-4347-a334-ed7973cb774c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:45.133084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1a27c431-f768-4347-a334-ed7973cb774c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fbf9440c5f6443f9c754beb5b30cbbc'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:45.136271 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1a27c431-f768-4347-a334-ed7973cb774c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fbf9440c5f6443f9c754beb5b30cbbc'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:45.146719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1a27c431-f768-4347-a334-ed7973cb774c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fbf9440c5f6443f9c754beb5b30cbbc'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:45.147640 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1a27c431-f768-4347-a334-ed7973cb774c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fbf9440c5f6443f9c754beb5b30cbbc'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:45.176205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1a27c431-f768-4347-a334-ed7973cb774c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fbf9440c5f6443f9c754beb5b30cbbc'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:45.223529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 834/1663] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:34:44 2022] DELETE /identity/v3/users/4fbf9440c5f6443f9c754beb5b30cbbc => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:45.884825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:45.886408 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:45.917060 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af19172-258d-44a5-96a3-04baf6061922 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:46.088095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:46.088994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:46.090876 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:46.091312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] PATH_INFO: `/v3/users/2d34a9b82f0b40eba62454a690761bb0` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:46.094425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d34a9b82f0b40eba62454a690761bb0)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:46.109205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:46.277385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d34a9b82f0b40eba62454a690761bb0'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:46.279231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d34a9b82f0b40eba62454a690761bb0'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:46.296285 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d34a9b82f0b40eba62454a690761bb0'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:46.321601 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d34a9b82f0b40eba62454a690761bb0'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:46.322773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d34a9b82f0b40eba62454a690761bb0'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:46.324348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:46.355063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 830/1664] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:34:45 2022] DELETE /identity/v3/users/2d34a9b82f0b40eba62454a690761bb0 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:46.359790 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fb61e-ee99-4eda-bd0e-0fffaa37b084 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:46.360244 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fb61e-ee99-4eda-bd0e-0fffaa37b084 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:46.360329 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fb61e-ee99-4eda-bd0e-0fffaa37b084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:46.419743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-051fb61e-ee99-4eda-bd0e-0fffaa37b084 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:46.421576 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-051fb61e-ee99-4eda-bd0e-0fffaa37b084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:46.568983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 835/1665] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:46.604262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:46.605817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:46.735404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d420d-e455-4edf-a93d-1c51158414bc admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:46.741666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6a43f-1c21-454c-85b9-fe0d19502b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:46.742598 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6a43f-1c21-454c-85b9-fe0d19502b92 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:46.743103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6a43f-1c21-454c-85b9-fe0d19502b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:46.743554 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6a43f-1c21-454c-85b9-fe0d19502b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:46.760741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6a43f-1c21-454c-85b9-fe0d19502b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:46.762335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6a43f-1c21-454c-85b9-fe0d19502b92 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:46.790587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 831/1666] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:47.117914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fb61e-ee99-4eda-bd0e-0fffaa37b084 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:47.120328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-051fb61e-ee99-4eda-bd0e-0fffaa37b084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:47.142598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fb61e-ee99-4eda-bd0e-0fffaa37b084 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:47.156016 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90504e1-5709-4d67-b293-7d63e1cb8f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:47.157031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90504e1-5709-4d67-b293-7d63e1cb8f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:47.157509 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90504e1-5709-4d67-b293-7d63e1cb8f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:47.157976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90504e1-5709-4d67-b293-7d63e1cb8f66 admin admin] PATH_INFO: `/v3/projects/f397d095af2d42d2960d44517431e9a8` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:47.159429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90504e1-5709-4d67-b293-7d63e1cb8f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f397d095af2d42d2960d44517431e9a8)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:47.162437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90504e1-5709-4d67-b293-7d63e1cb8f66 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:47.187180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:47.292414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a90504e1-5709-4d67-b293-7d63e1cb8f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f397d095af2d42d2960d44517431e9a8', 'request_id': 'req-a90504e1-5709-4d67-b293-7d63e1cb8f66'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:47.309633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a90504e1-5709-4d67-b293-7d63e1cb8f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f397d095af2d42d2960d44517431e9a8', 'request_id': 'req-a90504e1-5709-4d67-b293-7d63e1cb8f66'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:47.329018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a90504e1-5709-4d67-b293-7d63e1cb8f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f397d095af2d42d2960d44517431e9a8', 'request_id': 'req-a90504e1-5709-4d67-b293-7d63e1cb8f66'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:47.353518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a90504e1-5709-4d67-b293-7d63e1cb8f66 admin admin] The token cache is being invalidate because project f397d095af2d42d2960d44517431e9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:34:47.355420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a90504e1-5709-4d67-b293-7d63e1cb8f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:47.357583 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a90504e1-5709-4d67-b293-7d63e1cb8f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:47.361771 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 836/1667] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:34:47 2022] DELETE /identity/v3/projects/f397d095af2d42d2960d44517431e9a8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:47.368570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d649a-60c1-4fce-a41e-defe37387f5f None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:47.369025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d649a-60c1-4fce-a41e-defe37387f5f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:47.369122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d649a-60c1-4fce-a41e-defe37387f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:47.408798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-3a7d649a-60c1-4fce-a41e-defe37387f5f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:47.409921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3a7d649a-60c1-4fce-a41e-defe37387f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:47.562293 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 832/1668] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:47.565053 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2c4e3-8a6a-4025-8b61-858812f3ab93 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:47.566901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2c4e3-8a6a-4025-8b61-858812f3ab93 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:47.567338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2c4e3-8a6a-4025-8b61-858812f3ab93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:47.595947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-f9c2c4e3-8a6a-4025-8b61-858812f3ab93 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:47.597929 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f9c2c4e3-8a6a-4025-8b61-858812f3ab93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:47.617596 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 837/1669] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:47.622046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d649a-60c1-4fce-a41e-defe37387f5f None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:47.644893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d649a-60c1-4fce-a41e-defe37387f5f None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:47.657770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff995e1-5135-4573-8356-f59ad6b7aae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:47.658738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff995e1-5135-4573-8356-f59ad6b7aae2 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:47.660505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff995e1-5135-4573-8356-f59ad6b7aae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:47.661832 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff995e1-5135-4573-8356-f59ad6b7aae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:47.662816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff995e1-5135-4573-8356-f59ad6b7aae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:34:47.663273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff995e1-5135-4573-8356-f59ad6b7aae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:47.666698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff995e1-5135-4573-8356-f59ad6b7aae2 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:47.684983 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 833/1670] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:34:47.689720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2c4e3-8a6a-4025-8b61-858812f3ab93 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:47.702995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2c4e3-8a6a-4025-8b61-858812f3ab93 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:47.710361 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f8c9-87be-4712-aff0-2d4bdc1a7e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:47.711288 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f8c9-87be-4712-aff0-2d4bdc1a7e95 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:47.711790 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f8c9-87be-4712-aff0-2d4bdc1a7e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:47.712269 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f8c9-87be-4712-aff0-2d4bdc1a7e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:47.714088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0f8c9-87be-4712-aff0-2d4bdc1a7e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:47.716801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0f8c9-87be-4712-aff0-2d4bdc1a7e95 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:47.766562 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 838/1671] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:47 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:34:47.768202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff995e1-5135-4573-8356-f59ad6b7aae2 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:47.783040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff995e1-5135-4573-8356-f59ad6b7aae2 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:47.900477 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42edc3-efc5-4800-b44d-d809fb74eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:47.901184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42edc3-efc5-4800-b44d-d809fb74eba2 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:47.901464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42edc3-efc5-4800-b44d-d809fb74eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:47.901853 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42edc3-efc5-4800-b44d-d809fb74eba2 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:47.902385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42edc3-efc5-4800-b44d-d809fb74eba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:47.904380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42edc3-efc5-4800-b44d-d809fb74eba2 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:47.933985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:47.956174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 834/1672] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:47 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:47.961073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f8c9-87be-4712-aff0-2d4bdc1a7e95 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:48.003243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f8c9-87be-4712-aff0-2d4bdc1a7e95 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:48.021907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6de8a-0a3f-4267-8dea-57904c98e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:48.026038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6de8a-0a3f-4267-8dea-57904c98e0be admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:48.026332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6de8a-0a3f-4267-8dea-57904c98e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:48.026633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6de8a-0a3f-4267-8dea-57904c98e0be admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:48.027308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6de8a-0a3f-4267-8dea-57904c98e0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:48.034455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6de8a-0a3f-4267-8dea-57904c98e0be admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:48.058051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 839/1673] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:48.063385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42edc3-efc5-4800-b44d-d809fb74eba2 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:48.096135 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42edc3-efc5-4800-b44d-d809fb74eba2 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:48.109632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf4a7c-ff14-4069-ba23-5549472926c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:48.110571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4a7c-ff14-4069-ba23-5549472926c2 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:48.111095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4a7c-ff14-4069-ba23-5549472926c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:48.111525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4a7c-ff14-4069-ba23-5549472926c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:48.112308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf4a7c-ff14-4069-ba23-5549472926c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:48.114039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf4a7c-ff14-4069-ba23-5549472926c2 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:48.139865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb58cf-e93e-4fd5-9a13-0d07d5a0ab04 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:48.140196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb58cf-e93e-4fd5-9a13-0d07d5a0ab04 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:48.140632 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb58cf-e93e-4fd5-9a13-0d07d5a0ab04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:48.149817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 835/1674] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:48.157328 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf4a7c-ff14-4069-ba23-5549472926c2 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:48.191155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf4a7c-ff14-4069-ba23-5549472926c2 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:48.203181 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633af32-17ef-43bd-8168-3e356af2c952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:48.204647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633af32-17ef-43bd-8168-3e356af2c952 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:48.205104 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633af32-17ef-43bd-8168-3e356af2c952 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:48.207209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633af32-17ef-43bd-8168-3e356af2c952 admin admin] PATH_INFO: `/v3/projects/929fc565ae7341a2bd184fa21db38f55/users/b9559006de1c45f59d5dbaa14a6a7a8f/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:48.223281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-2dfb58cf-e93e-4fd5-9a13-0d07d5a0ab04 None None] MFA Rules not processed for user `264331d460b3498ca88603a380ea61ce`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:48.238034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2dfb58cf-e93e-4fd5-9a13-0d07d5a0ab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:48.263818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633af32-17ef-43bd-8168-3e356af2c952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=929fc565ae7341a2bd184fa21db38f55, user_id=b9559006de1c45f59d5dbaa14a6a7a8f, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:48.271793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633af32-17ef-43bd-8168-3e356af2c952 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:48.312343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 836/1675] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:48 2022] PUT /identity/v3/projects/929fc565ae7341a2bd184fa21db38f55/users/b9559006de1c45f59d5dbaa14a6a7a8f/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:48.323403 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9b300-b047-4b68-985e-efde2c606128 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:48.323688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9b300-b047-4b68-985e-efde2c606128 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:48.324354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9b300-b047-4b68-985e-efde2c606128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:48.426075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-adc9b300-b047-4b68-985e-efde2c606128 None None] MFA Rules not processed for user `b9559006de1c45f59d5dbaa14a6a7a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:48.429118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-adc9b300-b047-4b68-985e-efde2c606128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:48.458981 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 840/1676] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:48 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:34:48.472711 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb58cf-e93e-4fd5-9a13-0d07d5a0ab04 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:48.474147 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2dfb58cf-e93e-4fd5-9a13-0d07d5a0ab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:48.501277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb58cf-e93e-4fd5-9a13-0d07d5a0ab04 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:48.618944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 837/1677] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:48.624985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9b300-b047-4b68-985e-efde2c606128 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:48.646968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:48.688647 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bf832-69fd-43e4-9bc8-9854eb491bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:48.689193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf832-69fd-43e4-9bc8-9854eb491bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:48.689478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf832-69fd-43e4-9bc8-9854eb491bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:48.689752 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf832-69fd-43e4-9bc8-9854eb491bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:48.690403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bf832-69fd-43e4-9bc8-9854eb491bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:48.694544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bf832-69fd-43e4-9bc8-9854eb491bc1 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:48.766056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 841/1678] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:48 2022] POST /identity/v3/projects => generated 403 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:48.766056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bf832-69fd-43e4-9bc8-9854eb491bc1 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:48.769405 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-cf8bf832-69fd-43e4-9bc8-9854eb491bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:48.793932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9b300-b047-4b68-985e-efde2c606128 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:48.944248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bf832-69fd-43e4-9bc8-9854eb491bc1 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:48.954830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab99cb-28b6-4518-9d1f-76cad4b51f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:48.955454 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab99cb-28b6-4518-9d1f-76cad4b51f47 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:48.956120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab99cb-28b6-4518-9d1f-76cad4b51f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:48.956283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab99cb-28b6-4518-9d1f-76cad4b51f47 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:48.956897 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab99cb-28b6-4518-9d1f-76cad4b51f47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:48.958848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab99cb-28b6-4518-9d1f-76cad4b51f47 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:48.961217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff359080-c8a9-4903-a006-05a0863d2ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:48.961884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359080-c8a9-4903-a006-05a0863d2ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:48.962174 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359080-c8a9-4903-a006-05a0863d2ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:48.962434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359080-c8a9-4903-a006-05a0863d2ef4 admin admin] PATH_INFO: `/v3/projects/3c7cfd7efbc54bbd90963f2e07af47de` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:48.963670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff359080-c8a9-4903-a006-05a0863d2ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7cfd7efbc54bbd90963f2e07af47de)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:48.965584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff359080-c8a9-4903-a006-05a0863d2ef4 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:48.974876 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:49.028643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 838/1679] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:48 2022] POST /identity/v3/projects => generated 377 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:34:49.029919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab99cb-28b6-4518-9d1f-76cad4b51f47 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:49.067294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ff359080-c8a9-4903-a006-05a0863d2ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7cfd7efbc54bbd90963f2e07af47de', 'request_id': 'req-ff359080-c8a9-4903-a006-05a0863d2ef4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:49.080035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ff359080-c8a9-4903-a006-05a0863d2ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7cfd7efbc54bbd90963f2e07af47de', 'request_id': 'req-ff359080-c8a9-4903-a006-05a0863d2ef4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:49.092290 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ff359080-c8a9-4903-a006-05a0863d2ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7cfd7efbc54bbd90963f2e07af47de', 'request_id': 'req-ff359080-c8a9-4903-a006-05a0863d2ef4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:49.120095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ff359080-c8a9-4903-a006-05a0863d2ef4 admin admin] The token cache is being invalidate because project 3c7cfd7efbc54bbd90963f2e07af47de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:34:49.120916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ff359080-c8a9-4903-a006-05a0863d2ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:49.121938 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ff359080-c8a9-4903-a006-05a0863d2ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:34:49.124580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 842/1680] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:34:48 2022] DELETE /identity/v3/projects/3c7cfd7efbc54bbd90963f2e07af47de => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:49.128419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41699-1aeb-458f-bb59-04cf4baf5d95 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:49.128419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41699-1aeb-458f-bb59-04cf4baf5d95 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:49.128419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41699-1aeb-458f-bb59-04cf4baf5d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:49.175593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-aeb41699-1aeb-458f-bb59-04cf4baf5d95 None None] MFA Rules not processed for user `18fafa4f50b14af297d8c8adf49c2925`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:49.177636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-aeb41699-1aeb-458f-bb59-04cf4baf5d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:49.203089 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab99cb-28b6-4518-9d1f-76cad4b51f47 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:49.265304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:49.313894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 843/1681] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:49.314887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb41699-1aeb-458f-bb59-04cf4baf5d95 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:49.316659 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-aeb41699-1aeb-458f-bb59-04cf4baf5d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:49.344517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585079b-2ff8-4952-8e0b-37177f5d8a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:49.345466 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585079b-2ff8-4952-8e0b-37177f5d8a0c admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:49.345925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585079b-2ff8-4952-8e0b-37177f5d8a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:49.346568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585079b-2ff8-4952-8e0b-37177f5d8a0c admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:49.347561 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585079b-2ff8-4952-8e0b-37177f5d8a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:49.351370 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585079b-2ff8-4952-8e0b-37177f5d8a0c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:49.417791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 839/1682] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:49 2022] POST /identity/v3/users => generated 308 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:49.419568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb2240-969f-4460-a366-63685b87f37b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:49.419850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb2240-969f-4460-a366-63685b87f37b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:49.420708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb2240-969f-4460-a366-63685b87f37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:49.454554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb41699-1aeb-458f-bb59-04cf4baf5d95 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:49.462637 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-eccb2240-969f-4460-a366-63685b87f37b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:49.464199 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-eccb2240-969f-4460-a366-63685b87f37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:49.464588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae6493-3b6e-4f1a-af51-c15fbeae9403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:49.465469 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae6493-3b6e-4f1a-af51-c15fbeae9403 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:49.465855 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae6493-3b6e-4f1a-af51-c15fbeae9403 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:49.466237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae6493-3b6e-4f1a-af51-c15fbeae9403 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:49.467062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae6493-3b6e-4f1a-af51-c15fbeae9403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:49.469687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae6493-3b6e-4f1a-af51-c15fbeae9403 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:49.479340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 840/1683] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:49.479340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84420d87-b8a9-44db-8ec2-7c6ea97b21b0 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:49.479340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84420d87-b8a9-44db-8ec2-7c6ea97b21b0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:49.479340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84420d87-b8a9-44db-8ec2-7c6ea97b21b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:49.499717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-84420d87-b8a9-44db-8ec2-7c6ea97b21b0 None None] MFA Rules not processed for user `18fafa4f50b14af297d8c8adf49c2925`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:49.500985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-84420d87-b8a9-44db-8ec2-7c6ea97b21b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:49.508080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 844/1684] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:49 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:49.509010 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae6493-3b6e-4f1a-af51-c15fbeae9403 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:49.516428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 841/1685] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:49.516602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1dae6493-3b6e-4f1a-af51-c15fbeae9403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:49.516679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107404c2-5301-413b-99f7-3facfc7f9d1b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:49.516679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107404c2-5301-413b-99f7-3facfc7f9d1b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:49.516679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107404c2-5301-413b-99f7-3facfc7f9d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:49.541834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae6493-3b6e-4f1a-af51-c15fbeae9403 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:49.558675 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-107404c2-5301-413b-99f7-3facfc7f9d1b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:49.560083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-107404c2-5301-413b-99f7-3facfc7f9d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:49.574864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 842/1686] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:49.575004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80eabb-5f00-4edc-82cb-f2a0852002f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:49.575117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107404c2-5301-413b-99f7-3facfc7f9d1b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:49.575190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80eabb-5f00-4edc-82cb-f2a0852002f6 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:49.575190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80eabb-5f00-4edc-82cb-f2a0852002f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:49.575190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80eabb-5f00-4edc-82cb-f2a0852002f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:49.575190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80eabb-5f00-4edc-82cb-f2a0852002f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:49.576636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80eabb-5f00-4edc-82cb-f2a0852002f6 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:49.611045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107404c2-5301-413b-99f7-3facfc7f9d1b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:49.622418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 845/1687] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:49.628597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80eabb-5f00-4edc-82cb-f2a0852002f6 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:49.639555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ef80eabb-5f00-4edc-82cb-f2a0852002f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:49.645446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b990620-2f8c-4e1f-b39f-9bac4ba5ad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:49.646245 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b990620-2f8c-4e1f-b39f-9bac4ba5ad26 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:49.648189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b990620-2f8c-4e1f-b39f-9bac4ba5ad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:49.648189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b990620-2f8c-4e1f-b39f-9bac4ba5ad26 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:49.648189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b990620-2f8c-4e1f-b39f-9bac4ba5ad26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:49.650471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b990620-2f8c-4e1f-b39f-9bac4ba5ad26 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:49.663595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 843/1688] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:49.668757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b990620-2f8c-4e1f-b39f-9bac4ba5ad26 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:49.680165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b990620-2f8c-4e1f-b39f-9bac4ba5ad26 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:49.685590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27663b7d-a14d-4be0-8967-2db73f265b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:49.686060 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27663b7d-a14d-4be0-8967-2db73f265b2c admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:49.686337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27663b7d-a14d-4be0-8967-2db73f265b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:49.686652 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27663b7d-a14d-4be0-8967-2db73f265b2c admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:49.687382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27663b7d-a14d-4be0-8967-2db73f265b2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:34:49.687649 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27663b7d-a14d-4be0-8967-2db73f265b2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:49.689676 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27663b7d-a14d-4be0-8967-2db73f265b2c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:49.722964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 844/1689] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:34:49.722964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27663b7d-a14d-4be0-8967-2db73f265b2c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:49.787187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27663b7d-a14d-4be0-8967-2db73f265b2c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:49.804106 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74894f-ae8c-4e51-96d9-811875c37f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:49.804957 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74894f-ae8c-4e51-96d9-811875c37f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:49.805235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74894f-ae8c-4e51-96d9-811875c37f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:49.805515 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74894f-ae8c-4e51-96d9-811875c37f23 admin admin] PATH_INFO: `/v3/projects/db9b393230094622824d6c3bb912acbe/users/7364e6179d69414d8e61b63956906794/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:49.827829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80eabb-5f00-4edc-82cb-f2a0852002f6 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:49.854771 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a179b6-493f-4de2-b7ef-d9d94ed5177d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:49.858173 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a179b6-493f-4de2-b7ef-d9d94ed5177d service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:49.858490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a179b6-493f-4de2-b7ef-d9d94ed5177d service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:49.860669 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74894f-ae8c-4e51-96d9-811875c37f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9b393230094622824d6c3bb912acbe, user_id=7364e6179d69414d8e61b63956906794, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:49.861884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a179b6-493f-4de2-b7ef-d9d94ed5177d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:49.878447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74894f-ae8c-4e51-96d9-811875c37f23 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:49.896489 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a179b6-493f-4de2-b7ef-d9d94ed5177d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:49.913333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a179b6-493f-4de2-b7ef-d9d94ed5177d service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:49.942159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 845/1690] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:49 2022] PUT /identity/v3/projects/db9b393230094622824d6c3bb912acbe/users/7364e6179d69414d8e61b63956906794/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:49.943120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74894f-ae8c-4e51-96d9-811875c37f23 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:49.966492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 846/1691] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:49.967446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a179b6-493f-4de2-b7ef-d9d94ed5177d service nova] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:50.005484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a179b6-493f-4de2-b7ef-d9d94ed5177d service nova] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:50.016491 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:50.190715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74894f-ae8c-4e51-96d9-811875c37f23 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:50.206675 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23a520-9bf4-43ec-856c-c7672a755755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:50.207582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23a520-9bf4-43ec-856c-c7672a755755 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:50.207998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23a520-9bf4-43ec-856c-c7672a755755 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:50.208429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23a520-9bf4-43ec-856c-c7672a755755 admin admin] PATH_INFO: `/v3/projects/b0295aeb1b314e63a960602391570cb1/users/81b6a89e689f43548be975dc8b835818/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:50.242605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:50.258678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78adf4-6005-4744-8ad6-10cfd5f31707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:50.259474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78adf4-6005-4744-8ad6-10cfd5f31707 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:50.261658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78adf4-6005-4744-8ad6-10cfd5f31707 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:50.262115 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78adf4-6005-4744-8ad6-10cfd5f31707 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:50.263767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78adf4-6005-4744-8ad6-10cfd5f31707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:50.264024 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23a520-9bf4-43ec-856c-c7672a755755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0295aeb1b314e63a960602391570cb1, user_id=81b6a89e689f43548be975dc8b835818, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:50.268724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23a520-9bf4-43ec-856c-c7672a755755 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:50.270839 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78adf4-6005-4744-8ad6-10cfd5f31707 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:50.321200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 846/1692] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:49 2022] PUT /identity/v3/projects/b0295aeb1b314e63a960602391570cb1/users/81b6a89e689f43548be975dc8b835818/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:50.324938 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23a520-9bf4-43ec-856c-c7672a755755 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:50.370014 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 847/1693] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:49 2022] POST /identity/v3/projects => generated 381 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:50.370014 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78adf4-6005-4744-8ad6-10cfd5f31707 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:50.482219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23a520-9bf4-43ec-856c-c7672a755755 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:50.528415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78adf4-6005-4744-8ad6-10cfd5f31707 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:50.535165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076f993-3039-423e-8ea0-d9531b8b1b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:50.535783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076f993-3039-423e-8ea0-d9531b8b1b41 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:50.536058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076f993-3039-423e-8ea0-d9531b8b1b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:50.536326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076f993-3039-423e-8ea0-d9531b8b1b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:50.537836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076f993-3039-423e-8ea0-d9531b8b1b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:50.539932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076f993-3039-423e-8ea0-d9531b8b1b41 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:50.554320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 848/1694] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:50.555380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076f993-3039-423e-8ea0-d9531b8b1b41 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:50.569024 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076f993-3039-423e-8ea0-d9531b8b1b41 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:50.574317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685494f6-7fa4-4adc-8420-4963948f1c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:50.574965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685494f6-7fa4-4adc-8420-4963948f1c61 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:50.575250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685494f6-7fa4-4adc-8420-4963948f1c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:50.575517 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685494f6-7fa4-4adc-8420-4963948f1c61 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:50.576157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685494f6-7fa4-4adc-8420-4963948f1c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:50.578374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685494f6-7fa4-4adc-8420-4963948f1c61 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:50.619913 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 849/1695] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:50 2022] POST /identity/v3/users => generated 291 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:50.619913 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685494f6-7fa4-4adc-8420-4963948f1c61 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:50.627480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114c51-024d-4212-aad4-e9510ba46095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:50.628378 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114c51-024d-4212-aad4-e9510ba46095 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:50.628823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114c51-024d-4212-aad4-e9510ba46095 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:50.629242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114c51-024d-4212-aad4-e9510ba46095 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:50.630213 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6114c51-024d-4212-aad4-e9510ba46095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:50.632845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6114c51-024d-4212-aad4-e9510ba46095 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:50.642866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685494f6-7fa4-4adc-8420-4963948f1c61 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:50.645310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 847/1696] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:50.646399 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114c51-024d-4212-aad4-e9510ba46095 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:50.657281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf892b-83e7-4aac-a351-634d42d9c1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:50.657281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf892b-83e7-4aac-a351-634d42d9c1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:50.657555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf892b-83e7-4aac-a351-634d42d9c1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:50.657665 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf892b-83e7-4aac-a351-634d42d9c1bb admin admin] PATH_INFO: `/v3/projects/b0295aeb1b314e63a960602391570cb1/users/81b6a89e689f43548be975dc8b835818/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:50.661481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114c51-024d-4212-aad4-e9510ba46095 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:50.667240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf892b-83e7-4aac-a351-634d42d9c1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0295aeb1b314e63a960602391570cb1, user_id=81b6a89e689f43548be975dc8b835818, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:50.667798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6030875-fdb6-4b30-9023-193b6ef8a10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:50.668646 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6030875-fdb6-4b30-9023-193b6ef8a10f admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:50.669062 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6030875-fdb6-4b30-9023-193b6ef8a10f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:50.669516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6030875-fdb6-4b30-9023-193b6ef8a10f admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:50.670772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf892b-83e7-4aac-a351-634d42d9c1bb admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:50.671228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6030875-fdb6-4b30-9023-193b6ef8a10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:50.673433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6030875-fdb6-4b30-9023-193b6ef8a10f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:50.690175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 848/1697] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:50.691502 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6030875-fdb6-4b30-9023-193b6ef8a10f admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:50.703934 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6030875-fdb6-4b30-9023-193b6ef8a10f admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:50.706552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 850/1698] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:50 2022] PUT /identity/v3/projects/b0295aeb1b314e63a960602391570cb1/users/81b6a89e689f43548be975dc8b835818/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:50.708066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf892b-83e7-4aac-a351-634d42d9c1bb admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:50.743928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:50.811009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c507f51-409d-48c7-aa03-2eb63eeecf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:50.813825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c507f51-409d-48c7-aa03-2eb63eeecf5f admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:50.814117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c507f51-409d-48c7-aa03-2eb63eeecf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:50.814396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c507f51-409d-48c7-aa03-2eb63eeecf5f admin admin] PATH_INFO: `/v3/projects/db9b393230094622824d6c3bb912acbe/users/7364e6179d69414d8e61b63956906794/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:50.818424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c507f51-409d-48c7-aa03-2eb63eeecf5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9b393230094622824d6c3bb912acbe, user_id=7364e6179d69414d8e61b63956906794, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:50.821494 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c507f51-409d-48c7-aa03-2eb63eeecf5f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:50.860049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 849/1699] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:50 2022] PUT /identity/v3/projects/db9b393230094622824d6c3bb912acbe/users/7364e6179d69414d8e61b63956906794/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:50.860049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15892ec-14f4-424b-b887-c0f87d2a788e None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:50.860049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15892ec-14f4-424b-b887-c0f87d2a788e None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:50.860049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15892ec-14f4-424b-b887-c0f87d2a788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:50.868126 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf892b-83e7-4aac-a351-634d42d9c1bb admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:50.928813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f15892ec-14f4-424b-b887-c0f87d2a788e None None] MFA Rules not processed for user `81b6a89e689f43548be975dc8b835818`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:50.930089 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f15892ec-14f4-424b-b887-c0f87d2a788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:50.990796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:51.007503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe807c-9d11-47c6-9fb8-bade6f8519dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:51.008131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe807c-9d11-47c6-9fb8-bade6f8519dc admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:51.008408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe807c-9d11-47c6-9fb8-bade6f8519dc admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:51.008678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe807c-9d11-47c6-9fb8-bade6f8519dc admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:51.013274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe807c-9d11-47c6-9fb8-bade6f8519dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:51.018277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe807c-9d11-47c6-9fb8-bade6f8519dc admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:51.049754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 851/1700] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:51.053198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe807c-9d11-47c6-9fb8-bade6f8519dc admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:51.080427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe807c-9d11-47c6-9fb8-bade6f8519dc admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:51.093392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5f8f3-7b47-4682-98b7-ac5c4b6d1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:51.094080 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 850/1701] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:51.094232 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5f8f3-7b47-4682-98b7-ac5c4b6d1024 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:51.094618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5f8f3-7b47-4682-98b7-ac5c4b6d1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:51.094894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5f8f3-7b47-4682-98b7-ac5c4b6d1024 admin admin] PATH_INFO: `/v3/projects/ec83eec797004647a462e52950657c21/users/4e1f14af68bb4ca79d887f0b254b27fd/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:51.108141 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15892ec-14f4-424b-b887-c0f87d2a788e None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:51.110972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f15892ec-14f4-424b-b887-c0f87d2a788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:51.134856 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5f8f3-7b47-4682-98b7-ac5c4b6d1024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec83eec797004647a462e52950657c21, user_id=4e1f14af68bb4ca79d887f0b254b27fd, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:51.139875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5f8f3-7b47-4682-98b7-ac5c4b6d1024 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:51.173676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 852/1702] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:51 2022] PUT /identity/v3/projects/ec83eec797004647a462e52950657c21/users/4e1f14af68bb4ca79d887f0b254b27fd/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:51.185353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7fb6b-ddbc-4f4a-9db8-8267586c43c0 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:51.185867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7fb6b-ddbc-4f4a-9db8-8267586c43c0 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:51.186218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7fb6b-ddbc-4f4a-9db8-8267586c43c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:51.252131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b9b7fb6b-ddbc-4f4a-9db8-8267586c43c0 None None] MFA Rules not processed for user `4e1f14af68bb4ca79d887f0b254b27fd`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:51.255426 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b9b7fb6b-ddbc-4f4a-9db8-8267586c43c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:51.289933 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15892ec-14f4-424b-b887-c0f87d2a788e None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:51.367205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 853/1703] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:34:51.368300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7fb6b-ddbc-4f4a-9db8-8267586c43c0 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:51.415724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749e4be-7ef8-44ae-ab64-9250afc3b38c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:51.418122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749e4be-7ef8-44ae-ab64-9250afc3b38c service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:51.418409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749e4be-7ef8-44ae-ab64-9250afc3b38c service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:51.418705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749e4be-7ef8-44ae-ab64-9250afc3b38c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:51.427798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c749e4be-7ef8-44ae-ab64-9250afc3b38c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:51.461592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7fb6b-ddbc-4f4a-9db8-8267586c43c0 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:51.475476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ea84-4272-4e95-98f8-eaf2418f9829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:51.479035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ea84-4272-4e95-98f8-eaf2418f9829 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:51.479497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ea84-4272-4e95-98f8-eaf2418f9829 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:51.480716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ea84-4272-4e95-98f8-eaf2418f9829 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:51.483285 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ea84-4272-4e95-98f8-eaf2418f9829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:51.488625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:51.489580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ea84-4272-4e95-98f8-eaf2418f9829 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:51.560645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 854/1704] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:34:51 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:51.567468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ea84-4272-4e95-98f8-eaf2418f9829 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:51.637705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749e4be-7ef8-44ae-ab64-9250afc3b38c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:51.644229 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749e4be-7ef8-44ae-ab64-9250afc3b38c service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:51.669804 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:51.676251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 851/1705] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:51.764994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ea84-4272-4e95-98f8-eaf2418f9829 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:51.776424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7127e-e4e7-4723-b133-0656ee4d6fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:51.777252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7127e-e4e7-4723-b133-0656ee4d6fda admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:51.777582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7127e-e4e7-4723-b133-0656ee4d6fda admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:51.777858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7127e-e4e7-4723-b133-0656ee4d6fda admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:51.778518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7127e-e4e7-4723-b133-0656ee4d6fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:51.780599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7127e-e4e7-4723-b133-0656ee4d6fda admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:51.848114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 855/1706] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:34:51 2022] POST /identity/v3/users => generated 297 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:34:51.849294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749e4be-7ef8-44ae-ab64-9250afc3b38c service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:51.868896 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749e4be-7ef8-44ae-ab64-9250afc3b38c service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:51.881814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaeb8b4-9ed4-42a2-8a84-5ff8a8443188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:51.882788 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaeb8b4-9ed4-42a2-8a84-5ff8a8443188 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:51.883068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaeb8b4-9ed4-42a2-8a84-5ff8a8443188 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:51.883337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaeb8b4-9ed4-42a2-8a84-5ff8a8443188 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:51.883991 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaeb8b4-9ed4-42a2-8a84-5ff8a8443188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:51.886036 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaeb8b4-9ed4-42a2-8a84-5ff8a8443188 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:51.916642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 852/1707] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:51.921869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7127e-e4e7-4723-b133-0656ee4d6fda admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:51.938602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7127e-e4e7-4723-b133-0656ee4d6fda admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:51.951205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fb427-340f-4f64-9ff0-c5c2e8af8fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:51.951927 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fb427-340f-4f64-9ff0-c5c2e8af8fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:51.952205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fb427-340f-4f64-9ff0-c5c2e8af8fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:51.953675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fb427-340f-4f64-9ff0-c5c2e8af8fc2 admin admin] PATH_INFO: `/v3/projects/f6a2db53916548aa9986e5a4ff26b921/users/613cb5dfcf7c4c97ba5aed22e1e8cd22/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:52.007345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fb427-340f-4f64-9ff0-c5c2e8af8fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a2db53916548aa9986e5a4ff26b921, user_id=613cb5dfcf7c4c97ba5aed22e1e8cd22, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:52.015510 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fb427-340f-4f64-9ff0-c5c2e8af8fc2 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:52.043933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 856/1708] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:51 2022] PUT /identity/v3/projects/f6a2db53916548aa9986e5a4ff26b921/users/613cb5dfcf7c4c97ba5aed22e1e8cd22/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:34:52.052074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaeb8b4-9ed4-42a2-8a84-5ff8a8443188 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:52.069790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaeb8b4-9ed4-42a2-8a84-5ff8a8443188 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:52.252518 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ad428-72dd-4576-a151-cd632c923c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:52.253287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ad428-72dd-4576-a151-cd632c923c3e admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:52.258008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ad428-72dd-4576-a151-cd632c923c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:52.258008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ad428-72dd-4576-a151-cd632c923c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:52.258008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ad428-72dd-4576-a151-cd632c923c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:52.264843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ad428-72dd-4576-a151-cd632c923c3e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:52.295352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fb427-340f-4f64-9ff0-c5c2e8af8fc2 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:52.296004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 853/1709] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:34:52.309814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fb427-340f-4f64-9ff0-c5c2e8af8fc2 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:52.331709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a350c4f-536f-4b2e-8889-05408f719dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:52.333543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a350c4f-536f-4b2e-8889-05408f719dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:52.333714 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a350c4f-536f-4b2e-8889-05408f719dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:52.334644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a350c4f-536f-4b2e-8889-05408f719dc3 admin admin] PATH_INFO: `/v3/projects/f6a2db53916548aa9986e5a4ff26b921/users/613cb5dfcf7c4c97ba5aed22e1e8cd22/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:52.343895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a350c4f-536f-4b2e-8889-05408f719dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a2db53916548aa9986e5a4ff26b921, user_id=613cb5dfcf7c4c97ba5aed22e1e8cd22, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:52.353896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a350c4f-536f-4b2e-8889-05408f719dc3 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:52.407696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489f71b-2a7f-4c9c-8cc7-f1ecc90193d6 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:52.408485 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489f71b-2a7f-4c9c-8cc7-f1ecc90193d6 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:52.408485 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489f71b-2a7f-4c9c-8cc7-f1ecc90193d6 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:52.408693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 857/1710] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:34:52 2022] PUT /identity/v3/projects/f6a2db53916548aa9986e5a4ff26b921/users/613cb5dfcf7c4c97ba5aed22e1e8cd22/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:34:52.420504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e62ef0-38f6-472a-ac0c-0b7bc910a64e None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:52.420907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e62ef0-38f6-472a-ac0c-0b7bc910a64e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:52.421658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e62ef0-38f6-472a-ac0c-0b7bc910a64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:52.426811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 854/1711] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 16 05:34:52 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:34:52.429692 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404acd5-c54b-4bca-add0-e6a2bb986a1a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:52.429692 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404acd5-c54b-4bca-add0-e6a2bb986a1a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:52.430282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404acd5-c54b-4bca-add0-e6a2bb986a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:52.505937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-3404acd5-c54b-4bca-add0-e6a2bb986a1a None None] MFA Rules not processed for user `d51f44d06b0f4303a753709bd1bcf3e5`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:52.507336 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3404acd5-c54b-4bca-add0-e6a2bb986a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:52.540554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-62e62ef0-38f6-472a-ac0c-0b7bc910a64e None None] MFA Rules not processed for user `613cb5dfcf7c4c97ba5aed22e1e8cd22`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:52.545182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-62e62ef0-38f6-472a-ac0c-0b7bc910a64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:52.602674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 855/1712] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:34:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:52.641390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404acd5-c54b-4bca-add0-e6a2bb986a1a None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:52.644280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3404acd5-c54b-4bca-add0-e6a2bb986a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:52.665954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404acd5-c54b-4bca-add0-e6a2bb986a1a None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:52.678014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5a259-2685-4004-afc2-14e01f5c3133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:52.682091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5a259-2685-4004-afc2-14e01f5c3133 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:52.685525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5a259-2685-4004-afc2-14e01f5c3133 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:52.686776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5a259-2685-4004-afc2-14e01f5c3133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:52.711266 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5a259-2685-4004-afc2-14e01f5c3133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:52.715438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5a259-2685-4004-afc2-14e01f5c3133 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:52.745898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 856/1713] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:34:52.831937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 858/1714] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:52.861714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5a259-2685-4004-afc2-14e01f5c3133 service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:52.978607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:53.047794 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5a259-2685-4004-afc2-14e01f5c3133 service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:53.057471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b553f-8dd5-4828-8935-5bfb0246ef63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:53.058105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b553f-8dd5-4828-8935-5bfb0246ef63 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:53.058436 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b553f-8dd5-4828-8935-5bfb0246ef63 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:53.058738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b553f-8dd5-4828-8935-5bfb0246ef63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:53.085139 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b553f-8dd5-4828-8935-5bfb0246ef63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:53.087949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b553f-8dd5-4828-8935-5bfb0246ef63 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:53.141565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 857/1715] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:53.334858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e62ef0-38f6-472a-ac0c-0b7bc910a64e None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:53.348277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e62ef0-38f6-472a-ac0c-0b7bc910a64e None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:53.364913 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a0528-d9f0-41c4-beac-ce568e46cbe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:53.365633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a0528-d9f0-41c4-beac-ce568e46cbe4 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:53.365908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a0528-d9f0-41c4-beac-ce568e46cbe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:53.366174 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a0528-d9f0-41c4-beac-ce568e46cbe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:53.557249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a0528-d9f0-41c4-beac-ce568e46cbe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:53.558849 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a0528-d9f0-41c4-beac-ce568e46cbe4 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:53.599024 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 859/1716] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:53.740093 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26e411-141c-4c19-a29f-5e283e81575c None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:53.740587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26e411-141c-4c19-a29f-5e283e81575c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:53.740661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26e411-141c-4c19-a29f-5e283e81575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:53.807942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-6c26e411-141c-4c19-a29f-5e283e81575c None None] MFA Rules not processed for user `946827404b58485daed0fc22a6da379a`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:53.812210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6c26e411-141c-4c19-a29f-5e283e81575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:54.026825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 858/1717] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:54.037678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7c500-b07b-451e-b585-c7a071a1403c None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:54.038126 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7c500-b07b-451e-b585-c7a071a1403c None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:54.038302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7c500-b07b-451e-b585-c7a071a1403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:54.076647 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-bdd7c500-b07b-451e-b585-c7a071a1403c None None] MFA Rules not processed for user `946827404b58485daed0fc22a6da379a`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:54.079757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-bdd7c500-b07b-451e-b585-c7a071a1403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:54.102923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 860/1718] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:54.120875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26e411-141c-4c19-a29f-5e283e81575c None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:54.123906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6c26e411-141c-4c19-a29f-5e283e81575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:54.429392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26e411-141c-4c19-a29f-5e283e81575c None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:54.444372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fc945-2a68-404f-a286-bff822d597f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:54.447034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc945-2a68-404f-a286-bff822d597f6 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:54.448349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc945-2a68-404f-a286-bff822d597f6 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:54.448790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc945-2a68-404f-a286-bff822d597f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:54.489944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c76864-a96c-406d-828e-dcc3f273f498 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:54.490527 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c76864-a96c-406d-828e-dcc3f273f498 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:54.490942 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c76864-a96c-406d-828e-dcc3f273f498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:54.507198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fc945-2a68-404f-a286-bff822d597f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:54.515798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fc945-2a68-404f-a286-bff822d597f6 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:54.555461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:54.558244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 859/1719] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:54.583204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-31c76864-a96c-406d-828e-dcc3f273f498 None None] MFA Rules not processed for user `7079422a25134eaa83102f970cc2b287`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:54.585810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-31c76864-a96c-406d-828e-dcc3f273f498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:54.703751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b1eff-9224-4f83-8fda-fe53020bfb09 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:54.704516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b1eff-9224-4f83-8fda-fe53020bfb09 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:54.705192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b1eff-9224-4f83-8fda-fe53020bfb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:54.744140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 861/1720] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:34:54.797926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-5b9b1eff-9224-4f83-8fda-fe53020bfb09 None None] MFA Rules not processed for user `7364e6179d69414d8e61b63956906794`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:54.818325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5b9b1eff-9224-4f83-8fda-fe53020bfb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:54.820674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c76864-a96c-406d-828e-dcc3f273f498 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:54.844827 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c76864-a96c-406d-828e-dcc3f273f498 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:54.871163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aadaba-038d-4d82-a147-cdb0b0e0b32e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:54.872047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aadaba-038d-4d82-a147-cdb0b0e0b32e service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:54.873300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aadaba-038d-4d82-a147-cdb0b0e0b32e service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:54.875014 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aadaba-038d-4d82-a147-cdb0b0e0b32e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:54.937059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aadaba-038d-4d82-a147-cdb0b0e0b32e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:54.944752 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aadaba-038d-4d82-a147-cdb0b0e0b32e service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:54.966100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:54.979094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 862/1721] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:34:55.001385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aadaba-038d-4d82-a147-cdb0b0e0b32e service nova] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:55.003142 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-75aadaba-038d-4d82-a147-cdb0b0e0b32e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:55.094231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 860/1722] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:54 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:34:55.234322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aadaba-038d-4d82-a147-cdb0b0e0b32e service nova] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:55.263499 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f310b1-f669-4ecc-9dc8-6bdf62f44d21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef60b27f5f545aa8ea063009ec66eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:55.264894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f310b1-f669-4ecc-9dc8-6bdf62f44d21 service placement] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:55.265465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f310b1-f669-4ecc-9dc8-6bdf62f44d21 service placement] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:55.266034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f310b1-f669-4ecc-9dc8-6bdf62f44d21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:55.270341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f0f310b1-f669-4ecc-9dc8-6bdf62f44d21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:55.298536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f310b1-f669-4ecc-9dc8-6bdf62f44d21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:55.303884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f310b1-f669-4ecc-9dc8-6bdf62f44d21 service placement] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:55.328454 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 863/1723] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:55.845839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b1eff-9224-4f83-8fda-fe53020bfb09 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:55.858402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b1eff-9224-4f83-8fda-fe53020bfb09 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:55.892033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88988068-58f6-4534-8a9c-a4985e6aafe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:55.893881 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88988068-58f6-4534-8a9c-a4985e6aafe2 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:55.896807 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88988068-58f6-4534-8a9c-a4985e6aafe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:55.897460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88988068-58f6-4534-8a9c-a4985e6aafe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:55.971496 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be053daa-c4f4-4248-b900-882f59ed44cd None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:55.972116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be053daa-c4f4-4248-b900-882f59ed44cd None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:55.972624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be053daa-c4f4-4248-b900-882f59ed44cd None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:55.974835 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 864/1724] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 16 05:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 05:34:55.993469 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8216e6-50e8-4a60-bb7b-0d6fba948166 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:55.994160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8216e6-50e8-4a60-bb7b-0d6fba948166 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:55.998658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8216e6-50e8-4a60-bb7b-0d6fba948166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:56.091938 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-6b8216e6-50e8-4a60-bb7b-0d6fba948166 None None] MFA Rules not processed for user `d51f44d06b0f4303a753709bd1bcf3e5`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:56.099314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6b8216e6-50e8-4a60-bb7b-0d6fba948166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:56.111342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88988068-58f6-4534-8a9c-a4985e6aafe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:56.114864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88988068-58f6-4534-8a9c-a4985e6aafe2 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:56.132703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 865/1725] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:34:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:56.158018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 861/1726] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:56.251003 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8216e6-50e8-4a60-bb7b-0d6fba948166 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:56.252994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6b8216e6-50e8-4a60-bb7b-0d6fba948166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:56.284359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8216e6-50e8-4a60-bb7b-0d6fba948166 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:56.311139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d490757-ec69-48a9-8fd5-24c1006f8df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:56.317268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d490757-ec69-48a9-8fd5-24c1006f8df3 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:56.322828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d490757-ec69-48a9-8fd5-24c1006f8df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:56.323383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d490757-ec69-48a9-8fd5-24c1006f8df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:56.370396 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d490757-ec69-48a9-8fd5-24c1006f8df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:56.372112 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d490757-ec69-48a9-8fd5-24c1006f8df3 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:56.397602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 866/1727] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:58.806795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c0908-e635-4a76-afda-5196df621d6c None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:58.808030 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c0908-e635-4a76-afda-5196df621d6c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:58.808030 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c0908-e635-4a76-afda-5196df621d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:58.860848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-ef4c0908-e635-4a76-afda-5196df621d6c None None] MFA Rules not processed for user `946827404b58485daed0fc22a6da379a`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:58.863179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89200085-da34-48c9-a809-057caacabe54 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:58.863677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89200085-da34-48c9-a809-057caacabe54 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:58.863784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89200085-da34-48c9-a809-057caacabe54 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:58.865651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 867/1728] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 05:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:34:58.867021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ef4c0908-e635-4a76-afda-5196df621d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:58.891138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb702f-d34b-4e2c-b832-3803e0d6cefd None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:58.891642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb702f-d34b-4e2c-b832-3803e0d6cefd None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:58.892068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb702f-d34b-4e2c-b832-3803e0d6cefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:58.895966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 862/1729] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:58.897544 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7fda3-2218-4c3e-8bd4-52700eb26c19 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:58.898008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7fda3-2218-4c3e-8bd4-52700eb26c19 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:58.898539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7fda3-2218-4c3e-8bd4-52700eb26c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:58.925442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-2bc7fda3-2218-4c3e-8bd4-52700eb26c19 None None] MFA Rules not processed for user `8ef60b27f5f545aa8ea063009ec66eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:58.926973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-2bc7fda3-2218-4c3e-8bd4-52700eb26c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:58.940220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 863/1730] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 05:34:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:34:58.979713 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adaf8d-ccc2-4027-8008-aa403785b7d6 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:58.979990 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adaf8d-ccc2-4027-8008-aa403785b7d6 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:58.980424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adaf8d-ccc2-4027-8008-aa403785b7d6 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:58.982230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 864/1731] 10.222.0.20 () {54 vars in 961 bytes} [Fri Sep 16 05:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:34:58.988860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57456d-6971-45e2-9d05-2822eedb38d0 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:58.992278 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57456d-6971-45e2-9d05-2822eedb38d0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:58.992556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57456d-6971-45e2-9d05-2822eedb38d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:58.994441 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-f7fb702f-d34b-4e2c-b832-3803e0d6cefd None None] MFA Rules not processed for user `fa478cd622a949d58a2f0eb4bb437368`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:58.999157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f7fb702f-d34b-4e2c-b832-3803e0d6cefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:59.089729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-4e57456d-6971-45e2-9d05-2822eedb38d0 None None] MFA Rules not processed for user `8ef60b27f5f545aa8ea063009ec66eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:59.091020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4e57456d-6971-45e2-9d05-2822eedb38d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:34:59.157256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 865/1732] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 16 05:34:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:34:59.166388 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57456d-6971-45e2-9d05-2822eedb38d0 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:59.194760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57456d-6971-45e2-9d05-2822eedb38d0 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:59.205157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:34:59.215501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163898db-0f83-4720-8b7a-77c030298680 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef60b27f5f545aa8ea063009ec66eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:59.216135 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163898db-0f83-4720-8b7a-77c030298680 service placement] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:59.216414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163898db-0f83-4720-8b7a-77c030298680 service placement] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:59.220982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163898db-0f83-4720-8b7a-77c030298680 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:59.265666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163898db-0f83-4720-8b7a-77c030298680 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:59.269537 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163898db-0f83-4720-8b7a-77c030298680 service placement] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:59.281955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 868/1733] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:34:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:34:59.295593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 866/1734] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:59.305706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb702f-d34b-4e2c-b832-3803e0d6cefd None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:34:59.326462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb702f-d34b-4e2c-b832-3803e0d6cefd None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:34:59.340864 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9fe9d-cf91-4205-8b7b-b9fbefedf39c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:34:59.344408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9fe9d-cf91-4205-8b7b-b9fbefedf39c service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:59.345047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9fe9d-cf91-4205-8b7b-b9fbefedf39c service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:59.345503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9fe9d-cf91-4205-8b7b-b9fbefedf39c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:59.367679 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9fe9d-cf91-4205-8b7b-b9fbefedf39c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:34:59.370082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9fe9d-cf91-4205-8b7b-b9fbefedf39c service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:34:59.395651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 869/1735] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:34:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:34:59.593415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eff8b-962f-451b-a274-66310be5f6f1 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:34:59.593732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eff8b-962f-451b-a274-66310be5f6f1 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:34:59.593971 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eff8b-962f-451b-a274-66310be5f6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:34:59.800174 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-208eff8b-962f-451b-a274-66310be5f6f1 None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:34:59.801428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-208eff8b-962f-451b-a274-66310be5f6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:00.047908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 867/1736] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:34:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:00.417606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9fe9d-cf91-4205-8b7b-b9fbefedf39c service nova] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:00.420976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-66e9fe9d-cf91-4205-8b7b-b9fbefedf39c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:00.712365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9fe9d-cf91-4205-8b7b-b9fbefedf39c service nova] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:00.720011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009fffa-286c-4b45-bb37-9d3a186dc851 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:00.720951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009fffa-286c-4b45-bb37-9d3a186dc851 service swift] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:00.721429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009fffa-286c-4b45-bb37-9d3a186dc851 service swift] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:00.722048 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009fffa-286c-4b45-bb37-9d3a186dc851 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:00.736907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009fffa-286c-4b45-bb37-9d3a186dc851 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:00.739553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009fffa-286c-4b45-bb37-9d3a186dc851 service swift] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:00.761642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 870/1737] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:35:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:35:01.565198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c459c-3cf2-48f2-b935-26151e1843b3 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:01.565720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c459c-3cf2-48f2-b935-26151e1843b3 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:01.565793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c459c-3cf2-48f2-b935-26151e1843b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:01.578693 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:01.647843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-453c459c-3cf2-48f2-b935-26151e1843b3 None None] MFA Rules not processed for user `7079422a25134eaa83102f970cc2b287`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:01.655065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-453c459c-3cf2-48f2-b935-26151e1843b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:01.696804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 868/1738] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:02.209904 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009fffa-286c-4b45-bb37-9d3a186dc851 service swift] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:02.211485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f009fffa-286c-4b45-bb37-9d3a186dc851 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:02.359589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009fffa-286c-4b45-bb37-9d3a186dc851 service swift] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:02.373915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a73b8-b598-4632-aaa2-ece3001813a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:02.374746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a73b8-b598-4632-aaa2-ece3001813a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:02.375176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a73b8-b598-4632-aaa2-ece3001813a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:02.375589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a73b8-b598-4632-aaa2-ece3001813a5 admin admin] PATH_INFO: `/v3/users/32c0eee4a5824c0db0d86aefa8bffd3c` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:02.379772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a73b8-b598-4632-aaa2-ece3001813a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c0eee4a5824c0db0d86aefa8bffd3c)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:02.381743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a73b8-b598-4632-aaa2-ece3001813a5 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:02.525624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:02.527324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-550a73b8-b598-4632-aaa2-ece3001813a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c0eee4a5824c0db0d86aefa8bffd3c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:02.528262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-550a73b8-b598-4632-aaa2-ece3001813a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c0eee4a5824c0db0d86aefa8bffd3c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:02.558640 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-550a73b8-b598-4632-aaa2-ece3001813a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c0eee4a5824c0db0d86aefa8bffd3c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:02.563759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-550a73b8-b598-4632-aaa2-ece3001813a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c0eee4a5824c0db0d86aefa8bffd3c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:02.622442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-550a73b8-b598-4632-aaa2-ece3001813a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c0eee4a5824c0db0d86aefa8bffd3c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:02.688083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 871/1739] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:02 2022] DELETE /identity/v3/users/32c0eee4a5824c0db0d86aefa8bffd3c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:02.700344 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f810067-690a-4826-827a-83389daec8bd None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:02.701024 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f810067-690a-4826-827a-83389daec8bd None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:02.701220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f810067-690a-4826-827a-83389daec8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:02.759150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-3f810067-690a-4826-827a-83389daec8bd None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:02.760571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddf689-afc3-45b9-a6db-662dbcc93931 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:02.760860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddf689-afc3-45b9-a6db-662dbcc93931 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:02.761137 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddf689-afc3-45b9-a6db-662dbcc93931 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:02.762483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 872/1740] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 05:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:35:02.764642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3f810067-690a-4826-827a-83389daec8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:02.945663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 869/1741] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:02.968313 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b24ea-4840-4e99-a2ad-defd41d4aa4f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:02.969644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b24ea-4840-4e99-a2ad-defd41d4aa4f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:02.969871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b24ea-4840-4e99-a2ad-defd41d4aa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:03.035410 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f810067-690a-4826-827a-83389daec8bd None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:03.037195 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3f810067-690a-4826-827a-83389daec8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:03.123885 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-a28b24ea-4840-4e99-a2ad-defd41d4aa4f None None] MFA Rules not processed for user `8ef60b27f5f545aa8ea063009ec66eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:03.127818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a28b24ea-4840-4e99-a2ad-defd41d4aa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:03.244397 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f810067-690a-4826-827a-83389daec8bd None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:03.257631 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fc339-c965-407d-b237-5c5bec2e5038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:03.258264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fc339-c965-407d-b237-5c5bec2e5038 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:03.258564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fc339-c965-407d-b237-5c5bec2e5038 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:03.258951 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fc339-c965-407d-b237-5c5bec2e5038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:03.293000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fc339-c965-407d-b237-5c5bec2e5038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:03.294468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fc339-c965-407d-b237-5c5bec2e5038 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:03.333818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 870/1742] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:35:03.334889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fc339-c965-407d-b237-5c5bec2e5038 service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:03.339714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-746fc339-c965-407d-b237-5c5bec2e5038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:03.386632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fc339-c965-407d-b237-5c5bec2e5038 service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:03.405084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1eef01-b829-4659-a56c-824a372a0717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:03.405736 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eef01-b829-4659-a56c-824a372a0717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:03.406013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eef01-b829-4659-a56c-824a372a0717 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:03.406283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eef01-b829-4659-a56c-824a372a0717 admin admin] PATH_INFO: `/v3/users/264331d460b3498ca88603a380ea61ce` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:03.411383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1eef01-b829-4659-a56c-824a372a0717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=264331d460b3498ca88603a380ea61ce)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:03.413359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1eef01-b829-4659-a56c-824a372a0717 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:03.430956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 873/1743] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 05:35:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:03.505748 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b24ea-4840-4e99-a2ad-defd41d4aa4f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:03.507444 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a28b24ea-4840-4e99-a2ad-defd41d4aa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:03.540928 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b24ea-4840-4e99-a2ad-defd41d4aa4f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:03.571276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25114f17-8716-4f37-a601-9eb822c42914 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef60b27f5f545aa8ea063009ec66eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:03.579072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114f17-8716-4f37-a601-9eb822c42914 service placement] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:03.579773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114f17-8716-4f37-a601-9eb822c42914 service placement] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:03.580462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114f17-8716-4f37-a601-9eb822c42914 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:03.603034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3f1eef01-b829-4659-a56c-824a372a0717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264331d460b3498ca88603a380ea61ce'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:03.603897 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3f1eef01-b829-4659-a56c-824a372a0717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264331d460b3498ca88603a380ea61ce'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:03.604558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25114f17-8716-4f37-a601-9eb822c42914 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:03.606809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25114f17-8716-4f37-a601-9eb822c42914 service placement] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:03.622813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3f1eef01-b829-4659-a56c-824a372a0717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264331d460b3498ca88603a380ea61ce'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:03.636377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 874/1744] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:35:03.646424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3f1eef01-b829-4659-a56c-824a372a0717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264331d460b3498ca88603a380ea61ce'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:03.647184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3f1eef01-b829-4659-a56c-824a372a0717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264331d460b3498ca88603a380ea61ce'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:03.706554 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 871/1745] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:03 2022] DELETE /identity/v3/users/264331d460b3498ca88603a380ea61ce => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:04.100775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25114f17-8716-4f37-a601-9eb822c42914 service placement] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:04.102741 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-25114f17-8716-4f37-a601-9eb822c42914 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:04.136514 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25114f17-8716-4f37-a601-9eb822c42914 service placement] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:04.297853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:04.299546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:04.299811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:04.301394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] PATH_INFO: `/v3/users/4e1f14af68bb4ca79d887f0b254b27fd` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:04.308192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e1f14af68bb4ca79d887f0b254b27fd)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:04.319657 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:04.466801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:04.471338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e1f14af68bb4ca79d887f0b254b27fd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:04.474377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e1f14af68bb4ca79d887f0b254b27fd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:04.501064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e1f14af68bb4ca79d887f0b254b27fd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:04.501693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e1f14af68bb4ca79d887f0b254b27fd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:04.549378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e1f14af68bb4ca79d887f0b254b27fd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:04.598279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 875/1746] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:04 2022] DELETE /identity/v3/users/4e1f14af68bb4ca79d887f0b254b27fd => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:04.599868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5e8a3-fee8-4862-8f9a-ee5f0b5efa86 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:04.600215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5e8a3-fee8-4862-8f9a-ee5f0b5efa86 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:04.604565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5e8a3-fee8-4862-8f9a-ee5f0b5efa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:04.676664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-4aa5e8a3-fee8-4862-8f9a-ee5f0b5efa86 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:04.686558 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4aa5e8a3-fee8-4862-8f9a-ee5f0b5efa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:04.705242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:04.875914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 872/1747] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:04.981918 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:04.986671 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:05.177070 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536cc6c-fc90-4cb5-b09b-4fa93248ca64 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:05.186750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592db77-205d-45e7-93ca-e9e54bd3b2f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:05.190169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592db77-205d-45e7-93ca-e9e54bd3b2f3 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:05.191408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592db77-205d-45e7-93ca-e9e54bd3b2f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:05.192618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592db77-205d-45e7-93ca-e9e54bd3b2f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:05.227264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592db77-205d-45e7-93ca-e9e54bd3b2f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:05.229673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592db77-205d-45e7-93ca-e9e54bd3b2f3 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:05.251665 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 876/1748] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:05.586216 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5e8a3-fee8-4862-8f9a-ee5f0b5efa86 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:05.587872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4aa5e8a3-fee8-4862-8f9a-ee5f0b5efa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:05.619160 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5e8a3-fee8-4862-8f9a-ee5f0b5efa86 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:05.646925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:05.647750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:05.651268 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:05.651852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] PATH_INFO: `/v3/projects/2dc7f939e90847b5b8c79088a7198faa` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:05.653715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dc7f939e90847b5b8c79088a7198faa)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:05.657587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:05.798778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dc7f939e90847b5b8c79088a7198faa', 'request_id': 'req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:05.836860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dc7f939e90847b5b8c79088a7198faa', 'request_id': 'req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:05.860802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dc7f939e90847b5b8c79088a7198faa', 'request_id': 'req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:05.892898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] The token cache is being invalidate because project 2dc7f939e90847b5b8c79088a7198faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:05.894340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:05.894853 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:05.898137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 873/1749] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:05 2022] DELETE /identity/v3/projects/2dc7f939e90847b5b8c79088a7198faa => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:05.902810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592db77-205d-45e7-93ca-e9e54bd3b2f3 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:05.916236 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592db77-205d-45e7-93ca-e9e54bd3b2f3 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:06.014058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:06.015315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:06.015737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:06.016167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] PATH_INFO: `/v3/users/77f27489966746c28cb6e2fc6bc9513f` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:06.018010 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f27489966746c28cb6e2fc6bc9513f)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:06.022257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:06.207836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f27489966746c28cb6e2fc6bc9513f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:06.217018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f27489966746c28cb6e2fc6bc9513f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:06.288041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f27489966746c28cb6e2fc6bc9513f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:06.289316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f27489966746c28cb6e2fc6bc9513f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:06.317834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:06.321461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f27489966746c28cb6e2fc6bc9513f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:06.368032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 877/1750] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:05 2022] DELETE /identity/v3/users/77f27489966746c28cb6e2fc6bc9513f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:06.960362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:06.966838 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:07.000435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b3e1f-dd46-4484-a03a-a9d9605d7f4e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:07.211339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:07.213723 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:07.214016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:07.214468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] PATH_INFO: `/v3/projects/aac6a0d133ef45b38eeaed0a5766bf43` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:07.217848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac6a0d133ef45b38eeaed0a5766bf43)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:07.220115 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:07.332152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:07.350605 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac6a0d133ef45b38eeaed0a5766bf43', 'request_id': 'req-597990f0-b784-4331-8106-12bb814a6f33'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:07.367432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac6a0d133ef45b38eeaed0a5766bf43', 'request_id': 'req-597990f0-b784-4331-8106-12bb814a6f33'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:07.385203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac6a0d133ef45b38eeaed0a5766bf43', 'request_id': 'req-597990f0-b784-4331-8106-12bb814a6f33'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:07.408304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] The token cache is being invalidate because project aac6a0d133ef45b38eeaed0a5766bf43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:07.409105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:07.410875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:07.418538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 874/1751] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:06 2022] DELETE /identity/v3/projects/aac6a0d133ef45b38eeaed0a5766bf43 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:07.418797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:07.421662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:07.486429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b7b4-902d-4710-8a57-9a2451ab2517 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:07.670094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675eb1f-7196-4e92-9a4d-b671549a27ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:07.670887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675eb1f-7196-4e92-9a4d-b671549a27ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:07.671234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675eb1f-7196-4e92-9a4d-b671549a27ea admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:07.671575 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675eb1f-7196-4e92-9a4d-b671549a27ea admin admin] PATH_INFO: `/v3/users/7364e6179d69414d8e61b63956906794` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:07.681447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675eb1f-7196-4e92-9a4d-b671549a27ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7364e6179d69414d8e61b63956906794)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:07.683570 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675eb1f-7196-4e92-9a4d-b671549a27ea admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:07.800296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:07.802148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:07.813652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-2675eb1f-7196-4e92-9a4d-b671549a27ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7364e6179d69414d8e61b63956906794'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:07.815262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-2675eb1f-7196-4e92-9a4d-b671549a27ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7364e6179d69414d8e61b63956906794'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:07.826799 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597990f0-b784-4331-8106-12bb814a6f33 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:07.839070 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:07.840476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:07.841226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:07.842260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-2675eb1f-7196-4e92-9a4d-b671549a27ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7364e6179d69414d8e61b63956906794'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:07.842717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] PATH_INFO: `/v3/projects/ec83eec797004647a462e52950657c21` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:07.843170 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-2675eb1f-7196-4e92-9a4d-b671549a27ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7364e6179d69414d8e61b63956906794'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:07.846134 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec83eec797004647a462e52950657c21)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:07.851160 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:07.869800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-2675eb1f-7196-4e92-9a4d-b671549a27ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7364e6179d69414d8e61b63956906794'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:07.923636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 878/1752] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:07 2022] DELETE /identity/v3/users/7364e6179d69414d8e61b63956906794 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:07.964757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7593aef-4337-4a0d-84e6-75600615d816 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:07.969575 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7593aef-4337-4a0d-84e6-75600615d816 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:07.970073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7593aef-4337-4a0d-84e6-75600615d816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:07.984917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec83eec797004647a462e52950657c21', 'request_id': 'req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:07.999384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec83eec797004647a462e52950657c21', 'request_id': 'req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:08.017345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b7593aef-4337-4a0d-84e6-75600615d816 None None] MFA Rules not processed for user `d51f44d06b0f4303a753709bd1bcf3e5`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:08.019127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b7593aef-4337-4a0d-84e6-75600615d816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:08.021930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec83eec797004647a462e52950657c21', 'request_id': 'req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:08.055569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] The token cache is being invalidate because project ec83eec797004647a462e52950657c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:08.055868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:08.060113 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:08.067001 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 875/1753] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:07 2022] DELETE /identity/v3/projects/ec83eec797004647a462e52950657c21 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:08.068873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:08.070793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:08.172301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 879/1754] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Sep 16 05:35:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:08.207364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7593aef-4337-4a0d-84e6-75600615d816 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:08.208932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b7593aef-4337-4a0d-84e6-75600615d816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:08.248571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7593aef-4337-4a0d-84e6-75600615d816 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:08.263528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1224d6f-2772-467c-ac17-a403f2307768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:08.264181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1224d6f-2772-467c-ac17-a403f2307768 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:08.264448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1224d6f-2772-467c-ac17-a403f2307768 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:08.264720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1224d6f-2772-467c-ac17-a403f2307768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:08.284113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1224d6f-2772-467c-ac17-a403f2307768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:08.285503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1224d6f-2772-467c-ac17-a403f2307768 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:08.286768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be9a62-ef1f-4958-a1c7-20fcf6b701e4 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:08.296313 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:08.305139 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc63b5-cc36-4e54-836f-6138d5957b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:08.307376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc63b5-cc36-4e54-836f-6138d5957b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:08.309930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc63b5-cc36-4e54-836f-6138d5957b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:08.310052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 880/1755] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:35:08.311962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc63b5-cc36-4e54-836f-6138d5957b92 admin admin] PATH_INFO: `/v3/users/613cb5dfcf7c4c97ba5aed22e1e8cd22` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:08.315194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1224d6f-2772-467c-ac17-a403f2307768 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:08.316907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc63b5-cc36-4e54-836f-6138d5957b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=613cb5dfcf7c4c97ba5aed22e1e8cd22)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:08.322975 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc63b5-cc36-4e54-836f-6138d5957b92 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:08.335727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1224d6f-2772-467c-ac17-a403f2307768 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:08.346407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c01f18-3d41-45f4-909d-e293fc0d5536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:08.347380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c01f18-3d41-45f4-909d-e293fc0d5536 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:08.347843 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c01f18-3d41-45f4-909d-e293fc0d5536 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:08.349224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c01f18-3d41-45f4-909d-e293fc0d5536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:08.404619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c01f18-3d41-45f4-909d-e293fc0d5536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:08.406439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c01f18-3d41-45f4-909d-e293fc0d5536 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:08.436462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-facc63b5-cc36-4e54-836f-6138d5957b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '613cb5dfcf7c4c97ba5aed22e1e8cd22'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:08.437696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-facc63b5-cc36-4e54-836f-6138d5957b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '613cb5dfcf7c4c97ba5aed22e1e8cd22'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:08.450287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:08.457543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-facc63b5-cc36-4e54-836f-6138d5957b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '613cb5dfcf7c4c97ba5aed22e1e8cd22'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:08.460178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 881/1756] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:08.491063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-facc63b5-cc36-4e54-836f-6138d5957b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '613cb5dfcf7c4c97ba5aed22e1e8cd22'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:08.492569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-facc63b5-cc36-4e54-836f-6138d5957b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '613cb5dfcf7c4c97ba5aed22e1e8cd22'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:08.574394 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 876/1757] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:08 2022] DELETE /identity/v3/users/613cb5dfcf7c4c97ba5aed22e1e8cd22 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:08.944795 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c01f18-3d41-45f4-909d-e293fc0d5536 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:08.946460 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-75c01f18-3d41-45f4-909d-e293fc0d5536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:08.987005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c01f18-3d41-45f4-909d-e293fc0d5536 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:09.109193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e769f7-0d5e-4717-9dc0-aa2879e26993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:09.111666 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e769f7-0d5e-4717-9dc0-aa2879e26993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:09.111666 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e769f7-0d5e-4717-9dc0-aa2879e26993 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:09.111666 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e769f7-0d5e-4717-9dc0-aa2879e26993 admin admin] PATH_INFO: `/v3/projects/db9b393230094622824d6c3bb912acbe` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:09.115223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e769f7-0d5e-4717-9dc0-aa2879e26993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9b393230094622824d6c3bb912acbe)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:09.118661 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e769f7-0d5e-4717-9dc0-aa2879e26993 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:09.251905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-82e769f7-0d5e-4717-9dc0-aa2879e26993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9b393230094622824d6c3bb912acbe', 'request_id': 'req-82e769f7-0d5e-4717-9dc0-aa2879e26993'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:09.265334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-82e769f7-0d5e-4717-9dc0-aa2879e26993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9b393230094622824d6c3bb912acbe', 'request_id': 'req-82e769f7-0d5e-4717-9dc0-aa2879e26993'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:09.290854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-82e769f7-0d5e-4717-9dc0-aa2879e26993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9b393230094622824d6c3bb912acbe', 'request_id': 'req-82e769f7-0d5e-4717-9dc0-aa2879e26993'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:09.324064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-82e769f7-0d5e-4717-9dc0-aa2879e26993 admin admin] The token cache is being invalidate because project db9b393230094622824d6c3bb912acbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:09.324361 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-82e769f7-0d5e-4717-9dc0-aa2879e26993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:09.331565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-82e769f7-0d5e-4717-9dc0-aa2879e26993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:09.334208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 882/1758] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:08 2022] DELETE /identity/v3/projects/db9b393230094622824d6c3bb912acbe => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:09.339200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255c4f0-a162-4c4c-86d9-e9e666bccede None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:09.340052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255c4f0-a162-4c4c-86d9-e9e666bccede None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:09.340478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255c4f0-a162-4c4c-86d9-e9e666bccede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:09.393700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-0255c4f0-a162-4c4c-86d9-e9e666bccede None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:09.403620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0255c4f0-a162-4c4c-86d9-e9e666bccede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:09.590551 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 877/1759] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:09.598273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401857cb-bcf8-4f1e-8b68-eb807d4436b0 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:09.599204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401857cb-bcf8-4f1e-8b68-eb807d4436b0 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:09.599612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401857cb-bcf8-4f1e-8b68-eb807d4436b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:09.640910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-401857cb-bcf8-4f1e-8b68-eb807d4436b0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:09.642144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-401857cb-bcf8-4f1e-8b68-eb807d4436b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:09.667434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 883/1760] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:09.667747 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255c4f0-a162-4c4c-86d9-e9e666bccede None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:09.684406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255c4f0-a162-4c4c-86d9-e9e666bccede None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:09.709968 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcd00d-2497-47ca-aad4-dce77223b9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:09.710801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcd00d-2497-47ca-aad4-dce77223b9be admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:09.711078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcd00d-2497-47ca-aad4-dce77223b9be admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:09.711345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcd00d-2497-47ca-aad4-dce77223b9be admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:09.712000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcd00d-2497-47ca-aad4-dce77223b9be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:09.712298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcd00d-2497-47ca-aad4-dce77223b9be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:09.722966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcd00d-2497-47ca-aad4-dce77223b9be admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:09.764948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 878/1761] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:35:09.766822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401857cb-bcf8-4f1e-8b68-eb807d4436b0 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:09.782078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401857cb-bcf8-4f1e-8b68-eb807d4436b0 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:09.795881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea5a3c-efcb-4463-94cd-f5335d0e9500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:09.799094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea5a3c-efcb-4463-94cd-f5335d0e9500 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:09.799827 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea5a3c-efcb-4463-94cd-f5335d0e9500 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:09.802646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea5a3c-efcb-4463-94cd-f5335d0e9500 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:09.804376 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea5a3c-efcb-4463-94cd-f5335d0e9500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:09.808715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea5a3c-efcb-4463-94cd-f5335d0e9500 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:09.865918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcd00d-2497-47ca-aad4-dce77223b9be admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:09.868031 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-81fcd00d-2497-47ca-aad4-dce77223b9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:09.903347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcd00d-2497-47ca-aad4-dce77223b9be admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:09.909623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 884/1762] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:09 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:09.912841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea5a3c-efcb-4463-94cd-f5335d0e9500 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:10.055101 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:10.088045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea5a3c-efcb-4463-94cd-f5335d0e9500 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:10.100686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81209c12-ad20-4022-b44b-e4e672ec8702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:10.101317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81209c12-ad20-4022-b44b-e4e672ec8702 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:10.101595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81209c12-ad20-4022-b44b-e4e672ec8702 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:10.101864 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81209c12-ad20-4022-b44b-e4e672ec8702 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:10.102538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81209c12-ad20-4022-b44b-e4e672ec8702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:10.104620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81209c12-ad20-4022-b44b-e4e672ec8702 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:10.135083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9538695-8002-4906-a909-a823ff2a217f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:10.136202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9538695-8002-4906-a909-a823ff2a217f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:10.138155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9538695-8002-4906-a909-a823ff2a217f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:10.139143 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9538695-8002-4906-a909-a823ff2a217f admin admin] PATH_INFO: `/v3/projects/900e2a59b58f451bafc11da404edf8a9` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:10.142039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9538695-8002-4906-a909-a823ff2a217f admin admin] RBAC: Authorizing `identity:delete_project(project_id=900e2a59b58f451bafc11da404edf8a9)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:10.148232 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9538695-8002-4906-a909-a823ff2a217f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:10.171164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 885/1763] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:09 2022] POST /identity/v3/users => generated 283 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:10.175458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81209c12-ad20-4022-b44b-e4e672ec8702 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:10.200943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81209c12-ad20-4022-b44b-e4e672ec8702 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:10.206861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37c9dc-16e5-47e6-9ff3-f92e3153a1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:10.208171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37c9dc-16e5-47e6-9ff3-f92e3153a1cc admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:10.208646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37c9dc-16e5-47e6-9ff3-f92e3153a1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:10.209247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37c9dc-16e5-47e6-9ff3-f92e3153a1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:10.210074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37c9dc-16e5-47e6-9ff3-f92e3153a1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:10.211910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37c9dc-16e5-47e6-9ff3-f92e3153a1cc admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:10.253374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 886/1764] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:10.257681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37c9dc-16e5-47e6-9ff3-f92e3153a1cc admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:10.275430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37c9dc-16e5-47e6-9ff3-f92e3153a1cc admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:10.317222 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c9538695-8002-4906-a909-a823ff2a217f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '900e2a59b58f451bafc11da404edf8a9', 'request_id': 'req-c9538695-8002-4906-a909-a823ff2a217f'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:10.337784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c9538695-8002-4906-a909-a823ff2a217f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '900e2a59b58f451bafc11da404edf8a9', 'request_id': 'req-c9538695-8002-4906-a909-a823ff2a217f'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:10.344402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:10.364497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c9538695-8002-4906-a909-a823ff2a217f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '900e2a59b58f451bafc11da404edf8a9', 'request_id': 'req-c9538695-8002-4906-a909-a823ff2a217f'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:10.400791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c9538695-8002-4906-a909-a823ff2a217f admin admin] The token cache is being invalidate because project 900e2a59b58f451bafc11da404edf8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:10.401005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c9538695-8002-4906-a909-a823ff2a217f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:10.405590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c9538695-8002-4906-a909-a823ff2a217f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:10.410747 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 879/1765] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:09 2022] DELETE /identity/v3/projects/900e2a59b58f451bafc11da404edf8a9 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:10.416424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab80341-7798-4a6c-abc7-63dcd24292ce None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:10.416725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab80341-7798-4a6c-abc7-63dcd24292ce None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:10.417010 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab80341-7798-4a6c-abc7-63dcd24292ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:10.426962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd341a3-fcf7-4bd4-8b2e-bc2ea83dd879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:10.427260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd341a3-fcf7-4bd4-8b2e-bc2ea83dd879 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:10.439057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd341a3-fcf7-4bd4-8b2e-bc2ea83dd879 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:10.439358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd341a3-fcf7-4bd4-8b2e-bc2ea83dd879 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:10.442901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd341a3-fcf7-4bd4-8b2e-bc2ea83dd879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:10.449958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd341a3-fcf7-4bd4-8b2e-bc2ea83dd879 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:10.475027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-3ab80341-7798-4a6c-abc7-63dcd24292ce None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:10.476289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3ab80341-7798-4a6c-abc7-63dcd24292ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:10.506575 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 880/1766] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:10.510358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 887/1767] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:10.514670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd341a3-fcf7-4bd4-8b2e-bc2ea83dd879 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:10.515090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bebadc-74de-4302-923e-4ffd50c27806 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:10.515382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bebadc-74de-4302-923e-4ffd50c27806 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:10.515720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bebadc-74de-4302-923e-4ffd50c27806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:10.520261 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-dcd341a3-fcf7-4bd4-8b2e-bc2ea83dd879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:10.594830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd341a3-fcf7-4bd4-8b2e-bc2ea83dd879 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:10.598418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-a5bebadc-74de-4302-923e-4ffd50c27806 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:10.600181 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-a5bebadc-74de-4302-923e-4ffd50c27806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:10.617238 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8371a9-b3b6-451d-bd4c-97da4c49ac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:10.617945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8371a9-b3b6-451d-bd4c-97da4c49ac1f admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:10.620874 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8371a9-b3b6-451d-bd4c-97da4c49ac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:10.621310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8371a9-b3b6-451d-bd4c-97da4c49ac1f admin admin] PATH_INFO: `/v3/projects/e0cbaf96aa69409fa260a30ea6e0aa7d/users/e3a1d3f2145d4a82b94e8daae71f3db3/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:10.642448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 881/1768] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:10.651636 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bebadc-74de-4302-923e-4ffd50c27806 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:10.685523 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8371a9-b3b6-451d-bd4c-97da4c49ac1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0cbaf96aa69409fa260a30ea6e0aa7d, user_id=e3a1d3f2145d4a82b94e8daae71f3db3, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:10.701057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8371a9-b3b6-451d-bd4c-97da4c49ac1f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:10.705082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bebadc-74de-4302-923e-4ffd50c27806 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:10.719593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333e0a5-b588-4e75-a86e-139c2a842abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:10.720595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333e0a5-b588-4e75-a86e-139c2a842abf admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:10.721198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333e0a5-b588-4e75-a86e-139c2a842abf admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:10.722111 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333e0a5-b588-4e75-a86e-139c2a842abf admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:10.723156 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333e0a5-b588-4e75-a86e-139c2a842abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:10.725380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333e0a5-b588-4e75-a86e-139c2a842abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:10.733019 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333e0a5-b588-4e75-a86e-139c2a842abf admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:10.755653 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 888/1769] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:10 2022] PUT /identity/v3/projects/e0cbaf96aa69409fa260a30ea6e0aa7d/users/e3a1d3f2145d4a82b94e8daae71f3db3/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:10.768101 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f014-5bc0-471a-913a-9ad700b930dc None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:10.768689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f014-5bc0-471a-913a-9ad700b930dc None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:10.769041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f014-5bc0-471a-913a-9ad700b930dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:10.784163 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 882/1770] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:10.788658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333e0a5-b588-4e75-a86e-139c2a842abf admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:10.821656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333e0a5-b588-4e75-a86e-139c2a842abf admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:10.903952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-9221f014-5bc0-471a-913a-9ad700b930dc None None] MFA Rules not processed for user `e3a1d3f2145d4a82b94e8daae71f3db3`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:10.905203 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-9221f014-5bc0-471a-913a-9ad700b930dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:11.036488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a433d-2165-4f5b-aa8b-68886079a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:11.037391 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a433d-2165-4f5b-aa8b-68886079a931 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:11.039234 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a433d-2165-4f5b-aa8b-68886079a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:11.040964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a433d-2165-4f5b-aa8b-68886079a931 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:11.041811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a433d-2165-4f5b-aa8b-68886079a931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:11.051836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a433d-2165-4f5b-aa8b-68886079a931 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:11.110524 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 889/1771] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:11.113963 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221f014-5bc0-471a-913a-9ad700b930dc None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:11.152947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221f014-5bc0-471a-913a-9ad700b930dc None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:11.170897 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359d440-56e4-444b-a823-d1a26e5bcd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:11.171520 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359d440-56e4-444b-a823-d1a26e5bcd6f admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:11.171799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359d440-56e4-444b-a823-d1a26e5bcd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:11.172106 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359d440-56e4-444b-a823-d1a26e5bcd6f admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:11.173026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359d440-56e4-444b-a823-d1a26e5bcd6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:11.173771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 883/1772] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:10 2022] POST /identity/v3/projects => generated 375 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:11.177318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359d440-56e4-444b-a823-d1a26e5bcd6f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:11.193667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a433d-2165-4f5b-aa8b-68886079a931 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:11.250654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 890/1773] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:11 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:11.251678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359d440-56e4-444b-a823-d1a26e5bcd6f admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:11.278443 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:11.379667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a433d-2165-4f5b-aa8b-68886079a931 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:11.425017 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359d440-56e4-444b-a823-d1a26e5bcd6f admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:11.431768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c69f1d-077b-4e0a-bf3c-797dffb77055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:11.432403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c69f1d-077b-4e0a-bf3c-797dffb77055 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:11.432687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c69f1d-077b-4e0a-bf3c-797dffb77055 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:11.432952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c69f1d-077b-4e0a-bf3c-797dffb77055 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:11.433588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c69f1d-077b-4e0a-bf3c-797dffb77055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:11.435612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c69f1d-077b-4e0a-bf3c-797dffb77055 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:11.499669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 891/1774] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:11 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:11.503245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c69f1d-077b-4e0a-bf3c-797dffb77055 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:11.520346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c69f1d-077b-4e0a-bf3c-797dffb77055 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:11.523802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:11.536519 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b9856-5aea-4e2c-ba52-27b5af1a49d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:11.537278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b9856-5aea-4e2c-ba52-27b5af1a49d8 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:11.537616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b9856-5aea-4e2c-ba52-27b5af1a49d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:11.537956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b9856-5aea-4e2c-ba52-27b5af1a49d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:11.541927 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b9856-5aea-4e2c-ba52-27b5af1a49d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:11.544943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b9856-5aea-4e2c-ba52-27b5af1a49d8 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:11.546445 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1060b-cd09-4c06-9e3f-56f13cdb55fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:11.547207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1060b-cd09-4c06-9e3f-56f13cdb55fa admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:11.547583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1060b-cd09-4c06-9e3f-56f13cdb55fa admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:11.547969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1060b-cd09-4c06-9e3f-56f13cdb55fa admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:11.548710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1060b-cd09-4c06-9e3f-56f13cdb55fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:11.550748 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1060b-cd09-4c06-9e3f-56f13cdb55fa admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:11.568972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 892/1775] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:11.574156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b9856-5aea-4e2c-ba52-27b5af1a49d8 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:11.600408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b9856-5aea-4e2c-ba52-27b5af1a49d8 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:11.605482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 884/1776] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:11 2022] POST /identity/v3/users => generated 288 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:11.609538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1060b-cd09-4c06-9e3f-56f13cdb55fa admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:11.614624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c07444-a50f-405d-a890-155eef30b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:11.615352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c07444-a50f-405d-a890-155eef30b7e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:11.615631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c07444-a50f-405d-a890-155eef30b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:11.616070 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c07444-a50f-405d-a890-155eef30b7e6 admin admin] PATH_INFO: `/v3/projects/ea49c49e50d64e1586414c16590c4e74/users/a05f32e7bbc24d44a0586ff9cd24d9df/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:11.629456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1060b-cd09-4c06-9e3f-56f13cdb55fa admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:11.650877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dd247-a7c4-4422-98cd-ecb1917ff8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:11.651545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dd247-a7c4-4422-98cd-ecb1917ff8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:11.654409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dd247-a7c4-4422-98cd-ecb1917ff8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:11.654718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dd247-a7c4-4422-98cd-ecb1917ff8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:11.656067 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c07444-a50f-405d-a890-155eef30b7e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea49c49e50d64e1586414c16590c4e74, user_id=a05f32e7bbc24d44a0586ff9cd24d9df, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:11.656810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dd247-a7c4-4422-98cd-ecb1917ff8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:11.658454 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dd247-a7c4-4422-98cd-ecb1917ff8e0 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:11.660274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c07444-a50f-405d-a890-155eef30b7e6 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:11.690278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 893/1777] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:11 2022] PUT /identity/v3/projects/ea49c49e50d64e1586414c16590c4e74/users/a05f32e7bbc24d44a0586ff9cd24d9df/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:11.695754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c07444-a50f-405d-a890-155eef30b7e6 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:11.702342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 885/1778] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:11.703329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dd247-a7c4-4422-98cd-ecb1917ff8e0 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:11.732538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dd247-a7c4-4422-98cd-ecb1917ff8e0 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:11.850830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c07444-a50f-405d-a890-155eef30b7e6 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:11.867597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98cb88-6df9-49cd-9fb5-742149c9c192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:11.868213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98cb88-6df9-49cd-9fb5-742149c9c192 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:11.868649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98cb88-6df9-49cd-9fb5-742149c9c192 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:11.869107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98cb88-6df9-49cd-9fb5-742149c9c192 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:11.869778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98cb88-6df9-49cd-9fb5-742149c9c192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:11.873714 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98cb88-6df9-49cd-9fb5-742149c9c192 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:11.898121 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 894/1779] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:11.901701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98cb88-6df9-49cd-9fb5-742149c9c192 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:11.927924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98cb88-6df9-49cd-9fb5-742149c9c192 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:11.939331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad42b7f-f95f-4697-b4db-0358f84f4b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:11.940510 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad42b7f-f95f-4697-b4db-0358f84f4b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:11.940790 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad42b7f-f95f-4697-b4db-0358f84f4b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:11.941130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad42b7f-f95f-4697-b4db-0358f84f4b44 admin admin] PATH_INFO: `/v3/projects/ea49c49e50d64e1586414c16590c4e74/users/a05f32e7bbc24d44a0586ff9cd24d9df/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:11.946902 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad42b7f-f95f-4697-b4db-0358f84f4b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea49c49e50d64e1586414c16590c4e74, user_id=a05f32e7bbc24d44a0586ff9cd24d9df, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:11.954681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad42b7f-f95f-4697-b4db-0358f84f4b44 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:11.960400 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c533d-dbf5-4bf4-8094-70757682dbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:11.964177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c533d-dbf5-4bf4-8094-70757682dbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:11.964421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c533d-dbf5-4bf4-8094-70757682dbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:11.964622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c533d-dbf5-4bf4-8094-70757682dbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:11.971579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c533d-dbf5-4bf4-8094-70757682dbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:11.975637 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c533d-dbf5-4bf4-8094-70757682dbb5 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:11.987780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 895/1780] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:11 2022] PUT /identity/v3/projects/ea49c49e50d64e1586414c16590c4e74/users/a05f32e7bbc24d44a0586ff9cd24d9df/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:11.998193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f15a0e-e9cd-4e8d-b5eb-bfb14fd6cbf5 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:11.998474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f15a0e-e9cd-4e8d-b5eb-bfb14fd6cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:11.998763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f15a0e-e9cd-4e8d-b5eb-bfb14fd6cbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:12.020947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 886/1781] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:12.025378 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c533d-dbf5-4bf4-8094-70757682dbb5 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:12.059773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c533d-dbf5-4bf4-8094-70757682dbb5 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:12.076761 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-32f15a0e-e9cd-4e8d-b5eb-bfb14fd6cbf5 None None] MFA Rules not processed for user `a05f32e7bbc24d44a0586ff9cd24d9df`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:12.079442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-32f15a0e-e9cd-4e8d-b5eb-bfb14fd6cbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:12.231577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:12.283273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523317c-dc95-4229-8b0e-1309e077c8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:12.285498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523317c-dc95-4229-8b0e-1309e077c8c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:12.285781 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523317c-dc95-4229-8b0e-1309e077c8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:12.286061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523317c-dc95-4229-8b0e-1309e077c8c5 admin admin] PATH_INFO: `/v3/projects/c1d270a31ee54fa8b3d132d82a2413da/users/b58481e2a11d4db0923a89973893f354/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:12.358398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 896/1782] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:12.378586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f15a0e-e9cd-4e8d-b5eb-bfb14fd6cbf5 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:12.378924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523317c-dc95-4229-8b0e-1309e077c8c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d270a31ee54fa8b3d132d82a2413da, user_id=b58481e2a11d4db0923a89973893f354, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:12.392558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-32f15a0e-e9cd-4e8d-b5eb-bfb14fd6cbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:12.398327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523317c-dc95-4229-8b0e-1309e077c8c5 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:12.427890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 887/1783] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:12 2022] PUT /identity/v3/projects/c1d270a31ee54fa8b3d132d82a2413da/users/b58481e2a11d4db0923a89973893f354/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:12.453032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61b0c-4856-47bf-9050-8d0eaede08f7 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:12.453605 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61b0c-4856-47bf-9050-8d0eaede08f7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:12.453605 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61b0c-4856-47bf-9050-8d0eaede08f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:12.520256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-fbd61b0c-4856-47bf-9050-8d0eaede08f7 None None] MFA Rules not processed for user `b58481e2a11d4db0923a89973893f354`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:12.521576 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-fbd61b0c-4856-47bf-9050-8d0eaede08f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:12.576044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f15a0e-e9cd-4e8d-b5eb-bfb14fd6cbf5 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:12.630497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:12.699418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 888/1784] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:12.704271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61b0c-4856-47bf-9050-8d0eaede08f7 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:12.712790 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c85ccd-9c79-4c65-b861-803474cc7d3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:12.719133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85ccd-9c79-4c65-b861-803474cc7d3a service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:12.719604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85ccd-9c79-4c65-b861-803474cc7d3a service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:12.719984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85ccd-9c79-4c65-b861-803474cc7d3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:12.857645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61b0c-4856-47bf-9050-8d0eaede08f7 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:12.869885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6202bd-d392-4453-9314-70dfb4c0b3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:12.870606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6202bd-d392-4453-9314-70dfb4c0b3db admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:12.870921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6202bd-d392-4453-9314-70dfb4c0b3db admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:12.871190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6202bd-d392-4453-9314-70dfb4c0b3db admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:12.871893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6202bd-d392-4453-9314-70dfb4c0b3db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:12.874831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6202bd-d392-4453-9314-70dfb4c0b3db admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:12.901473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c85ccd-9c79-4c65-b861-803474cc7d3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:12.904378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c85ccd-9c79-4c65-b861-803474cc7d3a service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:12.925083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 889/1785] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:12 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:12.926022 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6202bd-d392-4453-9314-70dfb4c0b3db admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:12.947748 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 897/1786] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:13.130055 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c85ccd-9c79-4c65-b861-803474cc7d3a service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:13.149414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c85ccd-9c79-4c65-b861-803474cc7d3a service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:13.150296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6202bd-d392-4453-9314-70dfb4c0b3db admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:13.165253 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1826a68-c302-4758-89a3-e7855085480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:13.166680 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1826a68-c302-4758-89a3-e7855085480c admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:13.166964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1826a68-c302-4758-89a3-e7855085480c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:13.167700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1826a68-c302-4758-89a3-e7855085480c admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:13.167932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1826a68-c302-4758-89a3-e7855085480c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:13.170992 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1826a68-c302-4758-89a3-e7855085480c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:13.233261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 890/1787] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:12 2022] POST /identity/v3/users => generated 295 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:13.234337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1826a68-c302-4758-89a3-e7855085480c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:13.266785 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1826a68-c302-4758-89a3-e7855085480c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:13.268142 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:13.284261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856a543-90c1-490f-a1c6-944c1dc0b59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:13.285661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a543-90c1-490f-a1c6-944c1dc0b59e admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:13.285954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a543-90c1-490f-a1c6-944c1dc0b59e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:13.286308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a543-90c1-490f-a1c6-944c1dc0b59e admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:13.291440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856a543-90c1-490f-a1c6-944c1dc0b59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:13.299127 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856a543-90c1-490f-a1c6-944c1dc0b59e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:13.329012 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e365a9-a96b-469f-8c1a-e782a8a7473b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:13.331321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e365a9-a96b-469f-8c1a-e782a8a7473b service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:13.331613 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e365a9-a96b-469f-8c1a-e782a8a7473b service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:13.331870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e365a9-a96b-469f-8c1a-e782a8a7473b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:13.335075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 891/1788] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:13.343698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856a543-90c1-490f-a1c6-944c1dc0b59e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:13.377293 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856a543-90c1-490f-a1c6-944c1dc0b59e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:13.400388 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac5bf7-13b6-44ac-83a8-cab3fff7489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:13.401630 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5bf7-13b6-44ac-83a8-cab3fff7489d admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:13.403151 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5bf7-13b6-44ac-83a8-cab3fff7489d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:13.405789 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5bf7-13b6-44ac-83a8-cab3fff7489d admin admin] PATH_INFO: `/v3/projects/a2cbb4342951414eb2dc3bd66071a812/users/1c6a7dd210ec435480b1d3b47ad1697a/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:13.464854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac5bf7-13b6-44ac-83a8-cab3fff7489d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2cbb4342951414eb2dc3bd66071a812, user_id=1c6a7dd210ec435480b1d3b47ad1697a, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:13.477934 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac5bf7-13b6-44ac-83a8-cab3fff7489d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:13.525960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 892/1789] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:13 2022] PUT /identity/v3/projects/a2cbb4342951414eb2dc3bd66071a812/users/1c6a7dd210ec435480b1d3b47ad1697a/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:13.525960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac5bf7-13b6-44ac-83a8-cab3fff7489d admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:13.527972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-eaac5bf7-13b6-44ac-83a8-cab3fff7489d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:13.555251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e365a9-a96b-469f-8c1a-e782a8a7473b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:13.559060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e365a9-a96b-469f-8c1a-e782a8a7473b service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:13.607427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 898/1790] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:35:13.610313 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e365a9-a96b-469f-8c1a-e782a8a7473b service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:13.623600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:13.642779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e365a9-a96b-469f-8c1a-e782a8a7473b service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:13.750225 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624b168-3821-4d53-884c-e906f8efe75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:13.750952 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac5bf7-13b6-44ac-83a8-cab3fff7489d admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:13.752077 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624b168-3821-4d53-884c-e906f8efe75a admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:13.753173 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624b168-3821-4d53-884c-e906f8efe75a admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:13.753644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624b168-3821-4d53-884c-e906f8efe75a admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:13.754584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624b168-3821-4d53-884c-e906f8efe75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:13.757886 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624b168-3821-4d53-884c-e906f8efe75a admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:13.777010 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 899/1791] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:13.777783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6852fd5-dbb6-4e63-9996-c1da8dd207f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:13.778439 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6852fd5-dbb6-4e63-9996-c1da8dd207f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:13.781836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624b168-3821-4d53-884c-e906f8efe75a admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:13.787199 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6852fd5-dbb6-4e63-9996-c1da8dd207f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:13.787488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6852fd5-dbb6-4e63-9996-c1da8dd207f1 admin admin] PATH_INFO: `/v3/users/b9559006de1c45f59d5dbaa14a6a7a8f` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:13.790423 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6852fd5-dbb6-4e63-9996-c1da8dd207f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9559006de1c45f59d5dbaa14a6a7a8f)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:13.792517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6852fd5-dbb6-4e63-9996-c1da8dd207f1 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:13.802354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624b168-3821-4d53-884c-e906f8efe75a admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:13.819210 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50099a13-70e8-4a61-a801-1a45c60af3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:13.820104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50099a13-70e8-4a61-a801-1a45c60af3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:13.820532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50099a13-70e8-4a61-a801-1a45c60af3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:13.820946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50099a13-70e8-4a61-a801-1a45c60af3c0 admin admin] PATH_INFO: `/v3/projects/a2cbb4342951414eb2dc3bd66071a812/users/1c6a7dd210ec435480b1d3b47ad1697a/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:13.823928 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50099a13-70e8-4a61-a801-1a45c60af3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2cbb4342951414eb2dc3bd66071a812, user_id=1c6a7dd210ec435480b1d3b47ad1697a, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:13.827474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50099a13-70e8-4a61-a801-1a45c60af3c0 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:13.856659 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 900/1792] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:13 2022] PUT /identity/v3/projects/a2cbb4342951414eb2dc3bd66071a812/users/1c6a7dd210ec435480b1d3b47ad1697a/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:13.880458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a780-0305-44bd-8af0-fa48c31f0880 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:13.882102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a780-0305-44bd-8af0-fa48c31f0880 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:13.882597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a780-0305-44bd-8af0-fa48c31f0880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:13.917625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-b6852fd5-dbb6-4e63-9996-c1da8dd207f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9559006de1c45f59d5dbaa14a6a7a8f'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:13.918188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-b6852fd5-dbb6-4e63-9996-c1da8dd207f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9559006de1c45f59d5dbaa14a6a7a8f'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:13.941191 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-b6852fd5-dbb6-4e63-9996-c1da8dd207f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9559006de1c45f59d5dbaa14a6a7a8f'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:13.977256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-b6852fd5-dbb6-4e63-9996-c1da8dd207f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9559006de1c45f59d5dbaa14a6a7a8f'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:13.978102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-b6852fd5-dbb6-4e63-9996-c1da8dd207f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9559006de1c45f59d5dbaa14a6a7a8f'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:14.041992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-39c2a780-0305-44bd-8af0-fa48c31f0880 None None] MFA Rules not processed for user `1c6a7dd210ec435480b1d3b47ad1697a`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:14.043087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-39c2a780-0305-44bd-8af0-fa48c31f0880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:14.064894 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 893/1793] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:13 2022] DELETE /identity/v3/users/b9559006de1c45f59d5dbaa14a6a7a8f => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:14.075018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13173003-295a-49f7-b246-7cfebcb2299d None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:14.076090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13173003-295a-49f7-b246-7cfebcb2299d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:14.076090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13173003-295a-49f7-b246-7cfebcb2299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:14.120797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-13173003-295a-49f7-b246-7cfebcb2299d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:14.122119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-13173003-295a-49f7-b246-7cfebcb2299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:14.236457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:14.249723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 901/1794] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:14.262903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2a780-0305-44bd-8af0-fa48c31f0880 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:14.264696 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-39c2a780-0305-44bd-8af0-fa48c31f0880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:14.364192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 894/1795] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:14.388845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13173003-295a-49f7-b246-7cfebcb2299d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:14.389973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-13173003-295a-49f7-b246-7cfebcb2299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:14.401497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2a780-0305-44bd-8af0-fa48c31f0880 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:14.545037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210baeb-77a2-4315-9fbd-cf06aeb7120f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:14.545785 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210baeb-77a2-4315-9fbd-cf06aeb7120f service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:14.546178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210baeb-77a2-4315-9fbd-cf06aeb7120f service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:14.546648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210baeb-77a2-4315-9fbd-cf06aeb7120f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:14.551578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0210baeb-77a2-4315-9fbd-cf06aeb7120f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:14.553064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:14.589877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13173003-295a-49f7-b246-7cfebcb2299d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:14.601720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e6161-a44a-4734-b7f8-5594155a11a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:14.607877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e6161-a44a-4734-b7f8-5594155a11a4 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:14.610771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e6161-a44a-4734-b7f8-5594155a11a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:14.611088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e6161-a44a-4734-b7f8-5594155a11a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:14.631556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e6161-a44a-4734-b7f8-5594155a11a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:14.633347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e6161-a44a-4734-b7f8-5594155a11a4 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:14.666880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 895/1796] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:14.668020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e6161-a44a-4734-b7f8-5594155a11a4 service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:14.672103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9e2e6161-a44a-4734-b7f8-5594155a11a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:14.709403 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e6161-a44a-4734-b7f8-5594155a11a4 service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:14.717860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486026f-98b1-4862-988f-a52a4697653a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:14.718925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486026f-98b1-4862-988f-a52a4697653a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:14.719611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486026f-98b1-4862-988f-a52a4697653a admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:14.720280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486026f-98b1-4862-988f-a52a4697653a admin admin] PATH_INFO: `/v3/projects/f6a2db53916548aa9986e5a4ff26b921` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:14.722054 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486026f-98b1-4862-988f-a52a4697653a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a2db53916548aa9986e5a4ff26b921)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:14.726933 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486026f-98b1-4862-988f-a52a4697653a admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:14.797955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210baeb-77a2-4315-9fbd-cf06aeb7120f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:14.805192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210baeb-77a2-4315-9fbd-cf06aeb7120f service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:14.856555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 902/1797] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:14.862862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e486026f-98b1-4862-988f-a52a4697653a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a2db53916548aa9986e5a4ff26b921', 'request_id': 'req-e486026f-98b1-4862-988f-a52a4697653a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:14.866292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339d295-312e-4552-a71c-2903ea960893 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:14.869378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339d295-312e-4552-a71c-2903ea960893 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:14.871169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339d295-312e-4552-a71c-2903ea960893 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:14.879112 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e486026f-98b1-4862-988f-a52a4697653a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a2db53916548aa9986e5a4ff26b921', 'request_id': 'req-e486026f-98b1-4862-988f-a52a4697653a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:14.890770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 903/1798] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 05:35:14 2022] GET /identity => generated 270 bytes in 33 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:35:14.897618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e486026f-98b1-4862-988f-a52a4697653a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a2db53916548aa9986e5a4ff26b921', 'request_id': 'req-e486026f-98b1-4862-988f-a52a4697653a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:14.900487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87783f22-178e-4d4f-9ccb-e6184e82cf4a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:14.905417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87783f22-178e-4d4f-9ccb-e6184e82cf4a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:14.907621 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87783f22-178e-4d4f-9ccb-e6184e82cf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:14.913114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e486026f-98b1-4862-988f-a52a4697653a admin admin] The token cache is being invalidate because project f6a2db53916548aa9986e5a4ff26b921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:14.913461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e486026f-98b1-4862-988f-a52a4697653a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:14.914223 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e486026f-98b1-4862-988f-a52a4697653a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:14.916286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 896/1799] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:14 2022] DELETE /identity/v3/projects/f6a2db53916548aa9986e5a4ff26b921 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:14.921539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8b6a0-e6c5-4860-81dd-f3b4ab92d8f7 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:14.921883 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8b6a0-e6c5-4860-81dd-f3b4ab92d8f7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:14.922169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8b6a0-e6c5-4860-81dd-f3b4ab92d8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:14.953128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-86a8b6a0-e6c5-4860-81dd-f3b4ab92d8f7 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:14.954811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-86a8b6a0-e6c5-4860-81dd-f3b4ab92d8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:15.031276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 897/1800] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:15.032779 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02c53f-0ec5-4e29-af68-f388e97392bd None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:15.033070 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02c53f-0ec5-4e29-af68-f388e97392bd None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:15.033396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02c53f-0ec5-4e29-af68-f388e97392bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:15.052134 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-87783f22-178e-4d4f-9ccb-e6184e82cf4a None None] MFA Rules not processed for user `fa478cd622a949d58a2f0eb4bb437368`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:15.055437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-87783f22-178e-4d4f-9ccb-e6184e82cf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:15.065530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-ea02c53f-0ec5-4e29-af68-f388e97392bd None None] MFA Rules not processed for user `515e548efd984b87bca742e26eec162a`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:15.067071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ea02c53f-0ec5-4e29-af68-f388e97392bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:15.174188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:15.227187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 898/1801] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 05:35:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:15.233231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5786e-5c33-4dbe-9ab5-e037e1f700e1 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:15.233832 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5786e-5c33-4dbe-9ab5-e037e1f700e1 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:15.234703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5786e-5c33-4dbe-9ab5-e037e1f700e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:15.314142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-25d5786e-5c33-4dbe-9ab5-e037e1f700e1 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:15.318663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-25d5786e-5c33-4dbe-9ab5-e037e1f700e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:15.365203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 899/1802] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:15.367265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5786e-5c33-4dbe-9ab5-e037e1f700e1 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:15.389355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5786e-5c33-4dbe-9ab5-e037e1f700e1 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:15.403534 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01e5aa-3d44-4fbd-9fb4-04820aa046d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:15.406204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01e5aa-3d44-4fbd-9fb4-04820aa046d6 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:15.406566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01e5aa-3d44-4fbd-9fb4-04820aa046d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:15.406851 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01e5aa-3d44-4fbd-9fb4-04820aa046d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:15.408550 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01e5aa-3d44-4fbd-9fb4-04820aa046d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:15.408868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01e5aa-3d44-4fbd-9fb4-04820aa046d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:15.412854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01e5aa-3d44-4fbd-9fb4-04820aa046d6 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:15.421507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 904/1803] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:15.440145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 900/1804] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:15.445136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87783f22-178e-4d4f-9ccb-e6184e82cf4a None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:15.510951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87783f22-178e-4d4f-9ccb-e6184e82cf4a None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:15.541830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa69697-2441-4cf9-8d54-d0d41f368a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:15.542535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa69697-2441-4cf9-8d54-d0d41f368a03 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:15.545649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa69697-2441-4cf9-8d54-d0d41f368a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:15.548565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa69697-2441-4cf9-8d54-d0d41f368a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:15.549460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dfdf6-5316-42c5-b4d1-5c66a52b57f2 None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:15.549803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dfdf6-5316-42c5-b4d1-5c66a52b57f2 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:15.550085 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dfdf6-5316-42c5-b4d1-5c66a52b57f2 None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:15.550629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa69697-2441-4cf9-8d54-d0d41f368a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:15.552196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 901/1805] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 05:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:35:15.558124 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa69697-2441-4cf9-8d54-d0d41f368a03 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:15.594295 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:15.659691 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 905/1806] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:15 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:15.666082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dfdf6-5316-42c5-b4d1-5c66a52b57f2 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:15.705981 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa69697-2441-4cf9-8d54-d0d41f368a03 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:15.719678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5aa69697-2441-4cf9-8d54-d0d41f368a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:15.909973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dfdf6-5316-42c5-b4d1-5c66a52b57f2 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:15.915233 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1f9c8-4bc1-4068-8967-431331371634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:15.916167 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1f9c8-4bc1-4068-8967-431331371634 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:15.916616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1f9c8-4bc1-4068-8967-431331371634 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:15.917099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1f9c8-4bc1-4068-8967-431331371634 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:15.917901 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1f9c8-4bc1-4068-8967-431331371634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:15.920832 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1f9c8-4bc1-4068-8967-431331371634 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:15.965044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 902/1807] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:15 2022] POST /identity/v3/users => generated 282 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:35:15.968037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee130d-069c-4b75-9730-74867feaa450 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:15.968525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee130d-069c-4b75-9730-74867feaa450 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:15.969029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee130d-069c-4b75-9730-74867feaa450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:15.993375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-06ee130d-069c-4b75-9730-74867feaa450 None None] MFA Rules not processed for user `515e548efd984b87bca742e26eec162a`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:15.995190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-06ee130d-069c-4b75-9730-74867feaa450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:16.010374 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 903/1808] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 05:35:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:16.012456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee130d-069c-4b75-9730-74867feaa450 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:16.046860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee130d-069c-4b75-9730-74867feaa450 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:16.048351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa69697-2441-4cf9-8d54-d0d41f368a03 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:16.054235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab6948-4287-47b5-823a-7dbb754d6311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:16.055251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab6948-4287-47b5-823a-7dbb754d6311 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:16.055717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab6948-4287-47b5-823a-7dbb754d6311 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:16.056411 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab6948-4287-47b5-823a-7dbb754d6311 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:16.057445 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab6948-4287-47b5-823a-7dbb754d6311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:16.059963 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab6948-4287-47b5-823a-7dbb754d6311 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:16.080911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e60fdb-0adc-4ea1-8068-b802899b52b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:16.080911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e60fdb-0adc-4ea1-8068-b802899b52b7 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:16.080911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e60fdb-0adc-4ea1-8068-b802899b52b7 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:16.080911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e60fdb-0adc-4ea1-8068-b802899b52b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:16.122496 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 904/1809] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:16.122820 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e60fdb-0adc-4ea1-8068-b802899b52b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:16.122820 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e60fdb-0adc-4ea1-8068-b802899b52b7 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:16.141325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab6948-4287-47b5-823a-7dbb754d6311 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:16.166479 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab6948-4287-47b5-823a-7dbb754d6311 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:16.181965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 906/1810] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:16.182125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3970f80-d19d-4e71-845e-2cdb319c66c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:16.183727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3970f80-d19d-4e71-845e-2cdb319c66c1 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:16.184119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3970f80-d19d-4e71-845e-2cdb319c66c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:16.184397 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3970f80-d19d-4e71-845e-2cdb319c66c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:16.185098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3970f80-d19d-4e71-845e-2cdb319c66c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:16.189294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3970f80-d19d-4e71-845e-2cdb319c66c1 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:16.228387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 905/1811] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:16.231585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e60fdb-0adc-4ea1-8068-b802899b52b7 service nova] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:16.260491 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e60fdb-0adc-4ea1-8068-b802899b52b7 service nova] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:16.288271 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfb390-aefb-4374-a60c-206c133dd242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:16.289824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb390-aefb-4374-a60c-206c133dd242 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:16.290112 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb390-aefb-4374-a60c-206c133dd242 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:16.290390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb390-aefb-4374-a60c-206c133dd242 admin admin] PATH_INFO: `/v3/projects/f3c0e289f95f46b08128d864ee1a64a5/users/e830e96bbe774e4a9345928843bbc9f6/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:16.370096 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfb390-aefb-4374-a60c-206c133dd242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c0e289f95f46b08128d864ee1a64a5, user_id=e830e96bbe774e4a9345928843bbc9f6, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:16.390264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfb390-aefb-4374-a60c-206c133dd242 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:16.459296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 907/1812] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:16 2022] PUT /identity/v3/projects/f3c0e289f95f46b08128d864ee1a64a5/users/e830e96bbe774e4a9345928843bbc9f6/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:16.464055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f248-9d12-44f9-a13e-2587f8600bb2 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:16.464333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f248-9d12-44f9-a13e-2587f8600bb2 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:16.464770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f248-9d12-44f9-a13e-2587f8600bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:16.552532 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-a704f248-9d12-44f9-a13e-2587f8600bb2 None None] MFA Rules not processed for user `e830e96bbe774e4a9345928843bbc9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:16.555683 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-a704f248-9d12-44f9-a13e-2587f8600bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:16.694411 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 906/1813] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:16.701290 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfb390-aefb-4374-a60c-206c133dd242 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:16.800798 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfb390-aefb-4374-a60c-206c133dd242 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:16.808611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbcfce-6bc9-4218-98e7-46e1759cfb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:16.809429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbcfce-6bc9-4218-98e7-46e1759cfb62 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:16.809849 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbcfce-6bc9-4218-98e7-46e1759cfb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:16.810216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbcfce-6bc9-4218-98e7-46e1759cfb62 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:16.811002 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbcfce-6bc9-4218-98e7-46e1759cfb62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:16.815020 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbcfce-6bc9-4218-98e7-46e1759cfb62 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:16.883225 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 908/1814] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:16 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:16.883629 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704f248-9d12-44f9-a13e-2587f8600bb2 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:16.917982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704f248-9d12-44f9-a13e-2587f8600bb2 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:16.985635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:17.027235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbcfce-6bc9-4218-98e7-46e1759cfb62 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:17.029708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3afbcfce-6bc9-4218-98e7-46e1759cfb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:17.068398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2d3ec-95fe-4605-a298-c9245f7a1c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:17.069103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2d3ec-95fe-4605-a298-c9245f7a1c10 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:17.069434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2d3ec-95fe-4605-a298-c9245f7a1c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:17.070137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2d3ec-95fe-4605-a298-c9245f7a1c10 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:17.070884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2d3ec-95fe-4605-a298-c9245f7a1c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:17.075661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2d3ec-95fe-4605-a298-c9245f7a1c10 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:17.120733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 907/1815] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:16 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:17.125520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2d3ec-95fe-4605-a298-c9245f7a1c10 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:17.127044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:17.140102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-59f2d3ec-95fe-4605-a298-c9245f7a1c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:17.159666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2d3ec-95fe-4605-a298-c9245f7a1c10 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:17.165598 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:17.166584 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:17.166897 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:17.167155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] PATH_INFO: `/v3/projects/929fc565ae7341a2bd184fa21db38f55` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:17.168372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] RBAC: Authorizing `identity:delete_project(project_id=929fc565ae7341a2bd184fa21db38f55)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:17.169093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbcfce-6bc9-4218-98e7-46e1759cfb62 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:17.170865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:17.179619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99034be5-25e6-45f0-89a5-fd94fee86881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:17.180924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99034be5-25e6-45f0-89a5-fd94fee86881 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:17.181400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99034be5-25e6-45f0-89a5-fd94fee86881 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:17.182248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99034be5-25e6-45f0-89a5-fd94fee86881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:17.184445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-99034be5-25e6-45f0-89a5-fd94fee86881 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:17.233366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929fc565ae7341a2bd184fa21db38f55', 'request_id': 'req-37072553-51a3-4cd9-ad3d-86538597214a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:17.245847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929fc565ae7341a2bd184fa21db38f55', 'request_id': 'req-37072553-51a3-4cd9-ad3d-86538597214a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:17.254963 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929fc565ae7341a2bd184fa21db38f55', 'request_id': 'req-37072553-51a3-4cd9-ad3d-86538597214a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:17.282615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] The token cache is being invalidate because project 929fc565ae7341a2bd184fa21db38f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:17.282962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:17.284067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:17.290688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 908/1816] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:17 2022] DELETE /identity/v3/projects/929fc565ae7341a2bd184fa21db38f55 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:17.292844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:17.293738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99034be5-25e6-45f0-89a5-fd94fee86881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:17.294987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:17.296217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99034be5-25e6-45f0-89a5-fd94fee86881 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:17.311354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 909/1817] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:17.313102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99034be5-25e6-45f0-89a5-fd94fee86881 service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:17.353746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99034be5-25e6-45f0-89a5-fd94fee86881 service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:17.493138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:17.493910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:17.494188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:17.494307 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37072553-51a3-4cd9-ad3d-86538597214a admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:17.494471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] PATH_INFO: `/v3/users/81b6a89e689f43548be975dc8b835818` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:17.496996 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81b6a89e689f43548be975dc8b835818)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:17.499999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:17.501687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172388d4-4bd2-48df-9f16-6fba924250aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:17.502662 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172388d4-4bd2-48df-9f16-6fba924250aa admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:17.503189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172388d4-4bd2-48df-9f16-6fba924250aa admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:17.503492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172388d4-4bd2-48df-9f16-6fba924250aa admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:17.504047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172388d4-4bd2-48df-9f16-6fba924250aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:17.514435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172388d4-4bd2-48df-9f16-6fba924250aa admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:17.536432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 909/1818] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:17.539754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172388d4-4bd2-48df-9f16-6fba924250aa admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:17.543675 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-172388d4-4bd2-48df-9f16-6fba924250aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:17.608166 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81b6a89e689f43548be975dc8b835818'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:17.609269 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81b6a89e689f43548be975dc8b835818'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:17.619430 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:17.619898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81b6a89e689f43548be975dc8b835818'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:17.621197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81b6a89e689f43548be975dc8b835818'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:17.659916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81b6a89e689f43548be975dc8b835818'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:17.703108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 910/1819] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:17 2022] DELETE /identity/v3/users/81b6a89e689f43548be975dc8b835818 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:17.705226 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:17.707569 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:17.708114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172388d4-4bd2-48df-9f16-6fba924250aa admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:17.726589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:17.844228 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3d0aa-6035-42ff-ab73-15aceb714036 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:17.849443 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6409f-25f6-45aa-ba3a-7e45a5e7e611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:17.850123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6409f-25f6-45aa-ba3a-7e45a5e7e611 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:17.850651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6409f-25f6-45aa-ba3a-7e45a5e7e611 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:17.850944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6409f-25f6-45aa-ba3a-7e45a5e7e611 admin admin] PATH_INFO: `/v3/projects/08921671073042c281cb446c9a151c31/users/238f751f783b406588bf5e3ff96e4070/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:17.864051 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1308c9c-8224-4183-8bf1-606fed2dec5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:17.864602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1308c9c-8224-4183-8bf1-606fed2dec5d service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:17.864884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1308c9c-8224-4183-8bf1-606fed2dec5d service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:17.865140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1308c9c-8224-4183-8bf1-606fed2dec5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:17.875949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d1308c9c-8224-4183-8bf1-606fed2dec5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:17.876673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6409f-25f6-45aa-ba3a-7e45a5e7e611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08921671073042c281cb446c9a151c31, user_id=238f751f783b406588bf5e3ff96e4070, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:17.880775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6409f-25f6-45aa-ba3a-7e45a5e7e611 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:17.912882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 911/1820] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:17 2022] PUT /identity/v3/projects/08921671073042c281cb446c9a151c31/users/238f751f783b406588bf5e3ff96e4070/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:17.915742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6409f-25f6-45aa-ba3a-7e45a5e7e611 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:17.924088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1308c9c-8224-4183-8bf1-606fed2dec5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:17.926816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1308c9c-8224-4183-8bf1-606fed2dec5d service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:17.958830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 910/1821] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:18.176728 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6409f-25f6-45aa-ba3a-7e45a5e7e611 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:18.194431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c4df4-0b2e-4ff2-8bb1-fe3fcb9c58c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:18.194431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c4df4-0b2e-4ff2-8bb1-fe3fcb9c58c8 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:18.194431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c4df4-0b2e-4ff2-8bb1-fe3fcb9c58c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:18.194431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c4df4-0b2e-4ff2-8bb1-fe3fcb9c58c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:18.195047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c4df4-0b2e-4ff2-8bb1-fe3fcb9c58c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:18.195141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c4df4-0b2e-4ff2-8bb1-fe3fcb9c58c8 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:18.226944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 912/1822] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:18.230743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1308c9c-8224-4183-8bf1-606fed2dec5d service nova] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:18.264582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1308c9c-8224-4183-8bf1-606fed2dec5d service nova] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:18.298567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8233a0d-81f8-4a43-99b3-14fda1793f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:18.298567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8233a0d-81f8-4a43-99b3-14fda1793f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:18.298567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8233a0d-81f8-4a43-99b3-14fda1793f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:18.298962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8233a0d-81f8-4a43-99b3-14fda1793f6c admin admin] PATH_INFO: `/v3/projects/08921671073042c281cb446c9a151c31/users/238f751f783b406588bf5e3ff96e4070/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:18.302167 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8233a0d-81f8-4a43-99b3-14fda1793f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08921671073042c281cb446c9a151c31, user_id=238f751f783b406588bf5e3ff96e4070, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:18.304858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8233a0d-81f8-4a43-99b3-14fda1793f6c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:18.343762 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 911/1823] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:18 2022] PUT /identity/v3/projects/08921671073042c281cb446c9a151c31/users/238f751f783b406588bf5e3ff96e4070/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:18.346018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ca0ef-8d2b-4443-9c2d-16a6c9df573d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:18.346991 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ca0ef-8d2b-4443-9c2d-16a6c9df573d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:18.347380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ca0ef-8d2b-4443-9c2d-16a6c9df573d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:18.431253 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b35ca0ef-8d2b-4443-9c2d-16a6c9df573d None None] MFA Rules not processed for user `238f751f783b406588bf5e3ff96e4070`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:18.438140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b35ca0ef-8d2b-4443-9c2d-16a6c9df573d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:18.572945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 913/1824] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:18.590382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8233a0d-81f8-4a43-99b3-14fda1793f6c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:18.595757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d8233a0d-81f8-4a43-99b3-14fda1793f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:18.655347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ca0ef-8d2b-4443-9c2d-16a6c9df573d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:18.656678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b35ca0ef-8d2b-4443-9c2d-16a6c9df573d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:18.675275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:18.703957 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8233a0d-81f8-4a43-99b3-14fda1793f6c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:18.713189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a499e-36db-42e3-b392-9b805a5cef70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:18.714689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a499e-36db-42e3-b392-9b805a5cef70 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:18.715168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a499e-36db-42e3-b392-9b805a5cef70 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:18.715679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a499e-36db-42e3-b392-9b805a5cef70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:18.729811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a499e-36db-42e3-b392-9b805a5cef70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:18.731861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a499e-36db-42e3-b392-9b805a5cef70 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:18.763885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 912/1825] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:18.785526 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ca0ef-8d2b-4443-9c2d-16a6c9df573d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:18.791993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:18.792671 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:18.796469 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:18.796836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87 admin admin] PATH_INFO: `/v3/projects/b0295aeb1b314e63a960602391570cb1` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:18.798101 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0295aeb1b314e63a960602391570cb1)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:18.800092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:18.870814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0295aeb1b314e63a960602391570cb1', 'request_id': 'req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:18.877952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0295aeb1b314e63a960602391570cb1', 'request_id': 'req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:18.889209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0295aeb1b314e63a960602391570cb1', 'request_id': 'req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:18.905796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87 admin admin] The token cache is being invalidate because project b0295aeb1b314e63a960602391570cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:18.906095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:18.906852 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fcc47a29-0f0f-4e9c-85a0-c094e3568d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:18.914362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 914/1826] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:18 2022] DELETE /identity/v3/projects/b0295aeb1b314e63a960602391570cb1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:18.916054 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847b0de-20c8-408b-ac3a-9af368049e10 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:18.916919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847b0de-20c8-408b-ac3a-9af368049e10 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:18.917384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847b0de-20c8-408b-ac3a-9af368049e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:18.941683 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-0847b0de-20c8-408b-ac3a-9af368049e10 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:18.943325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0847b0de-20c8-408b-ac3a-9af368049e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:19.044756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:19.081287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 913/1827] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:19.084011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab369-1540-44fc-960b-094a81c1fe7d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:19.084250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab369-1540-44fc-960b-094a81c1fe7d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:19.084919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab369-1540-44fc-960b-094a81c1fe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:19.124144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-890ab369-1540-44fc-960b-094a81c1fe7d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:19.127725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-890ab369-1540-44fc-960b-094a81c1fe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:19.142492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 915/1828] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:19.151087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847b0de-20c8-408b-ac3a-9af368049e10 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:19.164839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847b0de-20c8-408b-ac3a-9af368049e10 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:19.176756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7d369-35ec-4653-b20d-6cf2c9c726b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:19.177382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7d369-35ec-4653-b20d-6cf2c9c726b2 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:19.177713 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7d369-35ec-4653-b20d-6cf2c9c726b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:19.177991 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7d369-35ec-4653-b20d-6cf2c9c726b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:19.178686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7d369-35ec-4653-b20d-6cf2c9c726b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:19.178989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7d369-35ec-4653-b20d-6cf2c9c726b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:19.180595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7d369-35ec-4653-b20d-6cf2c9c726b2 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:19.213838 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 914/1829] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:19.217824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ab369-1540-44fc-960b-094a81c1fe7d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:19.249995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ab369-1540-44fc-960b-094a81c1fe7d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:19.264799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6436e3-8bc4-4cb4-869f-1bbb761f405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:19.265448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6436e3-8bc4-4cb4-869f-1bbb761f405a admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:19.265744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6436e3-8bc4-4cb4-869f-1bbb761f405a admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:19.266008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6436e3-8bc4-4cb4-869f-1bbb761f405a admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:19.270480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6436e3-8bc4-4cb4-869f-1bbb761f405a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:19.275916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6436e3-8bc4-4cb4-869f-1bbb761f405a admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:19.366146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7d369-35ec-4653-b20d-6cf2c9c726b2 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:19.366387 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 916/1830] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:19 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:19.380443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7d369-35ec-4653-b20d-6cf2c9c726b2 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:19.548973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f2338-0778-46b8-92be-919a5cb4af93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:19.550304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f2338-0778-46b8-92be-919a5cb4af93 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:19.550746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f2338-0778-46b8-92be-919a5cb4af93 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:19.552067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f2338-0778-46b8-92be-919a5cb4af93 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:19.553693 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f2338-0778-46b8-92be-919a5cb4af93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:19.560732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f2338-0778-46b8-92be-919a5cb4af93 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:19.618794 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 915/1831] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:19 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:19.618909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6436e3-8bc4-4cb4-869f-1bbb761f405a admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:19.628879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6436e3-8bc4-4cb4-869f-1bbb761f405a admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:19.634052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bbc72-65e6-4285-a8ef-2723c13aba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:19.634916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bbc72-65e6-4285-a8ef-2723c13aba71 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:19.635197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bbc72-65e6-4285-a8ef-2723c13aba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:19.635774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bbc72-65e6-4285-a8ef-2723c13aba71 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:19.636316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bbc72-65e6-4285-a8ef-2723c13aba71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:19.638175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bbc72-65e6-4285-a8ef-2723c13aba71 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:19.650315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 917/1832] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:19.654903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f2338-0778-46b8-92be-919a5cb4af93 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:19.671617 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f2338-0778-46b8-92be-919a5cb4af93 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:19.678525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273c185-8a15-479f-9628-66640b5c9c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:19.679211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c185-8a15-479f-9628-66640b5c9c0a admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:19.679517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c185-8a15-479f-9628-66640b5c9c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:19.679755 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c185-8a15-479f-9628-66640b5c9c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:19.680402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273c185-8a15-479f-9628-66640b5c9c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:19.682672 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273c185-8a15-479f-9628-66640b5c9c0a admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:19.711736 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 916/1833] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:19.712952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bbc72-65e6-4285-a8ef-2723c13aba71 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:19.728198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bbc72-65e6-4285-a8ef-2723c13aba71 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:19.747503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd35e8-06ec-433e-8bcd-bcd7aef38f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:19.748695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd35e8-06ec-433e-8bcd-bcd7aef38f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:19.749253 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd35e8-06ec-433e-8bcd-bcd7aef38f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:19.749667 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd35e8-06ec-433e-8bcd-bcd7aef38f3b admin admin] PATH_INFO: `/v3/projects/dfd167d29b374730b064c3de5ab833bd/users/d7fb22232cc74249acbfb5421fb1924b/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:19.772434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd35e8-06ec-433e-8bcd-bcd7aef38f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd167d29b374730b064c3de5ab833bd, user_id=d7fb22232cc74249acbfb5421fb1924b, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:19.782694 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd35e8-06ec-433e-8bcd-bcd7aef38f3b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:19.815297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 918/1834] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:19 2022] PUT /identity/v3/projects/dfd167d29b374730b064c3de5ab833bd/users/d7fb22232cc74249acbfb5421fb1924b/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:19.825383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e640f-9488-49a2-9819-d8e6eb1cf186 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:19.825875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e640f-9488-49a2-9819-d8e6eb1cf186 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:19.825983 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e640f-9488-49a2-9819-d8e6eb1cf186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:19.881546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-482e640f-9488-49a2-9819-d8e6eb1cf186 None None] MFA Rules not processed for user `d7fb22232cc74249acbfb5421fb1924b`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:19.882941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-482e640f-9488-49a2-9819-d8e6eb1cf186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:19.962128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 917/1835] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:19.963212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd35e8-06ec-433e-8bcd-bcd7aef38f3b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:19.971375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e640f-9488-49a2-9819-d8e6eb1cf186 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:19.972755 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-482e640f-9488-49a2-9819-d8e6eb1cf186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:20.010322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:20.036429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:20.043762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd35e8-06ec-433e-8bcd-bcd7aef38f3b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:20.048944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acc82b-009e-424f-af67-157449dba5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:20.049825 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acc82b-009e-424f-af67-157449dba5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:20.050240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acc82b-009e-424f-af67-157449dba5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:20.050673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acc82b-009e-424f-af67-157449dba5f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:20.051629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acc82b-009e-424f-af67-157449dba5f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:20.054712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acc82b-009e-424f-af67-157449dba5f0 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:20.055320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e640f-9488-49a2-9819-d8e6eb1cf186 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:20.060218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad5bf1-1348-4e61-a7e1-9a877292c45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:20.060875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad5bf1-1348-4e61-a7e1-9a877292c45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:20.061151 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad5bf1-1348-4e61-a7e1-9a877292c45b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:20.061419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad5bf1-1348-4e61-a7e1-9a877292c45b admin admin] PATH_INFO: `/v3/users/e830e96bbe774e4a9345928843bbc9f6` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:20.062590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad5bf1-1348-4e61-a7e1-9a877292c45b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e830e96bbe774e4a9345928843bbc9f6)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:20.064482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad5bf1-1348-4e61-a7e1-9a877292c45b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:20.090019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 919/1836] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:19 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:35:20.095324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acc82b-009e-424f-af67-157449dba5f0 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:20.116088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e5ad5bf1-1348-4e61-a7e1-9a877292c45b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e830e96bbe774e4a9345928843bbc9f6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:20.117002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e5ad5bf1-1348-4e61-a7e1-9a877292c45b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e830e96bbe774e4a9345928843bbc9f6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:20.125713 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e5ad5bf1-1348-4e61-a7e1-9a877292c45b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e830e96bbe774e4a9345928843bbc9f6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:20.137639 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e5ad5bf1-1348-4e61-a7e1-9a877292c45b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e830e96bbe774e4a9345928843bbc9f6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:20.138994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e5ad5bf1-1348-4e61-a7e1-9a877292c45b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e830e96bbe774e4a9345928843bbc9f6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:20.160701 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 918/1837] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:19 2022] DELETE /identity/v3/users/e830e96bbe774e4a9345928843bbc9f6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:20.164960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12423a-778f-4f3f-8dfc-4669e3452cb4 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:20.165247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12423a-778f-4f3f-8dfc-4669e3452cb4 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:20.165566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12423a-778f-4f3f-8dfc-4669e3452cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:20.172814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acc82b-009e-424f-af67-157449dba5f0 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:20.185795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-2a12423a-778f-4f3f-8dfc-4669e3452cb4 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:20.187072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-2a12423a-778f-4f3f-8dfc-4669e3452cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:20.240147 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21784d-019c-42d4-aef4-15a3a6d41df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:20.240924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21784d-019c-42d4-aef4-15a3a6d41df7 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:20.241677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21784d-019c-42d4-aef4-15a3a6d41df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:20.242062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21784d-019c-42d4-aef4-15a3a6d41df7 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:20.243309 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21784d-019c-42d4-aef4-15a3a6d41df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:20.245750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21784d-019c-42d4-aef4-15a3a6d41df7 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:20.260451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 919/1838] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:20.269527 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 920/1839] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:20 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:20.271173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12423a-778f-4f3f-8dfc-4669e3452cb4 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:20.272601 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-2a12423a-778f-4f3f-8dfc-4669e3452cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:20.273370 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21784d-019c-42d4-aef4-15a3a6d41df7 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:20.275092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3b21784d-019c-42d4-aef4-15a3a6d41df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:20.288677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21784d-019c-42d4-aef4-15a3a6d41df7 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:20.293401 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d738e8-2de9-46ac-b79b-6de3bff2d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:20.294035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d738e8-2de9-46ac-b79b-6de3bff2d741 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:20.294319 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d738e8-2de9-46ac-b79b-6de3bff2d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:20.294623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d738e8-2de9-46ac-b79b-6de3bff2d741 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:20.295264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d738e8-2de9-46ac-b79b-6de3bff2d741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:20.296869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d738e8-2de9-46ac-b79b-6de3bff2d741 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:20.307732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 921/1840] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:20.311592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d738e8-2de9-46ac-b79b-6de3bff2d741 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:20.321846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d738e8-2de9-46ac-b79b-6de3bff2d741 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:20.327116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b5def-8e2f-4810-8b3f-29e292642b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:20.327698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b5def-8e2f-4810-8b3f-29e292642b3c admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:20.327977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b5def-8e2f-4810-8b3f-29e292642b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:20.328254 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b5def-8e2f-4810-8b3f-29e292642b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:20.328875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b5def-8e2f-4810-8b3f-29e292642b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:20.330454 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b5def-8e2f-4810-8b3f-29e292642b3c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:20.333461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12423a-778f-4f3f-8dfc-4669e3452cb4 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:20.337504 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57591ab8-7194-41f7-94e9-10dd6d4db36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:20.338109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57591ab8-7194-41f7-94e9-10dd6d4db36e service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:20.338384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57591ab8-7194-41f7-94e9-10dd6d4db36e service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:20.338689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57591ab8-7194-41f7-94e9-10dd6d4db36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:20.340962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 922/1841] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:20.345580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b5def-8e2f-4810-8b3f-29e292642b3c admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:20.348896 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57591ab8-7194-41f7-94e9-10dd6d4db36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:20.350379 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57591ab8-7194-41f7-94e9-10dd6d4db36e service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:20.354865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b5def-8e2f-4810-8b3f-29e292642b3c admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:20.359878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f56b4-76fa-475f-848d-a70d9a6ecaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:20.360340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 920/1842] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:35:20.360548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f56b4-76fa-475f-848d-a70d9a6ecaf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:20.360824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f56b4-76fa-475f-848d-a70d9a6ecaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:20.361094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f56b4-76fa-475f-848d-a70d9a6ecaf8 admin admin] PATH_INFO: `/v3/projects/3e7f84e9d8724da7aae99b3098ba0124/users/1434fb8d7de249e1b63ebf340f3e938b/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:20.381799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f56b4-76fa-475f-848d-a70d9a6ecaf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7f84e9d8724da7aae99b3098ba0124, user_id=1434fb8d7de249e1b63ebf340f3e938b, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:20.384536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f56b4-76fa-475f-848d-a70d9a6ecaf8 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:20.397862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 923/1843] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:20 2022] PUT /identity/v3/projects/3e7f84e9d8724da7aae99b3098ba0124/users/1434fb8d7de249e1b63ebf340f3e938b/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:20.410029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3031ec-8fdc-43fe-910c-445a313a2f1d None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:20.410371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3031ec-8fdc-43fe-910c-445a313a2f1d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:20.410690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3031ec-8fdc-43fe-910c-445a313a2f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:20.431043 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:20.441747 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-ba3031ec-8fdc-43fe-910c-445a313a2f1d None None] MFA Rules not processed for user `1434fb8d7de249e1b63ebf340f3e938b`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:20.443240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ba3031ec-8fdc-43fe-910c-445a313a2f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:20.530808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 921/1844] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:20.531828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f56b4-76fa-475f-848d-a70d9a6ecaf8 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:20.548033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:20.617139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f56b4-76fa-475f-848d-a70d9a6ecaf8 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:20.622082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402df361-8174-41ac-a43d-0fc79063d03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:20.623273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402df361-8174-41ac-a43d-0fc79063d03b admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:20.623548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402df361-8174-41ac-a43d-0fc79063d03b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:20.624128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402df361-8174-41ac-a43d-0fc79063d03b admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:20.624780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402df361-8174-41ac-a43d-0fc79063d03b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:20.626802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402df361-8174-41ac-a43d-0fc79063d03b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:20.679954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3031ec-8fdc-43fe-910c-445a313a2f1d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:20.681332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 924/1845] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:20 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:20.694323 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3031ec-8fdc-43fe-910c-445a313a2f1d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:20.759242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402df361-8174-41ac-a43d-0fc79063d03b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:20.761541 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-402df361-8174-41ac-a43d-0fc79063d03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:20.768359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a830f3-db6f-4d9c-acaa-2fb74fe48cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:20.770299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a830f3-db6f-4d9c-acaa-2fb74fe48cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:20.772124 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a830f3-db6f-4d9c-acaa-2fb74fe48cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:20.772412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a830f3-db6f-4d9c-acaa-2fb74fe48cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:20.773071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a830f3-db6f-4d9c-acaa-2fb74fe48cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:20.775047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a830f3-db6f-4d9c-acaa-2fb74fe48cd3 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:20.777129 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402df361-8174-41ac-a43d-0fc79063d03b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:20.800163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:20.800163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:20.800163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:20.800163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] PATH_INFO: `/v3/projects/f3c0e289f95f46b08128d864ee1a64a5` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:20.801589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c0e289f95f46b08128d864ee1a64a5)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:20.812438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:20.835621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 922/1846] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:20 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:20.842058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a830f3-db6f-4d9c-acaa-2fb74fe48cd3 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:20.855211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a830f3-db6f-4d9c-acaa-2fb74fe48cd3 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:20.863887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6816b75-c688-49bd-a335-c2e9e4f380ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:20.864590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6816b75-c688-49bd-a335-c2e9e4f380ae admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:20.864867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6816b75-c688-49bd-a335-c2e9e4f380ae admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:20.865140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6816b75-c688-49bd-a335-c2e9e4f380ae admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:20.865818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6816b75-c688-49bd-a335-c2e9e4f380ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:20.867497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6816b75-c688-49bd-a335-c2e9e4f380ae admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:20.881516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 923/1847] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:20.895790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6816b75-c688-49bd-a335-c2e9e4f380ae admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:20.920312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6816b75-c688-49bd-a335-c2e9e4f380ae admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:20.922823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c0e289f95f46b08128d864ee1a64a5', 'request_id': 'req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:20.934024 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c0e289f95f46b08128d864ee1a64a5', 'request_id': 'req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:20.974615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c0e289f95f46b08128d864ee1a64a5', 'request_id': 'req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:21.012587 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] The token cache is being invalidate because project f3c0e289f95f46b08128d864ee1a64a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:21.013064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:21.016946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:21.021155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 925/1848] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:20 2022] DELETE /identity/v3/projects/f3c0e289f95f46b08128d864ee1a64a5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:21.028397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:21.034871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:21.041220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7323dd-bd50-428d-943c-5373d86d201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:21.047039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7323dd-bd50-428d-943c-5373d86d201e admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:21.048211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7323dd-bd50-428d-943c-5373d86d201e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:21.048760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7323dd-bd50-428d-943c-5373d86d201e admin admin] PATH_INFO: `/v3/projects/10c280f1aa384350b28364ee58f83833/users/e43396ad439641f280b44e500c00a665/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:21.058558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6e47a-857c-4de1-bfbd-13eaa3e4ef30 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:21.070871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:21.071659 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:21.073246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:21.073664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] PATH_INFO: `/v3/users/238f751f783b406588bf5e3ff96e4070` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:21.078077 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=238f751f783b406588bf5e3ff96e4070)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:21.084489 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:21.094054 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7323dd-bd50-428d-943c-5373d86d201e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c280f1aa384350b28364ee58f83833, user_id=e43396ad439641f280b44e500c00a665, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:21.095784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7323dd-bd50-428d-943c-5373d86d201e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:21.113579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:21.125158 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 924/1849] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:20 2022] PUT /identity/v3/projects/10c280f1aa384350b28364ee58f83833/users/e43396ad439641f280b44e500c00a665/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:21.129357 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7323dd-bd50-428d-943c-5373d86d201e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:21.131316 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ad7323dd-bd50-428d-943c-5373d86d201e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:21.207682 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238f751f783b406588bf5e3ff96e4070'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:21.208391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238f751f783b406588bf5e3ff96e4070'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:21.228925 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238f751f783b406588bf5e3ff96e4070'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:21.230091 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238f751f783b406588bf5e3ff96e4070'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:21.259336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238f751f783b406588bf5e3ff96e4070'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:21.265563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:21.272591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7323dd-bd50-428d-943c-5373d86d201e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:21.280872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 926/1850] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:21 2022] DELETE /identity/v3/users/238f751f783b406588bf5e3ff96e4070 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:21.284942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd2285-e64a-48fe-b20f-224365b89841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:21.285654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd2285-e64a-48fe-b20f-224365b89841 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:21.285998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd2285-e64a-48fe-b20f-224365b89841 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:21.286361 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd2285-e64a-48fe-b20f-224365b89841 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:21.287107 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd2285-e64a-48fe-b20f-224365b89841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:21.288780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd2285-e64a-48fe-b20f-224365b89841 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:21.303215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 925/1851] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:21.307289 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:21.309392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:21.383991 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4c284-12cc-4865-a301-6a8e12b40e1b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:21.389176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aee32b-6759-4739-8f24-80cfac9cf3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:21.389966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aee32b-6759-4739-8f24-80cfac9cf3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:21.390318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aee32b-6759-4739-8f24-80cfac9cf3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:21.390696 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aee32b-6759-4739-8f24-80cfac9cf3f7 admin admin] PATH_INFO: `/v3/projects/10c280f1aa384350b28364ee58f83833/users/e43396ad439641f280b44e500c00a665/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:21.392600 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aee32b-6759-4739-8f24-80cfac9cf3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c280f1aa384350b28364ee58f83833, user_id=e43396ad439641f280b44e500c00a665, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:21.395493 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aee32b-6759-4739-8f24-80cfac9cf3f7 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:21.407296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 927/1852] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:21 2022] PUT /identity/v3/projects/10c280f1aa384350b28364ee58f83833/users/e43396ad439641f280b44e500c00a665/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:21.417934 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416053f-7e9a-4441-8078-bf086874c102 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:21.418302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416053f-7e9a-4441-8078-bf086874c102 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:21.418501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416053f-7e9a-4441-8078-bf086874c102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:21.460102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-7416053f-7e9a-4441-8078-bf086874c102 None None] MFA Rules not processed for user `e43396ad439641f280b44e500c00a665`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:21.461578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7416053f-7e9a-4441-8078-bf086874c102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:21.563301 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 926/1853] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:21.576737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aee32b-6759-4739-8f24-80cfac9cf3f7 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:21.582960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-52aee32b-6759-4739-8f24-80cfac9cf3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:21.665911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aee32b-6759-4739-8f24-80cfac9cf3f7 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:21.679232 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276962a-8b60-4dce-9308-a0d68689c736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:21.680480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276962a-8b60-4dce-9308-a0d68689c736 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:21.680988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276962a-8b60-4dce-9308-a0d68689c736 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:21.681511 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276962a-8b60-4dce-9308-a0d68689c736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:21.699471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276962a-8b60-4dce-9308-a0d68689c736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:21.701632 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276962a-8b60-4dce-9308-a0d68689c736 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:21.722229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 928/1854] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:21.822128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416053f-7e9a-4441-8078-bf086874c102 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:21.824348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7416053f-7e9a-4441-8078-bf086874c102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:21.849793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416053f-7e9a-4441-8078-bf086874c102 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:21.855690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae86248-d745-453c-be4e-3361c0572efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:21.857412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae86248-d745-453c-be4e-3361c0572efe service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:21.857697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae86248-d745-453c-be4e-3361c0572efe service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:21.857975 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae86248-d745-453c-be4e-3361c0572efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:21.865418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0ae86248-d745-453c-be4e-3361c0572efe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:21.943184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae86248-d745-453c-be4e-3361c0572efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:21.945459 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae86248-d745-453c-be4e-3361c0572efe service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:21.974836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 927/1855] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:22.062537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276962a-8b60-4dce-9308-a0d68689c736 service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:22.064494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5276962a-8b60-4dce-9308-a0d68689c736 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:22.111180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae86248-d745-453c-be4e-3361c0572efe service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:22.113321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0ae86248-d745-453c-be4e-3361c0572efe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:22.185340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:22.272376 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276962a-8b60-4dce-9308-a0d68689c736 service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:22.284509 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff5b1e-c3ee-41dc-849d-fdb0f475f52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:22.285179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff5b1e-c3ee-41dc-849d-fdb0f475f52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:22.285457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff5b1e-c3ee-41dc-849d-fdb0f475f52d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:22.285727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff5b1e-c3ee-41dc-849d-fdb0f475f52d admin admin] PATH_INFO: `/v3/users/b58481e2a11d4db0923a89973893f354` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:22.295049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff5b1e-c3ee-41dc-849d-fdb0f475f52d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58481e2a11d4db0923a89973893f354)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:22.295482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff5b1e-c3ee-41dc-849d-fdb0f475f52d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:22.411450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae86248-d745-453c-be4e-3361c0572efe service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:22.430697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:22.432016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:22.432340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:22.432618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a admin admin] PATH_INFO: `/v3/projects/08921671073042c281cb446c9a151c31` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:22.440709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=08921671073042c281cb446c9a151c31)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:22.446081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:22.455169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:22.499136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-23ff5b1e-c3ee-41dc-849d-fdb0f475f52d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58481e2a11d4db0923a89973893f354'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:22.500634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-23ff5b1e-c3ee-41dc-849d-fdb0f475f52d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58481e2a11d4db0923a89973893f354'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:22.517707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-23ff5b1e-c3ee-41dc-849d-fdb0f475f52d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58481e2a11d4db0923a89973893f354'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:22.518661 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-23ff5b1e-c3ee-41dc-849d-fdb0f475f52d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58481e2a11d4db0923a89973893f354'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:22.545339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08921671073042c281cb446c9a151c31', 'request_id': 'req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:22.562978 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08921671073042c281cb446c9a151c31', 'request_id': 'req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:22.573168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-23ff5b1e-c3ee-41dc-849d-fdb0f475f52d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58481e2a11d4db0923a89973893f354'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:22.593083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08921671073042c281cb446c9a151c31', 'request_id': 'req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:22.614622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 929/1856] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:22 2022] DELETE /identity/v3/users/b58481e2a11d4db0923a89973893f354 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:22.618940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f78b-4596-489e-ba13-4a4a090756b0 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:22.619483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f78b-4596-489e-ba13-4a4a090756b0 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:22.620003 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f78b-4596-489e-ba13-4a4a090756b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:22.624213 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a admin admin] The token cache is being invalidate because project 08921671073042c281cb446c9a151c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:22.624507 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:22.627681 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2c93fff4-23eb-4b64-9c5e-d23e83a0e51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:22.634296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 928/1857] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:22 2022] DELETE /identity/v3/projects/08921671073042c281cb446c9a151c31 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:22.639343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b2f2-5a05-42d1-a7bd-b5d7c6b4b4eb None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:22.639676 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b2f2-5a05-42d1-a7bd-b5d7c6b4b4eb None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:22.639879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b2f2-5a05-42d1-a7bd-b5d7c6b4b4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:22.652601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-d140f78b-4596-489e-ba13-4a4a090756b0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:22.656389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d140f78b-4596-489e-ba13-4a4a090756b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:22.711644 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-5c78b2f2-5a05-42d1-a7bd-b5d7c6b4b4eb None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:22.712882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5c78b2f2-5a05-42d1-a7bd-b5d7c6b4b4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:22.850140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 930/1858] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:22.851249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140f78b-4596-489e-ba13-4a4a090756b0 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:22.854111 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d140f78b-4596-489e-ba13-4a4a090756b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:22.868075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140f78b-4596-489e-ba13-4a4a090756b0 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:22.873875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:22.874784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:22.875139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:22.875483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] PATH_INFO: `/v3/users/e3a1d3f2145d4a82b94e8daae71f3db3` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:22.877658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a1d3f2145d4a82b94e8daae71f3db3)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:22.878969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:22.894109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 929/1859] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:22.896567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f96923-532b-462e-9e4d-8cba0f20f248 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:22.896854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f96923-532b-462e-9e4d-8cba0f20f248 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:22.897121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f96923-532b-462e-9e4d-8cba0f20f248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:22.927014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-23f96923-532b-462e-9e4d-8cba0f20f248 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:22.928477 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-23f96923-532b-462e-9e4d-8cba0f20f248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:22.937761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 930/1860] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:22.941938 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f96923-532b-462e-9e4d-8cba0f20f248 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:22.953438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f96923-532b-462e-9e4d-8cba0f20f248 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:22.959357 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c4aee-6c9d-41fb-924f-46f21c8e7c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:22.960028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4aee-6c9d-41fb-924f-46f21c8e7c88 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:22.960829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4aee-6c9d-41fb-924f-46f21c8e7c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:22.960829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4aee-6c9d-41fb-924f-46f21c8e7c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:22.961239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c4aee-6c9d-41fb-924f-46f21c8e7c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:22.961541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c4aee-6c9d-41fb-924f-46f21c8e7c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:22.963371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c4aee-6c9d-41fb-924f-46f21c8e7c88 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:22.975728 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a1d3f2145d4a82b94e8daae71f3db3'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:22.977507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a1d3f2145d4a82b94e8daae71f3db3'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:22.981601 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 931/1861] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:35:22.982556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c4aee-6c9d-41fb-924f-46f21c8e7c88 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:22.984396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-269c4aee-6c9d-41fb-924f-46f21c8e7c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:22.988700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a1d3f2145d4a82b94e8daae71f3db3'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:22.989655 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a1d3f2145d4a82b94e8daae71f3db3'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:23.017992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a1d3f2145d4a82b94e8daae71f3db3'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:23.035924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 931/1862] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:22 2022] DELETE /identity/v3/users/e3a1d3f2145d4a82b94e8daae71f3db3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:23.036623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:23.038245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:23.040359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:23.073106 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c4aee-6c9d-41fb-924f-46f21c8e7c88 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:23.081712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:23.158834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2f942-9eea-45c1-bd60-d35a2f756b57 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:23.161025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca7a09-97fb-428b-a640-6a285be7af6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:23.161883 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca7a09-97fb-428b-a640-6a285be7af6d service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:23.162337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca7a09-97fb-428b-a640-6a285be7af6d service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:23.162720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca7a09-97fb-428b-a640-6a285be7af6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:23.165606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44061c66-a23d-4180-a5ec-c7bef5ebb911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:23.166483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44061c66-a23d-4180-a5ec-c7bef5ebb911 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:23.166982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44061c66-a23d-4180-a5ec-c7bef5ebb911 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:23.167186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-92ca7a09-97fb-428b-a640-6a285be7af6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:23.167520 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44061c66-a23d-4180-a5ec-c7bef5ebb911 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:23.168223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44061c66-a23d-4180-a5ec-c7bef5ebb911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:23.170816 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44061c66-a23d-4180-a5ec-c7bef5ebb911 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:23.190470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca7a09-97fb-428b-a640-6a285be7af6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:23.192363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca7a09-97fb-428b-a640-6a285be7af6d service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:23.207549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 932/1863] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:23.209451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac261b-515c-4466-acd9-5335da914cd7 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:23.210080 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac261b-515c-4466-acd9-5335da914cd7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:23.210918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac261b-515c-4466-acd9-5335da914cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:23.214494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 932/1864] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:23 2022] POST /identity/v3/projects => generated 389 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:23.215788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44061c66-a23d-4180-a5ec-c7bef5ebb911 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:23.237654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-5dac261b-515c-4466-acd9-5335da914cd7 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:23.239022 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5dac261b-515c-4466-acd9-5335da914cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:23.339303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 933/1865] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:23.350959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac261b-515c-4466-acd9-5335da914cd7 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:23.352717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5dac261b-515c-4466-acd9-5335da914cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:23.369705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44061c66-a23d-4180-a5ec-c7bef5ebb911 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:23.386981 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ab754-2625-4376-835a-5460234b0c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:23.388140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ab754-2625-4376-835a-5460234b0c59 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:23.388432 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ab754-2625-4376-835a-5460234b0c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:23.388702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ab754-2625-4376-835a-5460234b0c59 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:23.389343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ab754-2625-4376-835a-5460234b0c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:23.391553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ab754-2625-4376-835a-5460234b0c59 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:23.466269 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 933/1866] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:23 2022] POST /identity/v3/users => generated 295 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:23.471811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ab754-2625-4376-835a-5460234b0c59 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:23.480130 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac261b-515c-4466-acd9-5335da914cd7 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:23.484186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf99976-3299-4b32-883b-93f79dae6ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:23.484990 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf99976-3299-4b32-883b-93f79dae6ffe service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:23.485276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf99976-3299-4b32-883b-93f79dae6ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:23.485754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf99976-3299-4b32-883b-93f79dae6ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:23.502203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf99976-3299-4b32-883b-93f79dae6ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:23.503853 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf99976-3299-4b32-883b-93f79dae6ffe service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:23.503967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ab754-2625-4376-835a-5460234b0c59 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:23.519350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24829913-582f-4632-b0ea-c20843803545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:23.520215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 934/1867] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:23.522871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24829913-582f-4632-b0ea-c20843803545 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:23.523452 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24829913-582f-4632-b0ea-c20843803545 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:23.523984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24829913-582f-4632-b0ea-c20843803545 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:23.524945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24829913-582f-4632-b0ea-c20843803545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:23.527846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24829913-582f-4632-b0ea-c20843803545 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:23.563192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf99976-3299-4b32-883b-93f79dae6ffe service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:23.574030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 934/1868] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:23.577449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf99976-3299-4b32-883b-93f79dae6ffe service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:23.585838 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c16da-ff1d-4bc8-ba42-a3021c2dc80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:23.586456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c16da-ff1d-4bc8-ba42-a3021c2dc80b admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:23.586765 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c16da-ff1d-4bc8-ba42-a3021c2dc80b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:23.587035 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c16da-ff1d-4bc8-ba42-a3021c2dc80b admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:23.588020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c16da-ff1d-4bc8-ba42-a3021c2dc80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:23.590360 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c16da-ff1d-4bc8-ba42-a3021c2dc80b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:23.605412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 935/1869] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:23.610841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24829913-582f-4632-b0ea-c20843803545 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:23.627275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24829913-582f-4632-b0ea-c20843803545 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:23.632823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487489d-84f2-4b26-ae5c-3358976bc2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:23.634213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487489d-84f2-4b26-ae5c-3358976bc2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:23.634551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487489d-84f2-4b26-ae5c-3358976bc2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:23.634895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487489d-84f2-4b26-ae5c-3358976bc2d0 admin admin] PATH_INFO: `/v3/projects/ac9d881aa89d4fe8b8fff7f9df048943/users/7f02574411bb459b87beb20fa87f0f04/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:23.662359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487489d-84f2-4b26-ae5c-3358976bc2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9d881aa89d4fe8b8fff7f9df048943, user_id=7f02574411bb459b87beb20fa87f0f04, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:23.667258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487489d-84f2-4b26-ae5c-3358976bc2d0 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:23.685420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 935/1870] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:23 2022] PUT /identity/v3/projects/ac9d881aa89d4fe8b8fff7f9df048943/users/7f02574411bb459b87beb20fa87f0f04/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:23.696013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7e273-c8f1-4363-87cb-789c92adc109 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:23.696351 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7e273-c8f1-4363-87cb-789c92adc109 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:23.696628 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7e273-c8f1-4363-87cb-789c92adc109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:23.731053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8bd7e273-c8f1-4363-87cb-789c92adc109 None None] MFA Rules not processed for user `7f02574411bb459b87beb20fa87f0f04`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:23.732392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8bd7e273-c8f1-4363-87cb-789c92adc109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:23.766256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:23.874744 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 936/1871] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:23.875956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487489d-84f2-4b26-ae5c-3358976bc2d0 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:23.925862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7e273-c8f1-4363-87cb-789c92adc109 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:23.927109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8bd7e273-c8f1-4363-87cb-789c92adc109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:24.008875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487489d-84f2-4b26-ae5c-3358976bc2d0 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:24.018049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c8a60-e307-4995-91c1-1a7f4db8b629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:24.019022 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c8a60-e307-4995-91c1-1a7f4db8b629 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:24.019452 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c8a60-e307-4995-91c1-1a7f4db8b629 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:24.019738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c8a60-e307-4995-91c1-1a7f4db8b629 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:24.021592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c8a60-e307-4995-91c1-1a7f4db8b629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:24.024312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c8a60-e307-4995-91c1-1a7f4db8b629 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:24.035876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:24.058264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7e273-c8f1-4363-87cb-789c92adc109 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:24.065363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:24.066786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:24.067152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:24.067483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] PATH_INFO: `/v3/projects/c1d270a31ee54fa8b3d132d82a2413da` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:24.069538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d270a31ee54fa8b3d132d82a2413da)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:24.073131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:24.086301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 936/1872] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:23 2022] POST /identity/v3/projects => generated 387 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:24.090256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c8a60-e307-4995-91c1-1a7f4db8b629 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:24.184584 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d270a31ee54fa8b3d132d82a2413da', 'request_id': 'req-f1bc6798-9887-40a5-89d8-3bf7189c7190'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.195699 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d270a31ee54fa8b3d132d82a2413da', 'request_id': 'req-f1bc6798-9887-40a5-89d8-3bf7189c7190'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.229870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d270a31ee54fa8b3d132d82a2413da', 'request_id': 'req-f1bc6798-9887-40a5-89d8-3bf7189c7190'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.237943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c8a60-e307-4995-91c1-1a7f4db8b629 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:24.294813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] The token cache is being invalidate because project c1d270a31ee54fa8b3d132d82a2413da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:24.295239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.302423 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.304133 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 937/1873] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:23 2022] DELETE /identity/v3/projects/c1d270a31ee54fa8b3d132d82a2413da => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:24.307665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:24.309227 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:24.322907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1ce8e-a313-46e5-8026-74d48f33279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:24.322907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1ce8e-a313-46e5-8026-74d48f33279f admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:24.323192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1ce8e-a313-46e5-8026-74d48f33279f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:24.323192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1ce8e-a313-46e5-8026-74d48f33279f admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:24.323838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1ce8e-a313-46e5-8026-74d48f33279f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:24.326160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1ce8e-a313-46e5-8026-74d48f33279f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:24.369738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 937/1874] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:24 2022] POST /identity/v3/users => generated 300 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:35:24.371418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1ce8e-a313-46e5-8026-74d48f33279f admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:24.382298 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-fde1ce8e-a313-46e5-8026-74d48f33279f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:24.395000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:24.405119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1ce8e-a313-46e5-8026-74d48f33279f admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:24.421465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:24.422236 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:24.422663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:24.423044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] PATH_INFO: `/v3/users/1c6a7dd210ec435480b1d3b47ad1697a` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:24.424328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6a7dd210ec435480b1d3b47ad1697a)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:24.426933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:24.437482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc6798-9887-40a5-89d8-3bf7189c7190 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:24.445026 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:24.446921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:24.447420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:24.448870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] PATH_INFO: `/v3/projects/e0cbaf96aa69409fa260a30ea6e0aa7d` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:24.450379 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0cbaf96aa69409fa260a30ea6e0aa7d)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:24.453994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:24.541444 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6a7dd210ec435480b1d3b47ad1697a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.542401 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6a7dd210ec435480b1d3b47ad1697a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.553986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6a7dd210ec435480b1d3b47ad1697a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.569602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0cbaf96aa69409fa260a30ea6e0aa7d', 'request_id': 'req-c9918fc3-ad13-4c19-b2c9-87197799465d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.573192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6a7dd210ec435480b1d3b47ad1697a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.591593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0cbaf96aa69409fa260a30ea6e0aa7d', 'request_id': 'req-c9918fc3-ad13-4c19-b2c9-87197799465d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.607242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0cbaf96aa69409fa260a30ea6e0aa7d', 'request_id': 'req-c9918fc3-ad13-4c19-b2c9-87197799465d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.634809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6a7dd210ec435480b1d3b47ad1697a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.639172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] The token cache is being invalidate because project e0cbaf96aa69409fa260a30ea6e0aa7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:24.641132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.643176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:24.649485 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 938/1875] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:24 2022] DELETE /identity/v3/projects/e0cbaf96aa69409fa260a30ea6e0aa7d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:24.649485 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:24.649767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:24.662533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:24.679485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 938/1876] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:24 2022] DELETE /identity/v3/users/1c6a7dd210ec435480b1d3b47ad1697a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:24.682611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:24.709375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:24.878365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9918fc3-ad13-4c19-b2c9-87197799465d admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:24.903891 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88633ab5-9537-492a-8dfa-413910834517 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:24.905754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737e900-1643-4a2f-821e-a67b9c84d01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:24.906632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737e900-1643-4a2f-821e-a67b9c84d01e admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:24.907677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737e900-1643-4a2f-821e-a67b9c84d01e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:24.908153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737e900-1643-4a2f-821e-a67b9c84d01e admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:24.909159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737e900-1643-4a2f-821e-a67b9c84d01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:24.911659 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737e900-1643-4a2f-821e-a67b9c84d01e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:24.923482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2467884-1b6e-4610-afba-f0674800c3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:24.924601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2467884-1b6e-4610-afba-f0674800c3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:24.925061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2467884-1b6e-4610-afba-f0674800c3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:24.925535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2467884-1b6e-4610-afba-f0674800c3ad admin admin] PATH_INFO: `/v3/users/a05f32e7bbc24d44a0586ff9cd24d9df` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:24.927275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2467884-1b6e-4610-afba-f0674800c3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05f32e7bbc24d44a0586ff9cd24d9df)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:24.929673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2467884-1b6e-4610-afba-f0674800c3ad admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:24.963648 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 939/1877] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:24.965394 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737e900-1643-4a2f-821e-a67b9c84d01e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:24.988178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737e900-1643-4a2f-821e-a67b9c84d01e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:25.012018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7739c53-e8fe-43e7-9c5f-613a90c2da00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:25.013070 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7739c53-e8fe-43e7-9c5f-613a90c2da00 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:25.014136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7739c53-e8fe-43e7-9c5f-613a90c2da00 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:25.014685 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7739c53-e8fe-43e7-9c5f-613a90c2da00 admin admin] PATH_INFO: `/v3/projects/35ed623331514a29a960a942d1ca5a81/users/467db8a8278b4670bc3fdb12c9ff4b67/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:25.061018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7739c53-e8fe-43e7-9c5f-613a90c2da00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ed623331514a29a960a942d1ca5a81, user_id=467db8a8278b4670bc3fdb12c9ff4b67, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:25.069592 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7739c53-e8fe-43e7-9c5f-613a90c2da00 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:25.074799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b2467884-1b6e-4610-afba-f0674800c3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05f32e7bbc24d44a0586ff9cd24d9df'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:25.077365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b2467884-1b6e-4610-afba-f0674800c3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05f32e7bbc24d44a0586ff9cd24d9df'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:25.097336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b2467884-1b6e-4610-afba-f0674800c3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05f32e7bbc24d44a0586ff9cd24d9df'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:25.098749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b2467884-1b6e-4610-afba-f0674800c3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05f32e7bbc24d44a0586ff9cd24d9df'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:25.105819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 940/1878] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:24 2022] PUT /identity/v3/projects/35ed623331514a29a960a942d1ca5a81/users/467db8a8278b4670bc3fdb12c9ff4b67/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:25.105819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84616c2-2fa2-4860-a513-1a9b2cce45dd None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:25.105819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84616c2-2fa2-4860-a513-1a9b2cce45dd None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:25.108231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84616c2-2fa2-4860-a513-1a9b2cce45dd None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:25.111455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 941/1879] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 05:35:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:35:25.112229 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84616c2-2fa2-4860-a513-1a9b2cce45dd None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:25.118548 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-a84616c2-2fa2-4860-a513-1a9b2cce45dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:25.127003 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b2467884-1b6e-4610-afba-f0674800c3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05f32e7bbc24d44a0586ff9cd24d9df'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:25.156785 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 939/1880] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:24 2022] DELETE /identity/v3/users/a05f32e7bbc24d44a0586ff9cd24d9df => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:25.158787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87847c5e-a5cc-40a4-90ed-b19d7efa2ab8 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:25.164024 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87847c5e-a5cc-40a4-90ed-b19d7efa2ab8 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:25.164490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87847c5e-a5cc-40a4-90ed-b19d7efa2ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:25.199107 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:25.203330 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-87847c5e-a5cc-40a4-90ed-b19d7efa2ab8 None None] MFA Rules not processed for user `515e548efd984b87bca742e26eec162a`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:25.205942 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-87847c5e-a5cc-40a4-90ed-b19d7efa2ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:25.250047 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84616c2-2fa2-4860-a513-1a9b2cce45dd None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:25.368504 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b70ca-15ce-4f5a-8940-101c388e6079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:25.370034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b70ca-15ce-4f5a-8940-101c388e6079 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:25.370767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b70ca-15ce-4f5a-8940-101c388e6079 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:25.371468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b70ca-15ce-4f5a-8940-101c388e6079 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:25.372775 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b70ca-15ce-4f5a-8940-101c388e6079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:25.374830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b70ca-15ce-4f5a-8940-101c388e6079 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:25.390843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 942/1881] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:25.395103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b70ca-15ce-4f5a-8940-101c388e6079 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:25.402282 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 940/1882] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 05:35:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:25.413570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b70ca-15ce-4f5a-8940-101c388e6079 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:25.423974 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d3de1-1395-49a3-8750-d03e67f671a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:25.424989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d3de1-1395-49a3-8750-d03e67f671a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:25.425690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d3de1-1395-49a3-8750-d03e67f671a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:25.426628 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d3de1-1395-49a3-8750-d03e67f671a6 admin admin] PATH_INFO: `/v3/projects/35ed623331514a29a960a942d1ca5a81/users/467db8a8278b4670bc3fdb12c9ff4b67/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:25.432971 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d3de1-1395-49a3-8750-d03e67f671a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ed623331514a29a960a942d1ca5a81, user_id=467db8a8278b4670bc3fdb12c9ff4b67, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:25.441503 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d3de1-1395-49a3-8750-d03e67f671a6 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:25.486354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 943/1883] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:25 2022] PUT /identity/v3/projects/35ed623331514a29a960a942d1ca5a81/users/467db8a8278b4670bc3fdb12c9ff4b67/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:25.499053 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f89bf-e9d4-4fc3-80d2-c5f08a231802 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:25.500331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f89bf-e9d4-4fc3-80d2-c5f08a231802 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:25.502535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f89bf-e9d4-4fc3-80d2-c5f08a231802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:25.516272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d3de1-1395-49a3-8750-d03e67f671a6 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:25.518386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-819d3de1-1395-49a3-8750-d03e67f671a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:25.547876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:25.618317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-c40f89bf-e9d4-4fc3-80d2-c5f08a231802 None None] MFA Rules not processed for user `467db8a8278b4670bc3fdb12c9ff4b67`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:25.623198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c40f89bf-e9d4-4fc3-80d2-c5f08a231802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:25.711237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d3de1-1395-49a3-8750-d03e67f671a6 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:25.740569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:25.741373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:25.742547 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:25.742977 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] PATH_INFO: `/v3/projects/a2cbb4342951414eb2dc3bd66071a812` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:25.745637 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2cbb4342951414eb2dc3bd66071a812)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:25.749023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:25.832154 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 941/1884] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:25.835337 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f89bf-e9d4-4fc3-80d2-c5f08a231802 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:25.841701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c40f89bf-e9d4-4fc3-80d2-c5f08a231802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:25.876976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2cbb4342951414eb2dc3bd66071a812', 'request_id': 'req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:25.884424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2cbb4342951414eb2dc3bd66071a812', 'request_id': 'req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:25.904269 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2cbb4342951414eb2dc3bd66071a812', 'request_id': 'req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:25.921210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] The token cache is being invalidate because project a2cbb4342951414eb2dc3bd66071a812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:25.921210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:25.921885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:25.923830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 944/1885] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:25 2022] DELETE /identity/v3/projects/a2cbb4342951414eb2dc3bd66071a812 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:25.927893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:25.929365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:25.937710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:25.995642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f89bf-e9d4-4fc3-80d2-c5f08a231802 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:26.006342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eb56a-4f42-4e33-a2e9-86f885ecccf3 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:26.011982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea8da6-69c4-4c75-a057-39fd223e704d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:26.013219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea8da6-69c4-4c75-a057-39fd223e704d service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:26.013495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea8da6-69c4-4c75-a057-39fd223e704d service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:26.013897 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea8da6-69c4-4c75-a057-39fd223e704d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:26.015844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d4ea8da6-69c4-4c75-a057-39fd223e704d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:26.102706 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea8da6-69c4-4c75-a057-39fd223e704d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:26.104706 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea8da6-69c4-4c75-a057-39fd223e704d service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:26.107963 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb73191-daae-4bfc-b8f6-862d4e799549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:26.108809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb73191-daae-4bfc-b8f6-862d4e799549 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:26.109294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb73191-daae-4bfc-b8f6-862d4e799549 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:26.109749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb73191-daae-4bfc-b8f6-862d4e799549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:26.111960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-feb73191-daae-4bfc-b8f6-862d4e799549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:26.122728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 945/1886] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:26.123628 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea8da6-69c4-4c75-a057-39fd223e704d service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:26.125173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d4ea8da6-69c4-4c75-a057-39fd223e704d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:26.126237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb73191-daae-4bfc-b8f6-862d4e799549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:26.128342 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb73191-daae-4bfc-b8f6-862d4e799549 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:26.142743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 942/1887] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:26.144199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb73191-daae-4bfc-b8f6-862d4e799549 service nova] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:26.145860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-feb73191-daae-4bfc-b8f6-862d4e799549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:26.173839 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:26.217695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea8da6-69c4-4c75-a057-39fd223e704d service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:26.222950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d28431-ac39-4830-87fb-706a56db5997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:26.223597 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28431-ac39-4830-87fb-706a56db5997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:26.223871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28431-ac39-4830-87fb-706a56db5997 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:26.224139 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28431-ac39-4830-87fb-706a56db5997 admin admin] PATH_INFO: `/v3/projects/ea49c49e50d64e1586414c16590c4e74` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:26.225296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d28431-ac39-4830-87fb-706a56db5997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea49c49e50d64e1586414c16590c4e74)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:26.227704 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d28431-ac39-4830-87fb-706a56db5997 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:26.341358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb73191-daae-4bfc-b8f6-862d4e799549 service nova] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:26.356787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-72d28431-ac39-4830-87fb-706a56db5997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea49c49e50d64e1586414c16590c4e74', 'request_id': 'req-72d28431-ac39-4830-87fb-706a56db5997'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.369059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:26.373953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-72d28431-ac39-4830-87fb-706a56db5997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea49c49e50d64e1586414c16590c4e74', 'request_id': 'req-72d28431-ac39-4830-87fb-706a56db5997'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.404522 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-72d28431-ac39-4830-87fb-706a56db5997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea49c49e50d64e1586414c16590c4e74', 'request_id': 'req-72d28431-ac39-4830-87fb-706a56db5997'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.439240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-72d28431-ac39-4830-87fb-706a56db5997 admin admin] The token cache is being invalidate because project ea49c49e50d64e1586414c16590c4e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:26.439572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-72d28431-ac39-4830-87fb-706a56db5997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.442581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-72d28431-ac39-4830-87fb-706a56db5997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.454547 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 946/1888] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:26 2022] DELETE /identity/v3/projects/ea49c49e50d64e1586414c16590c4e74 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:26.456214 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657081a0-b168-4899-831e-9a4c6a4b8b81 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:26.456495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657081a0-b168-4899-831e-9a4c6a4b8b81 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:26.456763 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657081a0-b168-4899-831e-9a4c6a4b8b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:26.527760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-657081a0-b168-4899-831e-9a4c6a4b8b81 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:26.529890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-657081a0-b168-4899-831e-9a4c6a4b8b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:26.533471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccf8ba-d0b8-4cba-8f19-b03df4d83c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:26.535223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccf8ba-d0b8-4cba-8f19-b03df4d83c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:26.535513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccf8ba-d0b8-4cba-8f19-b03df4d83c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:26.535837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccf8ba-d0b8-4cba-8f19-b03df4d83c92 admin admin] PATH_INFO: `/v3/users/d7fb22232cc74249acbfb5421fb1924b` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:26.541643 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccf8ba-d0b8-4cba-8f19-b03df4d83c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7fb22232cc74249acbfb5421fb1924b)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:26.546066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccf8ba-d0b8-4cba-8f19-b03df4d83c92 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:26.552827 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 947/1889] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:26.553765 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657081a0-b168-4899-831e-9a4c6a4b8b81 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:26.556312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-657081a0-b168-4899-831e-9a4c6a4b8b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:26.574590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657081a0-b168-4899-831e-9a4c6a4b8b81 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:26.581193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4089b-f5a6-4ad2-bb7b-94867decf95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:26.581830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4089b-f5a6-4ad2-bb7b-94867decf95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:26.582104 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4089b-f5a6-4ad2-bb7b-94867decf95e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:26.582370 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4089b-f5a6-4ad2-bb7b-94867decf95e admin admin] PATH_INFO: `/v3/users/7f02574411bb459b87beb20fa87f0f04` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:26.583936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4089b-f5a6-4ad2-bb7b-94867decf95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f02574411bb459b87beb20fa87f0f04)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:26.585487 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4089b-f5a6-4ad2-bb7b-94867decf95e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:26.622528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4bccf8ba-d0b8-4cba-8f19-b03df4d83c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7fb22232cc74249acbfb5421fb1924b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.624206 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4bccf8ba-d0b8-4cba-8f19-b03df4d83c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7fb22232cc74249acbfb5421fb1924b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.633472 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4bccf8ba-d0b8-4cba-8f19-b03df4d83c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7fb22232cc74249acbfb5421fb1924b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.634360 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4bccf8ba-d0b8-4cba-8f19-b03df4d83c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7fb22232cc74249acbfb5421fb1924b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.652030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4bccf8ba-d0b8-4cba-8f19-b03df4d83c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7fb22232cc74249acbfb5421fb1924b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.658678 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1dc4089b-f5a6-4ad2-bb7b-94867decf95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f02574411bb459b87beb20fa87f0f04'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.659636 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1dc4089b-f5a6-4ad2-bb7b-94867decf95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f02574411bb459b87beb20fa87f0f04'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.676208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 943/1890] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:26 2022] DELETE /identity/v3/users/d7fb22232cc74249acbfb5421fb1924b => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:26.676208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9293e-8976-43ee-b244-93db31a54d21 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:26.676675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9293e-8976-43ee-b244-93db31a54d21 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:26.677295 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9293e-8976-43ee-b244-93db31a54d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:26.682603 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1dc4089b-f5a6-4ad2-bb7b-94867decf95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f02574411bb459b87beb20fa87f0f04'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.693479 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1dc4089b-f5a6-4ad2-bb7b-94867decf95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f02574411bb459b87beb20fa87f0f04'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.695324 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1dc4089b-f5a6-4ad2-bb7b-94867decf95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f02574411bb459b87beb20fa87f0f04'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:26.711720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-e6f9293e-8976-43ee-b244-93db31a54d21 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:26.713211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e6f9293e-8976-43ee-b244-93db31a54d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:26.730615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 948/1891] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:26 2022] DELETE /identity/v3/users/7f02574411bb459b87beb20fa87f0f04 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:26.732267 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974de68-e9fe-4d1a-9e92-6769a3d1e11a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:26.732892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974de68-e9fe-4d1a-9e92-6769a3d1e11a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:26.734004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974de68-e9fe-4d1a-9e92-6769a3d1e11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:26.766265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8974de68-e9fe-4d1a-9e92-6769a3d1e11a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:26.768146 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:26.770340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8974de68-e9fe-4d1a-9e92-6769a3d1e11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:26.803015 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 944/1892] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:26.804561 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cca8d0-6654-4521-bf07-63a84e5ec012 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:26.804965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cca8d0-6654-4521-bf07-63a84e5ec012 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:26.805322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cca8d0-6654-4521-bf07-63a84e5ec012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:26.831699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-47cca8d0-6654-4521-bf07-63a84e5ec012 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:26.833546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-47cca8d0-6654-4521-bf07-63a84e5ec012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:26.860286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 949/1893] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:26.861550 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7309a-f819-41c5-9281-2d4b98fdaf2f None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:26.861839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7309a-f819-41c5-9281-2d4b98fdaf2f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:26.862110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7309a-f819-41c5-9281-2d4b98fdaf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:26.891103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-a9e7309a-f819-41c5-9281-2d4b98fdaf2f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:26.892452 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-a9e7309a-f819-41c5-9281-2d4b98fdaf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:26.904399 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 950/1894] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:26.906459 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4ac57-89fc-4af8-82a1-715292c57af9 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:26.906772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4ac57-89fc-4af8-82a1-715292c57af9 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:26.907043 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4ac57-89fc-4af8-82a1-715292c57af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:26.933620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-58f4ac57-89fc-4af8-82a1-715292c57af9 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:26.935571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-58f4ac57-89fc-4af8-82a1-715292c57af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:26.945772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 951/1895] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:26.947395 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4ac57-89fc-4af8-82a1-715292c57af9 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:26.955549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 945/1896] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:26.956702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cca8d0-6654-4521-bf07-63a84e5ec012 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:26.958086 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-47cca8d0-6654-4521-bf07-63a84e5ec012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:26.965735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4ac57-89fc-4af8-82a1-715292c57af9 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:26.974236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a96a0-f693-433a-bc6d-f93e11ccffc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:26.975419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a96a0-f693-433a-bc6d-f93e11ccffc9 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:26.976005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a96a0-f693-433a-bc6d-f93e11ccffc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:26.976480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a96a0-f693-433a-bc6d-f93e11ccffc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:26.977435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a96a0-f693-433a-bc6d-f93e11ccffc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:26.978051 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a96a0-f693-433a-bc6d-f93e11ccffc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:26.980965 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a96a0-f693-433a-bc6d-f93e11ccffc9 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:26.996348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 952/1897] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:26.998322 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a96a0-f693-433a-bc6d-f93e11ccffc9 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.014416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a96a0-f693-433a-bc6d-f93e11ccffc9 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.024100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39059be6-749d-402d-9931-883a7dff3567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.025345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059be6-749d-402d-9931-883a7dff3567 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.026187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059be6-749d-402d-9931-883a7dff3567 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.026801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059be6-749d-402d-9931-883a7dff3567 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.027653 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39059be6-749d-402d-9931-883a7dff3567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:27.028386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39059be6-749d-402d-9931-883a7dff3567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.030354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39059be6-749d-402d-9931-883a7dff3567 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.049638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 953/1898] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:27.050345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cca8d0-6654-4521-bf07-63a84e5ec012 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.051688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39059be6-749d-402d-9931-883a7dff3567 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.056527 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b2769-9564-4362-9e40-855326365f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.057167 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b2769-9564-4362-9e40-855326365f7b service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.057585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b2769-9564-4362-9e40-855326365f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.057864 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b2769-9564-4362-9e40-855326365f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.069486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39059be6-749d-402d-9931-883a7dff3567 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.071499 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b2769-9564-4362-9e40-855326365f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.073574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b2769-9564-4362-9e40-855326365f7b service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.075071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db418ef-24b7-4dc7-9f51-2383d282654d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.075275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db418ef-24b7-4dc7-9f51-2383d282654d service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.075862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db418ef-24b7-4dc7-9f51-2383d282654d service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.076205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db418ef-24b7-4dc7-9f51-2383d282654d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.084267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 946/1899] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:27.084870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b2769-9564-4362-9e40-855326365f7b service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.091845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db418ef-24b7-4dc7-9f51-2383d282654d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.093379 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db418ef-24b7-4dc7-9f51-2383d282654d service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.099682 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:27.123789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b2769-9564-4362-9e40-855326365f7b service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.126771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 954/1900] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:27.127643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db418ef-24b7-4dc7-9f51-2383d282654d service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.135266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d024c8-4643-4243-a929-0edd15caa899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.135895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d024c8-4643-4243-a929-0edd15caa899 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.136660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d024c8-4643-4243-a929-0edd15caa899 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.136660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d024c8-4643-4243-a929-0edd15caa899 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.137064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d024c8-4643-4243-a929-0edd15caa899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.139983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d024c8-4643-4243-a929-0edd15caa899 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.163157 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db418ef-24b7-4dc7-9f51-2383d282654d service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.183146 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 947/1901] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:27 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:27.183953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b5601-2c96-4a61-bf00-7276f11b1ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.184664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5601-2c96-4a61-bf00-7276f11b1ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.184943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5601-2c96-4a61-bf00-7276f11b1ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.185281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5601-2c96-4a61-bf00-7276f11b1ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.185928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b5601-2c96-4a61-bf00-7276f11b1ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.187564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d024c8-4643-4243-a929-0edd15caa899 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.189060 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b5601-2c96-4a61-bf00-7276f11b1ec2 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.221269 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 955/1902] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:27 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:27.225165 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b5601-2c96-4a61-bf00-7276f11b1ec2 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.274977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d024c8-4643-4243-a929-0edd15caa899 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.288735 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:27.348294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b5601-2c96-4a61-bf00-7276f11b1ec2 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.355996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d259e-3544-480e-8964-4ef6582094c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.357335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d259e-3544-480e-8964-4ef6582094c5 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.357753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d259e-3544-480e-8964-4ef6582094c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.358171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d259e-3544-480e-8964-4ef6582094c5 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.359098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d259e-3544-480e-8964-4ef6582094c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.361139 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d259e-3544-480e-8964-4ef6582094c5 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.362780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12635ad9-9c57-4ed3-b897-478149b7128a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.363862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12635ad9-9c57-4ed3-b897-478149b7128a admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.364225 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12635ad9-9c57-4ed3-b897-478149b7128a admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.364686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12635ad9-9c57-4ed3-b897-478149b7128a admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.365481 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12635ad9-9c57-4ed3-b897-478149b7128a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.367873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12635ad9-9c57-4ed3-b897-478149b7128a admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.397401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 956/1903] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:27 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:27.402753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d259e-3544-480e-8964-4ef6582094c5 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.415040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 948/1904] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:27 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:35:27.418750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d259e-3544-480e-8964-4ef6582094c5 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.419762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12635ad9-9c57-4ed3-b897-478149b7128a admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.424837 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7faa69d-ae87-4a85-ac0a-de9ec698684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.425461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faa69d-ae87-4a85-ac0a-de9ec698684f admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.425743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faa69d-ae87-4a85-ac0a-de9ec698684f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.426147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faa69d-ae87-4a85-ac0a-de9ec698684f admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.428658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7faa69d-ae87-4a85-ac0a-de9ec698684f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.430783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7faa69d-ae87-4a85-ac0a-de9ec698684f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.432453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12635ad9-9c57-4ed3-b897-478149b7128a admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.439389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df1f16-189d-42d3-a357-c6cbe97e2c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.440144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df1f16-189d-42d3-a357-c6cbe97e2c22 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.440966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df1f16-189d-42d3-a357-c6cbe97e2c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.440966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df1f16-189d-42d3-a357-c6cbe97e2c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.441549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df1f16-189d-42d3-a357-c6cbe97e2c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.443307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df1f16-189d-42d3-a357-c6cbe97e2c22 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.445422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 957/1905] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:27.464132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7faa69d-ae87-4a85-ac0a-de9ec698684f admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.475825 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 949/1906] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:27.481032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df1f16-189d-42d3-a357-c6cbe97e2c22 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.485183 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7faa69d-ae87-4a85-ac0a-de9ec698684f admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.504145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b8314-a76c-417b-a232-7979dd4ff203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.505143 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8314-a76c-417b-a232-7979dd4ff203 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.505636 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8314-a76c-417b-a232-7979dd4ff203 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.506135 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8314-a76c-417b-a232-7979dd4ff203 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.506287 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df1f16-189d-42d3-a357-c6cbe97e2c22 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.507828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b8314-a76c-417b-a232-7979dd4ff203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.510624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b8314-a76c-417b-a232-7979dd4ff203 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.516534 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d0576-55cd-4918-965c-a743f7b62c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.517286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d0576-55cd-4918-965c-a743f7b62c42 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.517574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d0576-55cd-4918-965c-a743f7b62c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.517852 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d0576-55cd-4918-965c-a743f7b62c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.518522 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d0576-55cd-4918-965c-a743f7b62c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.520524 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d0576-55cd-4918-965c-a743f7b62c42 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.533837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 950/1907] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:27.537776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d0576-55cd-4918-965c-a743f7b62c42 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.547114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 958/1908] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:27.551714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b8314-a76c-417b-a232-7979dd4ff203 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.567269 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d0576-55cd-4918-965c-a743f7b62c42 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.569053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b8314-a76c-417b-a232-7979dd4ff203 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.573421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10a062-f785-4f08-a211-b65fc0d46fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.574599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10a062-f785-4f08-a211-b65fc0d46fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.574959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10a062-f785-4f08-a211-b65fc0d46fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.575466 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10a062-f785-4f08-a211-b65fc0d46fa9 admin admin] PATH_INFO: `/v3/projects/91ec7d65f49e4a44b6d74d9f69d44603/users/ae4ede6db32a4c8bb95318f75e780672/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.586500 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1c0f0-c9b7-4e43-9e7e-ffa57b0ff672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.587574 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1c0f0-c9b7-4e43-9e7e-ffa57b0ff672 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.587929 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1c0f0-c9b7-4e43-9e7e-ffa57b0ff672 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.588276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1c0f0-c9b7-4e43-9e7e-ffa57b0ff672 admin admin] PATH_INFO: `/v3/projects/ffa5f7584712419399cff407c191d049/users/0c9f9b4989804a6fa0945910590c8063/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.598182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10a062-f785-4f08-a211-b65fc0d46fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ec7d65f49e4a44b6d74d9f69d44603, user_id=ae4ede6db32a4c8bb95318f75e780672, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.602985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10a062-f785-4f08-a211-b65fc0d46fa9 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.611966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1c0f0-c9b7-4e43-9e7e-ffa57b0ff672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa5f7584712419399cff407c191d049, user_id=0c9f9b4989804a6fa0945910590c8063, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.615595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1c0f0-c9b7-4e43-9e7e-ffa57b0ff672 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.628712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 951/1909] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:27 2022] PUT /identity/v3/projects/91ec7d65f49e4a44b6d74d9f69d44603/users/ae4ede6db32a4c8bb95318f75e780672/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:27.640120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696d349-29a7-4886-803f-516386ab5b82 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.640731 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696d349-29a7-4886-803f-516386ab5b82 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.641115 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696d349-29a7-4886-803f-516386ab5b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.644847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 959/1910] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:27 2022] PUT /identity/v3/projects/ffa5f7584712419399cff407c191d049/users/0c9f9b4989804a6fa0945910590c8063/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:27.656238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973282c-7df8-4bae-8deb-5bfccd37b930 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.656420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973282c-7df8-4bae-8deb-5bfccd37b930 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.656695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973282c-7df8-4bae-8deb-5bfccd37b930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.693023 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-4696d349-29a7-4886-803f-516386ab5b82 None None] MFA Rules not processed for user `ae4ede6db32a4c8bb95318f75e780672`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:27.694471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4696d349-29a7-4886-803f-516386ab5b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:27.694784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-2973282c-7df8-4bae-8deb-5bfccd37b930 None None] MFA Rules not processed for user `0c9f9b4989804a6fa0945910590c8063`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:27.696109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-2973282c-7df8-4bae-8deb-5bfccd37b930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:27.790317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 952/1911] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:27.795833 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696d349-29a7-4886-803f-516386ab5b82 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.853811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 960/1912] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:27.853811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973282c-7df8-4bae-8deb-5bfccd37b930 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.854715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-2973282c-7df8-4bae-8deb-5bfccd37b930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:27.875470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:27.899726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:27.927811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696d349-29a7-4886-803f-516386ab5b82 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.933443 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7c3ce-d92c-445e-b4bc-f60b6f4354fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.934179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7c3ce-d92c-445e-b4bc-f60b6f4354fa admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.935113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7c3ce-d92c-445e-b4bc-f60b6f4354fa admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.935390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7c3ce-d92c-445e-b4bc-f60b6f4354fa admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.936201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7c3ce-d92c-445e-b4bc-f60b6f4354fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.938721 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7c3ce-d92c-445e-b4bc-f60b6f4354fa admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.949039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973282c-7df8-4bae-8deb-5bfccd37b930 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:27.956871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:27.958243 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:27.958920 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:27.959286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] PATH_INFO: `/v3/projects/ac9d881aa89d4fe8b8fff7f9df048943` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:27.961007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9d881aa89d4fe8b8fff7f9df048943)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:27.963622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:27.972197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 953/1913] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:27 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:27.975584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7c3ce-d92c-445e-b4bc-f60b6f4354fa admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:27.977485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0ea7c3ce-d92c-445e-b4bc-f60b6f4354fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:28.017101 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9d881aa89d4fe8b8fff7f9df048943', 'request_id': 'req-efddae18-65c4-4041-9206-060b0ce212f8'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.023250 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9d881aa89d4fe8b8fff7f9df048943', 'request_id': 'req-efddae18-65c4-4041-9206-060b0ce212f8'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.032204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9d881aa89d4fe8b8fff7f9df048943', 'request_id': 'req-efddae18-65c4-4041-9206-060b0ce212f8'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.046202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] The token cache is being invalidate because project ac9d881aa89d4fe8b8fff7f9df048943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:28.046549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.047765 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.050488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 961/1914] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:27 2022] DELETE /identity/v3/projects/ac9d881aa89d4fe8b8fff7f9df048943 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:28.051304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:28.052649 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:28.060867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7c3ce-d92c-445e-b4bc-f60b6f4354fa admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:28.125196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:28.125748 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:28.126034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:28.127053 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] PATH_INFO: `/v3/projects/dfd167d29b374730b064c3de5ab833bd` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:28.127559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd167d29b374730b064c3de5ab833bd)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:28.129497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:28.129690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddae18-65c4-4041-9206-060b0ce212f8 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:28.134464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6772c1a-99de-42e7-bcb0-28011892300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:28.135089 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6772c1a-99de-42e7-bcb0-28011892300d admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:28.135366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6772c1a-99de-42e7-bcb0-28011892300d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:28.135771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6772c1a-99de-42e7-bcb0-28011892300d admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:28.136407 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6772c1a-99de-42e7-bcb0-28011892300d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:28.138963 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6772c1a-99de-42e7-bcb0-28011892300d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:28.166860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 962/1915] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:28 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:28.167738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6772c1a-99de-42e7-bcb0-28011892300d admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:28.169349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c6772c1a-99de-42e7-bcb0-28011892300d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:28.177596 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd167d29b374730b064c3de5ab833bd', 'request_id': 'req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.185894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd167d29b374730b064c3de5ab833bd', 'request_id': 'req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.195732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd167d29b374730b064c3de5ab833bd', 'request_id': 'req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.199266 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:28.213737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] The token cache is being invalidate because project dfd167d29b374730b064c3de5ab833bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:28.214102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.214868 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.216827 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 954/1916] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:27 2022] DELETE /identity/v3/projects/dfd167d29b374730b064c3de5ab833bd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:28.220434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:28.221856 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:28.232747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:28.246018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6772c1a-99de-42e7-bcb0-28011892300d admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:28.253173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d905c9-eddb-4d06-8bcb-86f5c53065a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:28.253796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d905c9-eddb-4d06-8bcb-86f5c53065a4 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:28.254074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d905c9-eddb-4d06-8bcb-86f5c53065a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:28.254343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d905c9-eddb-4d06-8bcb-86f5c53065a4 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:28.255254 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d905c9-eddb-4d06-8bcb-86f5c53065a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:28.257318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d905c9-eddb-4d06-8bcb-86f5c53065a4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:28.289784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 963/1917] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:28 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:28.289784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d905c9-eddb-4d06-8bcb-86f5c53065a4 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:28.291545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c5d905c9-eddb-4d06-8bcb-86f5c53065a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:28.306974 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d905c9-eddb-4d06-8bcb-86f5c53065a4 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:28.312570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704822f-16f3-440c-a29b-299ba0e41f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:28.313192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704822f-16f3-440c-a29b-299ba0e41f3e admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:28.313472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704822f-16f3-440c-a29b-299ba0e41f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:28.313741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704822f-16f3-440c-a29b-299ba0e41f3e admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:28.314389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704822f-16f3-440c-a29b-299ba0e41f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:28.316892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704822f-16f3-440c-a29b-299ba0e41f3e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:28.320619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632fd4c-d772-40cd-b3b9-58a814e2e8e9 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:28.325536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:28.326271 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:28.326647 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:28.327021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] PATH_INFO: `/v3/users/467db8a8278b4670bc3fdb12c9ff4b67` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:28.328305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=467db8a8278b4670bc3fdb12c9ff4b67)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:28.331192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:28.342084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 964/1918] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:28 2022] POST /identity/v3/users => generated 302 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:28.343203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704822f-16f3-440c-a29b-299ba0e41f3e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:28.346988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1704822f-16f3-440c-a29b-299ba0e41f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:28.362179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704822f-16f3-440c-a29b-299ba0e41f3e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:28.368626 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:28.369343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:28.369694 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:28.369955 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] PATH_INFO: `/v3/users/1434fb8d7de249e1b63ebf340f3e938b` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:28.371497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1434fb8d7de249e1b63ebf340f3e938b)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:28.374034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:28.393154 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467db8a8278b4670bc3fdb12c9ff4b67'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.394139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467db8a8278b4670bc3fdb12c9ff4b67'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.409232 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467db8a8278b4670bc3fdb12c9ff4b67'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.410106 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467db8a8278b4670bc3fdb12c9ff4b67'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.428944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467db8a8278b4670bc3fdb12c9ff4b67'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.455412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 955/1919] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:28 2022] DELETE /identity/v3/users/467db8a8278b4670bc3fdb12c9ff4b67 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:28.455412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:28.455412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:28.473162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1434fb8d7de249e1b63ebf340f3e938b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.475164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1434fb8d7de249e1b63ebf340f3e938b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.498056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1434fb8d7de249e1b63ebf340f3e938b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.518313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1434fb8d7de249e1b63ebf340f3e938b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.519239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1434fb8d7de249e1b63ebf340f3e938b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:28.534545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9db5d9-5ee7-4a80-8c40-36e042d1f340 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:28.541267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe95b6c-0b00-4f06-bf70-d50a8a294894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:28.541908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe95b6c-0b00-4f06-bf70-d50a8a294894 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:28.542410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe95b6c-0b00-4f06-bf70-d50a8a294894 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:28.542719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe95b6c-0b00-4f06-bf70-d50a8a294894 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:28.544449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe95b6c-0b00-4f06-bf70-d50a8a294894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:28.546235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe95b6c-0b00-4f06-bf70-d50a8a294894 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:28.555936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 965/1920] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:28 2022] DELETE /identity/v3/users/1434fb8d7de249e1b63ebf340f3e938b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:28.557009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:28.561032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 956/1921] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:28.561386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:28.565134 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe95b6c-0b00-4f06-bf70-d50a8a294894 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:28.567933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-cbe95b6c-0b00-4f06-bf70-d50a8a294894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:28.587489 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe95b6c-0b00-4f06-bf70-d50a8a294894 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:28.614353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:28.714937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f728e8-a731-4106-93fe-454e2df58aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:28.718180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f728e8-a731-4106-93fe-454e2df58aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:28.718484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f728e8-a731-4106-93fe-454e2df58aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:28.718906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f728e8-a731-4106-93fe-454e2df58aa1 admin admin] PATH_INFO: `/v3/projects/a90710f605a84641bc3f45b54a7bd0c0/users/b5d1eaef58834cc29412e3672b9f2edc/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:28.728156 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dddf6-d929-4ad8-b042-ac898fe3c796 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:28.743235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd642d-ffcd-4337-8d06-43dbbd0528f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:28.744783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd642d-ffcd-4337-8d06-43dbbd0528f7 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:28.745256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd642d-ffcd-4337-8d06-43dbbd0528f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:28.745809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd642d-ffcd-4337-8d06-43dbbd0528f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:28.747835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd642d-ffcd-4337-8d06-43dbbd0528f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:28.750206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd642d-ffcd-4337-8d06-43dbbd0528f7 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:28.750707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f728e8-a731-4106-93fe-454e2df58aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90710f605a84641bc3f45b54a7bd0c0, user_id=b5d1eaef58834cc29412e3672b9f2edc, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:28.753445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f728e8-a731-4106-93fe-454e2df58aa1 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:28.767040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 966/1922] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:28.771281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd642d-ffcd-4337-8d06-43dbbd0528f7 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:28.773602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 957/1923] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:28 2022] PUT /identity/v3/projects/a90710f605a84641bc3f45b54a7bd0c0/users/b5d1eaef58834cc29412e3672b9f2edc/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:28.776958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f728e8-a731-4106-93fe-454e2df58aa1 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:28.782715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:28.791133 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd642d-ffcd-4337-8d06-43dbbd0528f7 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:28.854090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f728e8-a731-4106-93fe-454e2df58aa1 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:28.861160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f306df-596a-4b33-9236-2f6d9072a00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:28.862093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f306df-596a-4b33-9236-2f6d9072a00a admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:28.862382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f306df-596a-4b33-9236-2f6d9072a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:28.862786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f306df-596a-4b33-9236-2f6d9072a00a admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:28.863597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f306df-596a-4b33-9236-2f6d9072a00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:28.865296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f306df-596a-4b33-9236-2f6d9072a00a admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:28.883478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 958/1924] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:28.884365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f306df-596a-4b33-9236-2f6d9072a00a admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:28.888607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828abe0-7d4b-4428-92d4-e7bda2de7332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:28.889273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828abe0-7d4b-4428-92d4-e7bda2de7332 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:28.889621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828abe0-7d4b-4428-92d4-e7bda2de7332 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:28.890001 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828abe0-7d4b-4428-92d4-e7bda2de7332 admin admin] PATH_INFO: `/v3/projects/44a22666296641e494ef5e124af5e18d/users/6e981ed486bc4a29a23f579f67ac32c4/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:28.897866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f306df-596a-4b33-9236-2f6d9072a00a admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:28.905911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84458e-a1b8-4e61-bcac-8ca0a61a7d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:28.906630 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84458e-a1b8-4e61-bcac-8ca0a61a7d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:28.906910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84458e-a1b8-4e61-bcac-8ca0a61a7d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:28.907182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84458e-a1b8-4e61-bcac-8ca0a61a7d8f admin admin] PATH_INFO: `/v3/projects/a90710f605a84641bc3f45b54a7bd0c0/users/b5d1eaef58834cc29412e3672b9f2edc/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:28.915377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84458e-a1b8-4e61-bcac-8ca0a61a7d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90710f605a84641bc3f45b54a7bd0c0, user_id=b5d1eaef58834cc29412e3672b9f2edc, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:28.919727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84458e-a1b8-4e61-bcac-8ca0a61a7d8f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:28.929909 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828abe0-7d4b-4428-92d4-e7bda2de7332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a22666296641e494ef5e124af5e18d, user_id=6e981ed486bc4a29a23f579f67ac32c4, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:28.936919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828abe0-7d4b-4428-92d4-e7bda2de7332 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:28.942722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 959/1925] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:28 2022] PUT /identity/v3/projects/a90710f605a84641bc3f45b54a7bd0c0/users/b5d1eaef58834cc29412e3672b9f2edc/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:28.956078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2417e3a-dfa8-410d-9f6c-d45ffcbb994a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:28.956403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2417e3a-dfa8-410d-9f6c-d45ffcbb994a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:28.956729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2417e3a-dfa8-410d-9f6c-d45ffcbb994a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:28.969375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 967/1926] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:28 2022] PUT /identity/v3/projects/44a22666296641e494ef5e124af5e18d/users/6e981ed486bc4a29a23f579f67ac32c4/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:28.973338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828abe0-7d4b-4428-92d4-e7bda2de7332 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:29.001689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-a2417e3a-dfa8-410d-9f6c-d45ffcbb994a None None] MFA Rules not processed for user `b5d1eaef58834cc29412e3672b9f2edc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:29.003655 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a2417e3a-dfa8-410d-9f6c-d45ffcbb994a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:29.067193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828abe0-7d4b-4428-92d4-e7bda2de7332 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:29.071922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a54fe-f3a2-4fc1-80d9-402dace2b048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:29.072581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a54fe-f3a2-4fc1-80d9-402dace2b048 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:29.072796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a54fe-f3a2-4fc1-80d9-402dace2b048 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:29.073067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a54fe-f3a2-4fc1-80d9-402dace2b048 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:29.073709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a54fe-f3a2-4fc1-80d9-402dace2b048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:29.076265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a54fe-f3a2-4fc1-80d9-402dace2b048 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:29.088081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 968/1927] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:29.092427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a54fe-f3a2-4fc1-80d9-402dace2b048 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:29.105078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 960/1928] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:29.108909 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a54fe-f3a2-4fc1-80d9-402dace2b048 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:29.114884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f8fde-25fc-42c0-aa15-77b0f408e3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:29.115554 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8fde-25fc-42c0-aa15-77b0f408e3e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:29.115830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8fde-25fc-42c0-aa15-77b0f408e3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:29.116364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8fde-25fc-42c0-aa15-77b0f408e3e8 admin admin] PATH_INFO: `/v3/projects/44a22666296641e494ef5e124af5e18d/users/6e981ed486bc4a29a23f579f67ac32c4/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:29.117457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2417e3a-dfa8-410d-9f6c-d45ffcbb994a None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:29.120553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a2417e3a-dfa8-410d-9f6c-d45ffcbb994a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:29.120773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f8fde-25fc-42c0-aa15-77b0f408e3e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a22666296641e494ef5e124af5e18d, user_id=6e981ed486bc4a29a23f579f67ac32c4, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:29.123521 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f8fde-25fc-42c0-aa15-77b0f408e3e8 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:29.138353 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 969/1929] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:29 2022] PUT /identity/v3/projects/44a22666296641e494ef5e124af5e18d/users/6e981ed486bc4a29a23f579f67ac32c4/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:29.143400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:29.149190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d286-6139-47bf-aab9-d700b129b0e3 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:29.149570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d286-6139-47bf-aab9-d700b129b0e3 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:29.150780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d286-6139-47bf-aab9-d700b129b0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:29.192738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8103d286-6139-47bf-aab9-d700b129b0e3 None None] MFA Rules not processed for user `6e981ed486bc4a29a23f579f67ac32c4`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:29.194025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8103d286-6139-47bf-aab9-d700b129b0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:29.259622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2417e3a-dfa8-410d-9f6c-d45ffcbb994a None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:29.324896 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:29.342170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 970/1930] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:29 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:29.343245 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103d286-6139-47bf-aab9-d700b129b0e3 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:29.344457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8103d286-6139-47bf-aab9-d700b129b0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:29.361459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdea246-ea65-4411-915c-bba71f4dbfe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:29.362497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdea246-ea65-4411-915c-bba71f4dbfe4 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:29.363021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdea246-ea65-4411-915c-bba71f4dbfe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:29.363292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdea246-ea65-4411-915c-bba71f4dbfe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:29.421016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103d286-6139-47bf-aab9-d700b129b0e3 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:29.425972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:29.426580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:29.426861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:29.427129 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] PATH_INFO: `/v3/projects/35ed623331514a29a960a942d1ca5a81` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:29.428261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ed623331514a29a960a942d1ca5a81)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:29.430169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:29.430369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdea246-ea65-4411-915c-bba71f4dbfe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:29.431874 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdea246-ea65-4411-915c-bba71f4dbfe4 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:29.441688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 961/1931] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:35:29.442320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdea246-ea65-4411-915c-bba71f4dbfe4 service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:29.443648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2cdea246-ea65-4411-915c-bba71f4dbfe4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:29.459175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdea246-ea65-4411-915c-bba71f4dbfe4 service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:29.469432 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:29.470279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:29.470389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:29.470697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] PATH_INFO: `/v3/projects/3e7f84e9d8724da7aae99b3098ba0124` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:29.471871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7f84e9d8724da7aae99b3098ba0124)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:29.473834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:29.493344 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ed623331514a29a960a942d1ca5a81', 'request_id': 'req-40930ac5-f5cb-4c74-988e-037c794b6999'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.499693 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ed623331514a29a960a942d1ca5a81', 'request_id': 'req-40930ac5-f5cb-4c74-988e-037c794b6999'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.507933 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ed623331514a29a960a942d1ca5a81', 'request_id': 'req-40930ac5-f5cb-4c74-988e-037c794b6999'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.524854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] The token cache is being invalidate because project 35ed623331514a29a960a942d1ca5a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:29.525143 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.525794 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.527323 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 971/1932] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:29 2022] DELETE /identity/v3/projects/35ed623331514a29a960a942d1ca5a81 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:29.528607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:29.529866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:29.533872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7f84e9d8724da7aae99b3098ba0124', 'request_id': 'req-e074635c-9edc-4d8a-8321-219898484b0b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.540719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7f84e9d8724da7aae99b3098ba0124', 'request_id': 'req-e074635c-9edc-4d8a-8321-219898484b0b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.552195 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7f84e9d8724da7aae99b3098ba0124', 'request_id': 'req-e074635c-9edc-4d8a-8321-219898484b0b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.563935 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] The token cache is being invalidate because project 3e7f84e9d8724da7aae99b3098ba0124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:29.564223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.564884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.566553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 962/1933] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:29 2022] DELETE /identity/v3/projects/3e7f84e9d8724da7aae99b3098ba0124 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:29.567195 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:29.568521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:29.573799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:29.599135 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40930ac5-f5cb-4c74-988e-037c794b6999 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:29.643796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:29.645353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074635c-9edc-4d8a-8321-219898484b0b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:29.650911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:29.651661 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:29.651946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:29.652222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] PATH_INFO: `/v3/users/ae4ede6db32a4c8bb95318f75e780672` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:29.654014 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4ede6db32a4c8bb95318f75e780672)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:29.654973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f51f8-a038-4ed3-9cb2-917e522ad3fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:29.655791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f51f8-a038-4ed3-9cb2-917e522ad3fe service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:29.656007 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:29.656207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f51f8-a038-4ed3-9cb2-917e522ad3fe service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:29.656546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f51f8-a038-4ed3-9cb2-917e522ad3fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:29.658357 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-684f51f8-a038-4ed3-9cb2-917e522ad3fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:29.719085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4ede6db32a4c8bb95318f75e780672'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.719959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4ede6db32a4c8bb95318f75e780672'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.730010 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4ede6db32a4c8bb95318f75e780672'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.730893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4ede6db32a4c8bb95318f75e780672'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.738382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f51f8-a038-4ed3-9cb2-917e522ad3fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:29.739860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f51f8-a038-4ed3-9cb2-917e522ad3fe service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:29.748535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4ede6db32a4c8bb95318f75e780672'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:29.770145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 972/1934] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:29.772906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1212330-094a-498e-9d9c-2545848aa1bf None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:29.773194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1212330-094a-498e-9d9c-2545848aa1bf None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:29.773470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1212330-094a-498e-9d9c-2545848aa1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:29.785598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 963/1935] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:29 2022] DELETE /identity/v3/users/ae4ede6db32a4c8bb95318f75e780672 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:29.786619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:29.788719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:29.828643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c1212330-094a-498e-9d9c-2545848aa1bf None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:29.830533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c1212330-094a-498e-9d9c-2545848aa1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:29.935407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89b7ea-aa01-4a7b-9560-9f9a2ecc01a4 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:29.937592 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 973/1936] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:29.939281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5c5ad-6986-4c76-b6ad-cd5062835f99 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:29.939281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5c5ad-6986-4c76-b6ad-cd5062835f99 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:29.939571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5c5ad-6986-4c76-b6ad-cd5062835f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:29.948351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd63612-57b1-45a3-8d96-71dd8b8cb38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:29.949150 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd63612-57b1-45a3-8d96-71dd8b8cb38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:29.949532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd63612-57b1-45a3-8d96-71dd8b8cb38f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:29.951252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd63612-57b1-45a3-8d96-71dd8b8cb38f admin admin] PATH_INFO: `/v3/users/e43396ad439641f280b44e500c00a665` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:29.953663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd63612-57b1-45a3-8d96-71dd8b8cb38f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43396ad439641f280b44e500c00a665)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:29.956469 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd63612-57b1-45a3-8d96-71dd8b8cb38f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:29.965299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-d6d5c5ad-6986-4c76-b6ad-cd5062835f99 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:29.967110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d6d5c5ad-6986-4c76-b6ad-cd5062835f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:29.975064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 974/1937] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:29.975933 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5c5ad-6986-4c76-b6ad-cd5062835f99 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:29.978843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d6d5c5ad-6986-4c76-b6ad-cd5062835f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:29.998465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:30.030828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fbd63612-57b1-45a3-8d96-71dd8b8cb38f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43396ad439641f280b44e500c00a665'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:30.031569 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fbd63612-57b1-45a3-8d96-71dd8b8cb38f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43396ad439641f280b44e500c00a665'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:30.039026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fbd63612-57b1-45a3-8d96-71dd8b8cb38f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43396ad439641f280b44e500c00a665'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:30.040079 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fbd63612-57b1-45a3-8d96-71dd8b8cb38f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43396ad439641f280b44e500c00a665'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:30.054684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fbd63612-57b1-45a3-8d96-71dd8b8cb38f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43396ad439641f280b44e500c00a665'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:30.057119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5c5ad-6986-4c76-b6ad-cd5062835f99 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:30.062019 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93970f92-7cf6-40a9-a02a-6b7f53777812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:30.062849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93970f92-7cf6-40a9-a02a-6b7f53777812 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:30.063318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93970f92-7cf6-40a9-a02a-6b7f53777812 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:30.063595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93970f92-7cf6-40a9-a02a-6b7f53777812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:30.065367 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-93970f92-7cf6-40a9-a02a-6b7f53777812 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:30.068729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 964/1938] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:29 2022] DELETE /identity/v3/users/e43396ad439641f280b44e500c00a665 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:30.070478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372906bc-bc12-4e4a-be4d-9210d7c030ac None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:30.070478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372906bc-bc12-4e4a-be4d-9210d7c030ac None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:30.070730 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372906bc-bc12-4e4a-be4d-9210d7c030ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:30.102557 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-372906bc-bc12-4e4a-be4d-9210d7c030ac None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:30.103931 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-372906bc-bc12-4e4a-be4d-9210d7c030ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:30.146103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:30.168451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93970f92-7cf6-40a9-a02a-6b7f53777812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:30.170362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93970f92-7cf6-40a9-a02a-6b7f53777812 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:30.194285 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 975/1939] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:30.195226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93970f92-7cf6-40a9-a02a-6b7f53777812 service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:30.196737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-93970f92-7cf6-40a9-a02a-6b7f53777812 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:30.233881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 965/1940] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:30.241242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372906bc-bc12-4e4a-be4d-9210d7c030ac None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:30.260606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372906bc-bc12-4e4a-be4d-9210d7c030ac None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:30.277197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c968b-a5fa-4d44-8e7d-863db06a0ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:30.277836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c968b-a5fa-4d44-8e7d-863db06a0ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:30.279268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c968b-a5fa-4d44-8e7d-863db06a0ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:30.280204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c968b-a5fa-4d44-8e7d-863db06a0ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:30.281419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c968b-a5fa-4d44-8e7d-863db06a0ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:30.281419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c968b-a5fa-4d44-8e7d-863db06a0ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:30.285402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c968b-a5fa-4d44-8e7d-863db06a0ef7 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:30.303567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93970f92-7cf6-40a9-a02a-6b7f53777812 service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:30.322188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 966/1941] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:30.323180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c968b-a5fa-4d44-8e7d-863db06a0ef7 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:30.347193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c968b-a5fa-4d44-8e7d-863db06a0ef7 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:30.358119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe9830-4bac-4298-9a42-49929264703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:30.360502 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe9830-4bac-4298-9a42-49929264703e admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:30.360838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe9830-4bac-4298-9a42-49929264703e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:30.361115 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe9830-4bac-4298-9a42-49929264703e admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:30.361770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe9830-4bac-4298-9a42-49929264703e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:30.367550 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe9830-4bac-4298-9a42-49929264703e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:30.419689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6b5a6-cf66-44b6-b297-652a03ccfeeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:30.423137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6b5a6-cf66-44b6-b297-652a03ccfeeb service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:30.424023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6b5a6-cf66-44b6-b297-652a03ccfeeb service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:30.426432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6b5a6-cf66-44b6-b297-652a03ccfeeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:30.431013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d1d6b5a6-cf66-44b6-b297-652a03ccfeeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:30.433695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 967/1942] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:30 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:30.442246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe9830-4bac-4298-9a42-49929264703e admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:30.474127 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6b5a6-cf66-44b6-b297-652a03ccfeeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:30.482656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6b5a6-cf66-44b6-b297-652a03ccfeeb service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:30.517736 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 976/1943] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:30.606017 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe9830-4bac-4298-9a42-49929264703e admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:30.612601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778adae6-0180-4796-bcd3-7d064dcb39b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:30.613231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778adae6-0180-4796-bcd3-7d064dcb39b1 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:30.613510 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778adae6-0180-4796-bcd3-7d064dcb39b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:30.613932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778adae6-0180-4796-bcd3-7d064dcb39b1 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:30.614647 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778adae6-0180-4796-bcd3-7d064dcb39b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:30.616596 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778adae6-0180-4796-bcd3-7d064dcb39b1 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:30.631178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:30.647006 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6b5a6-cf66-44b6-b297-652a03ccfeeb service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:30.649465 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d1d6b5a6-cf66-44b6-b297-652a03ccfeeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:30.667966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 968/1944] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:30 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:30.669575 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778adae6-0180-4796-bcd3-7d064dcb39b1 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:30.671210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6b5a6-cf66-44b6-b297-652a03ccfeeb service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:30.727763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778adae6-0180-4796-bcd3-7d064dcb39b1 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:30.737305 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:30.737605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f645e04-36fe-46e4-a8f2-94c1047ddb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:30.738480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f645e04-36fe-46e4-a8f2-94c1047ddb26 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:30.738987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f645e04-36fe-46e4-a8f2-94c1047ddb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:30.739091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:30.739375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:30.739656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752 admin admin] PATH_INFO: `/v3/projects/10c280f1aa384350b28364ee58f83833` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:30.740645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f645e04-36fe-46e4-a8f2-94c1047ddb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:30.741513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f645e04-36fe-46e4-a8f2-94c1047ddb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:30.743833 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f645e04-36fe-46e4-a8f2-94c1047ddb26 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:30.748045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c280f1aa384350b28364ee58f83833)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:30.755186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:30.786349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 969/1945] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:30.793584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f645e04-36fe-46e4-a8f2-94c1047ddb26 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:30.818820 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f645e04-36fe-46e4-a8f2-94c1047ddb26 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:30.834891 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc811b10-7bde-4601-a60a-5c34ace3fb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:30.835820 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc811b10-7bde-4601-a60a-5c34ace3fb52 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:30.836306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc811b10-7bde-4601-a60a-5c34ace3fb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:30.836862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc811b10-7bde-4601-a60a-5c34ace3fb52 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:30.837744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc811b10-7bde-4601-a60a-5c34ace3fb52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:30.843700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c280f1aa384350b28364ee58f83833', 'request_id': 'req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:30.844277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc811b10-7bde-4601-a60a-5c34ace3fb52 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:30.851478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c280f1aa384350b28364ee58f83833', 'request_id': 'req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:30.862925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c280f1aa384350b28364ee58f83833', 'request_id': 'req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:30.863287 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 970/1946] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:30.867733 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc811b10-7bde-4601-a60a-5c34ace3fb52 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:30.880036 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752 admin admin] The token cache is being invalidate because project 10c280f1aa384350b28364ee58f83833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:30.880324 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:30.880992 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c3c1e41b-8c2f-47e2-8f90-8138f51d0752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:30.882021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc811b10-7bde-4601-a60a-5c34ace3fb52 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:30.887179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 977/1947] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:30 2022] DELETE /identity/v3/projects/10c280f1aa384350b28364ee58f83833 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:30.889142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0baa25-dee1-484d-8c1e-88d9e2270bbb None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:30.889431 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0baa25-dee1-484d-8c1e-88d9e2270bbb None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:30.889706 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0baa25-dee1-484d-8c1e-88d9e2270bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:30.915546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-0c0baa25-dee1-484d-8c1e-88d9e2270bbb None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:30.918255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0c0baa25-dee1-484d-8c1e-88d9e2270bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:30.948339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:30.964615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100b9a7-e3db-4f67-98d4-8bab05561568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:30.965195 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100b9a7-e3db-4f67-98d4-8bab05561568 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:30.965974 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100b9a7-e3db-4f67-98d4-8bab05561568 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:30.966252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100b9a7-e3db-4f67-98d4-8bab05561568 admin admin] PATH_INFO: `/v3/projects/372f0637564b4df88d610afea4585f3b/users/4d384eabb6b14736bf9b89e28f682b21/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:30.986421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100b9a7-e3db-4f67-98d4-8bab05561568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=372f0637564b4df88d610afea4585f3b, user_id=4d384eabb6b14736bf9b89e28f682b21, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:30.989704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100b9a7-e3db-4f67-98d4-8bab05561568 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.006286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 971/1948] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:30 2022] PUT /identity/v3/projects/372f0637564b4df88d610afea4585f3b/users/4d384eabb6b14736bf9b89e28f682b21/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:31.011452 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100b9a7-e3db-4f67-98d4-8bab05561568 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.016915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8100b9a7-e3db-4f67-98d4-8bab05561568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:31.023423 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 978/1949] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:31.024593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a63b4-5469-40fd-b5ce-cd7f53d2ac72 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.024880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a63b4-5469-40fd-b5ce-cd7f53d2ac72 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.025170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a63b4-5469-40fd-b5ce-cd7f53d2ac72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.056435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-eb4a63b4-5469-40fd-b5ce-cd7f53d2ac72 None None] MFA Rules not processed for user `4d384eabb6b14736bf9b89e28f682b21`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:31.057678 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-eb4a63b4-5469-40fd-b5ce-cd7f53d2ac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:31.097513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100b9a7-e3db-4f67-98d4-8bab05561568 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.103100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:31.103573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.104432 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.104432 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] PATH_INFO: `/v3/projects/91ec7d65f49e4a44b6d74d9f69d44603` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.106959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ec7d65f49e4a44b6d74d9f69d44603)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:31.109431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.141035 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 979/1950] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:31.142286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb44b87-8aa5-4b76-bcab-e1f8d4f11670 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.142616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb44b87-8aa5-4b76-bcab-e1f8d4f11670 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.143014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb44b87-8aa5-4b76-bcab-e1f8d4f11670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.160973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ec7d65f49e4a44b6d74d9f69d44603', 'request_id': 'req-b50c901e-f75f-4234-80d6-a7adc181e5f8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:31.163709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-6bb44b87-8aa5-4b76-bcab-e1f8d4f11670 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:31.164917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6bb44b87-8aa5-4b76-bcab-e1f8d4f11670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:31.167900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ec7d65f49e4a44b6d74d9f69d44603', 'request_id': 'req-b50c901e-f75f-4234-80d6-a7adc181e5f8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:31.170257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:31.177508 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ec7d65f49e4a44b6d74d9f69d44603', 'request_id': 'req-b50c901e-f75f-4234-80d6-a7adc181e5f8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:31.189920 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] The token cache is being invalidate because project 91ec7d65f49e4a44b6d74d9f69d44603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:31.190220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:31.190958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:31.192615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 972/1951] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:31 2022] DELETE /identity/v3/projects/91ec7d65f49e4a44b6d74d9f69d44603 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:31.193360 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.194661 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:31.249326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 980/1952] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:31.250737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb44b87-8aa5-4b76-bcab-e1f8d4f11670 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.253334 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6bb44b87-8aa5-4b76-bcab-e1f8d4f11670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:31.268358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb44b87-8aa5-4b76-bcab-e1f8d4f11670 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.273436 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:31.274277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.274780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.275195 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] PATH_INFO: `/v3/users/b5d1eaef58834cc29412e3672b9f2edc` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.277013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d1eaef58834cc29412e3672b9f2edc)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:31.280090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.284934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c901e-f75f-4234-80d6-a7adc181e5f8 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.290535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d4147-cd65-41d8-9cfb-f12a375de001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:31.291264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d4147-cd65-41d8-9cfb-f12a375de001 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.291617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d4147-cd65-41d8-9cfb-f12a375de001 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.291981 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d4147-cd65-41d8-9cfb-f12a375de001 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.292686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d4147-cd65-41d8-9cfb-f12a375de001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:31.294756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d4147-cd65-41d8-9cfb-f12a375de001 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.324737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 973/1953] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:31 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:31.326128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d4147-cd65-41d8-9cfb-f12a375de001 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.336621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d1eaef58834cc29412e3672b9f2edc'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:31.337297 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d1eaef58834cc29412e3672b9f2edc'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:31.338653 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:31.349443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d1eaef58834cc29412e3672b9f2edc'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:31.358201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d1eaef58834cc29412e3672b9f2edc'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:31.358954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d1eaef58834cc29412e3672b9f2edc'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:31.388349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 981/1954] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:31 2022] DELETE /identity/v3/users/b5d1eaef58834cc29412e3672b9f2edc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:31.389347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.390706 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:31.399877 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d4147-cd65-41d8-9cfb-f12a375de001 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.467320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad1897-b84e-4f3b-8a9c-83273db09849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:31.467988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad1897-b84e-4f3b-8a9c-83273db09849 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.468275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad1897-b84e-4f3b-8a9c-83273db09849 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.468534 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad1897-b84e-4f3b-8a9c-83273db09849 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.469188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad1897-b84e-4f3b-8a9c-83273db09849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:31.469732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad1897-b84e-4f3b-8a9c-83273db09849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:31.471762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad1897-b84e-4f3b-8a9c-83273db09849 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.475774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5f6a5-8c39-45e5-a689-fd724ed56794 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.481357 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a7ace-3d6c-49bd-adda-9ad8eb8479e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:31.481969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a7ace-3d6c-49bd-adda-9ad8eb8479e2 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.482243 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a7ace-3d6c-49bd-adda-9ad8eb8479e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.482528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a7ace-3d6c-49bd-adda-9ad8eb8479e2 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.484959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 974/1955] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:31.485453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a7ace-3d6c-49bd-adda-9ad8eb8479e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:31.487590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a7ace-3d6c-49bd-adda-9ad8eb8479e2 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.489392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad1897-b84e-4f3b-8a9c-83273db09849 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.493419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-faad1897-b84e-4f3b-8a9c-83273db09849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:31.508140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad1897-b84e-4f3b-8a9c-83273db09849 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.513410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaed87-be69-4dea-a403-02a49a5be307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:31.514023 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaed87-be69-4dea-a403-02a49a5be307 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.514300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaed87-be69-4dea-a403-02a49a5be307 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.514602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaed87-be69-4dea-a403-02a49a5be307 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.515244 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aaed87-be69-4dea-a403-02a49a5be307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:31.518556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 982/1956] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:31 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:31.518705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aaed87-be69-4dea-a403-02a49a5be307 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.521108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a7ace-3d6c-49bd-adda-9ad8eb8479e2 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.530644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:31.534434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a7ace-3d6c-49bd-adda-9ad8eb8479e2 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.541550 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce24ce-a444-4418-b1dc-3800654d9e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:31.542376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce24ce-a444-4418-b1dc-3800654d9e1f admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.542687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce24ce-a444-4418-b1dc-3800654d9e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.542993 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce24ce-a444-4418-b1dc-3800654d9e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.543956 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce24ce-a444-4418-b1dc-3800654d9e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:31.545935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce24ce-a444-4418-b1dc-3800654d9e1f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.557318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 975/1957] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:31 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:35:31.558591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 983/1958] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:31.559548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaed87-be69-4dea-a403-02a49a5be307 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.563495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce24ce-a444-4418-b1dc-3800654d9e1f admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.576517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce24ce-a444-4418-b1dc-3800654d9e1f admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.633944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaed87-be69-4dea-a403-02a49a5be307 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.643488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97043206-be25-4830-84ce-f3c46f47f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:31.644183 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97043206-be25-4830-84ce-f3c46f47f6a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.644659 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97043206-be25-4830-84ce-f3c46f47f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.644945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97043206-be25-4830-84ce-f3c46f47f6a6 admin admin] PATH_INFO: `/v3/projects/2eaaa8c6f5ea41589bc436611fe8f814/users/d7216c831cf548d0a2cfa370f10351b3/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.646467 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba6c6e-78a3-4878-a72c-deac7a3f827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:31.647224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba6c6e-78a3-4878-a72c-deac7a3f827b admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.647563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba6c6e-78a3-4878-a72c-deac7a3f827b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.647892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba6c6e-78a3-4878-a72c-deac7a3f827b admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.649078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba6c6e-78a3-4878-a72c-deac7a3f827b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:31.652204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba6c6e-78a3-4878-a72c-deac7a3f827b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.667266 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97043206-be25-4830-84ce-f3c46f47f6a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eaaa8c6f5ea41589bc436611fe8f814, user_id=d7216c831cf548d0a2cfa370f10351b3, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:31.670920 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97043206-be25-4830-84ce-f3c46f47f6a6 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.682774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 976/1959] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:31 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:31.686034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba6c6e-78a3-4878-a72c-deac7a3f827b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.694549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 984/1960] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:31 2022] PUT /identity/v3/projects/2eaaa8c6f5ea41589bc436611fe8f814/users/d7216c831cf548d0a2cfa370f10351b3/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:31.695913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97043206-be25-4830-84ce-f3c46f47f6a6 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.708029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba6c6e-78a3-4878-a72c-deac7a3f827b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.734281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:31.773264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97043206-be25-4830-84ce-f3c46f47f6a6 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.776556 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9573a3-c017-49ae-ab56-73eb3873d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:31.777445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9573a3-c017-49ae-ab56-73eb3873d1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.777870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9573a3-c017-49ae-ab56-73eb3873d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.778017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708431c0-cb89-4660-8fa7-882cf113a7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:31.778436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9573a3-c017-49ae-ab56-73eb3873d1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.778618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708431c0-cb89-4660-8fa7-882cf113a7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.778905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708431c0-cb89-4660-8fa7-882cf113a7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.779177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708431c0-cb89-4660-8fa7-882cf113a7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.779822 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708431c0-cb89-4660-8fa7-882cf113a7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:31.779968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9573a3-c017-49ae-ab56-73eb3873d1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:31.781457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708431c0-cb89-4660-8fa7-882cf113a7e5 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.782029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9573a3-c017-49ae-ab56-73eb3873d1c1 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.795252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 985/1961] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:31.796362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708431c0-cb89-4660-8fa7-882cf113a7e5 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.806322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 977/1962] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:31.807497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9573a3-c017-49ae-ab56-73eb3873d1c1 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.810179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2f9573a3-c017-49ae-ab56-73eb3873d1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:31.810919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708431c0-cb89-4660-8fa7-882cf113a7e5 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.822668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3254f-92ad-4e4b-af0d-58c1e574d9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:31.823632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3254f-92ad-4e4b-af0d-58c1e574d9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.823915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3254f-92ad-4e4b-af0d-58c1e574d9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.824186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3254f-92ad-4e4b-af0d-58c1e574d9a1 admin admin] PATH_INFO: `/v3/projects/2eaaa8c6f5ea41589bc436611fe8f814/users/d7216c831cf548d0a2cfa370f10351b3/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.829117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3254f-92ad-4e4b-af0d-58c1e574d9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eaaa8c6f5ea41589bc436611fe8f814, user_id=d7216c831cf548d0a2cfa370f10351b3, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:31.841393 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3254f-92ad-4e4b-af0d-58c1e574d9a1 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.843234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9573a3-c017-49ae-ab56-73eb3873d1c1 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.861633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b3140-0c21-464c-94e6-90e7691acb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:31.862336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3140-0c21-464c-94e6-90e7691acb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:31.862578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3140-0c21-464c-94e6-90e7691acb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:31.862858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3140-0c21-464c-94e6-90e7691acb7b admin admin] PATH_INFO: `/v3/projects/a90710f605a84641bc3f45b54a7bd0c0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:31.864648 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 986/1963] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:31 2022] PUT /identity/v3/projects/2eaaa8c6f5ea41589bc436611fe8f814/users/d7216c831cf548d0a2cfa370f10351b3/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:31.867717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3254f-92ad-4e4b-af0d-58c1e574d9a1 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:31.869451 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b3140-0c21-464c-94e6-90e7691acb7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90710f605a84641bc3f45b54a7bd0c0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:31.872336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b3140-0c21-464c-94e6-90e7691acb7b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:31.950863 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-397b3140-0c21-464c-94e6-90e7691acb7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90710f605a84641bc3f45b54a7bd0c0', 'request_id': 'req-397b3140-0c21-464c-94e6-90e7691acb7b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:31.960188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-397b3140-0c21-464c-94e6-90e7691acb7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90710f605a84641bc3f45b54a7bd0c0', 'request_id': 'req-397b3140-0c21-464c-94e6-90e7691acb7b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:31.977699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-397b3140-0c21-464c-94e6-90e7691acb7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90710f605a84641bc3f45b54a7bd0c0', 'request_id': 'req-397b3140-0c21-464c-94e6-90e7691acb7b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:31.977945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3254f-92ad-4e4b-af0d-58c1e574d9a1 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:31.991849 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:31.999484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-397b3140-0c21-464c-94e6-90e7691acb7b admin admin] The token cache is being invalidate because project a90710f605a84641bc3f45b54a7bd0c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:32.000427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-397b3140-0c21-464c-94e6-90e7691acb7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:32.002355 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-397b3140-0c21-464c-94e6-90e7691acb7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:32.004586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 978/1964] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:31 2022] DELETE /identity/v3/projects/a90710f605a84641bc3f45b54a7bd0c0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:32.006468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab98a-28da-4b4e-9269-bbb436e621d9 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.006845 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab98a-28da-4b4e-9269-bbb436e621d9 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.007466 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab98a-28da-4b4e-9269-bbb436e621d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.057675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-06eab98a-28da-4b4e-9269-bbb436e621d9 None None] MFA Rules not processed for user `d7216c831cf548d0a2cfa370f10351b3`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:32.061781 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-06eab98a-28da-4b4e-9269-bbb436e621d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:32.076363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be203dc4-6176-4411-88cd-4a9fb0807768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:32.077218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be203dc4-6176-4411-88cd-4a9fb0807768 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.077637 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be203dc4-6176-4411-88cd-4a9fb0807768 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.077934 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be203dc4-6176-4411-88cd-4a9fb0807768 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.078710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be203dc4-6176-4411-88cd-4a9fb0807768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:32.081140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be203dc4-6176-4411-88cd-4a9fb0807768 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:32.097153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 987/1965] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:32.098621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac49af2-328f-4805-9805-6fe22a3658c0 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.099008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac49af2-328f-4805-9805-6fe22a3658c0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.099382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac49af2-328f-4805-9805-6fe22a3658c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.123320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-1ac49af2-328f-4805-9805-6fe22a3658c0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:32.125454 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1ac49af2-328f-4805-9805-6fe22a3658c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:32.163126 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 979/1966] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:32.166651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eab98a-28da-4b4e-9269-bbb436e621d9 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:32.167740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-06eab98a-28da-4b4e-9269-bbb436e621d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:32.175655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 988/1967] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:32.177115 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c9319-7ae0-4420-9709-2ed29b604d7b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.177399 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c9319-7ae0-4420-9709-2ed29b604d7b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.177666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c9319-7ae0-4420-9709-2ed29b604d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.195846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eab98a-28da-4b4e-9269-bbb436e621d9 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:32.202063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66823505-d840-47b1-b239-365f55037280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:32.202821 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66823505-d840-47b1-b239-365f55037280 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.203089 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66823505-d840-47b1-b239-365f55037280 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.203731 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66823505-d840-47b1-b239-365f55037280 admin admin] PATH_INFO: `/v3/projects/98c9639b46154b1497a2969a1de8ad9a/users/10e3f576882845939a4aa708b9bd3269/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.215281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c85c9319-7ae0-4420-9709-2ed29b604d7b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:32.217099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c85c9319-7ae0-4420-9709-2ed29b604d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:32.221949 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66823505-d840-47b1-b239-365f55037280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c9639b46154b1497a2969a1de8ad9a, user_id=10e3f576882845939a4aa708b9bd3269, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:32.224647 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66823505-d840-47b1-b239-365f55037280 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:32.228627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 989/1968] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:32.228627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c9319-7ae0-4420-9709-2ed29b604d7b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:32.228627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c85c9319-7ae0-4420-9709-2ed29b604d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:32.243233 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 980/1969] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:32 2022] PUT /identity/v3/projects/98c9639b46154b1497a2969a1de8ad9a/users/10e3f576882845939a4aa708b9bd3269/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:32.244223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66823505-d840-47b1-b239-365f55037280 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:32.276648 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:32.296650 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c9319-7ae0-4420-9709-2ed29b604d7b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:32.322030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66823505-d840-47b1-b239-365f55037280 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:32.327937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98263d9-2444-4307-8a36-1dd502c6715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:32.329400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98263d9-2444-4307-8a36-1dd502c6715b admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.329751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98263d9-2444-4307-8a36-1dd502c6715b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.331102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98263d9-2444-4307-8a36-1dd502c6715b admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.331786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98263d9-2444-4307-8a36-1dd502c6715b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:32.332099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98263d9-2444-4307-8a36-1dd502c6715b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:32.333736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98263d9-2444-4307-8a36-1dd502c6715b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:32.349866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 981/1970] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:32.349866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68e6ee-d234-4d4b-8de3-9db10a18fac0 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.349866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68e6ee-d234-4d4b-8de3-9db10a18fac0 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.349866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68e6ee-d234-4d4b-8de3-9db10a18fac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.373522 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e64592-0f4d-47e1-a9d0-b9b4c96b9c5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:32.374818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e64592-0f4d-47e1-a9d0-b9b4c96b9c5c service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.375500 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e64592-0f4d-47e1-a9d0-b9b4c96b9c5c service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.375938 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e64592-0f4d-47e1-a9d0-b9b4c96b9c5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.393606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-eb68e6ee-d234-4d4b-8de3-9db10a18fac0 None None] MFA Rules not processed for user `10e3f576882845939a4aa708b9bd3269`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:32.394884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-eb68e6ee-d234-4d4b-8de3-9db10a18fac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:32.483626 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:32.509862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e64592-0f4d-47e1-a9d0-b9b4c96b9c5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:32.514638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 982/1971] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:32.514638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68e6ee-d234-4d4b-8de3-9db10a18fac0 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:32.517441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e64592-0f4d-47e1-a9d0-b9b4c96b9c5c service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:32.533673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68e6ee-d234-4d4b-8de3-9db10a18fac0 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:32.537309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 990/1972] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:32.537939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e64592-0f4d-47e1-a9d0-b9b4c96b9c5c service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:32.540071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-78e64592-0f4d-47e1-a9d0-b9b4c96b9c5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:32.543655 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8ee7e-abc4-41e3-8c67-d2b667c81c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:32.544810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8ee7e-abc4-41e3-8c67-d2b667c81c41 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.545923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8ee7e-abc4-41e3-8c67-d2b667c81c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.546612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8ee7e-abc4-41e3-8c67-d2b667c81c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.547887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8ee7e-abc4-41e3-8c67-d2b667c81c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:32.550612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8ee7e-abc4-41e3-8c67-d2b667c81c41 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:32.554258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e64592-0f4d-47e1-a9d0-b9b4c96b9c5c service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:32.562262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90524b9-7d5d-44a1-86a9-87b965011448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:32.564220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90524b9-7d5d-44a1-86a9-87b965011448 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.567115 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90524b9-7d5d-44a1-86a9-87b965011448 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.567469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90524b9-7d5d-44a1-86a9-87b965011448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.586303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90524b9-7d5d-44a1-86a9-87b965011448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:32.588669 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90524b9-7d5d-44a1-86a9-87b965011448 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:32.600730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 991/1973] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:32.624310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 983/1974] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:32 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:32.625387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90524b9-7d5d-44a1-86a9-87b965011448 service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:32.639958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8ee7e-abc4-41e3-8c67-d2b667c81c41 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:32.647162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90524b9-7d5d-44a1-86a9-87b965011448 service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:32.758916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34938e9e-bf53-4d8b-a924-6222810aad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:32.759759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938e9e-bf53-4d8b-a924-6222810aad22 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.765290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938e9e-bf53-4d8b-a924-6222810aad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.765290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938e9e-bf53-4d8b-a924-6222810aad22 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.765290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34938e9e-bf53-4d8b-a924-6222810aad22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:32.765547 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34938e9e-bf53-4d8b-a924-6222810aad22 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:32.775357 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8ee7e-abc4-41e3-8c67-d2b667c81c41 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:32.781837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dafae-b169-42ac-bd8d-70154fa37cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:32.782592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dafae-b169-42ac-bd8d-70154fa37cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.782962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dafae-b169-42ac-bd8d-70154fa37cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.783306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dafae-b169-42ac-bd8d-70154fa37cc2 admin admin] PATH_INFO: `/v3/users/10e3f576882845939a4aa708b9bd3269` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.784986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dafae-b169-42ac-bd8d-70154fa37cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e3f576882845939a4aa708b9bd3269)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:32.787762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dafae-b169-42ac-bd8d-70154fa37cc2 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:32.796626 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 992/1975] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:32 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:35:32.801249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34938e9e-bf53-4d8b-a924-6222810aad22 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:32.813276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34938e9e-bf53-4d8b-a924-6222810aad22 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:32.823076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7293e1-6ae0-4156-97ea-faf7b1db58d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:32.824300 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7293e1-6ae0-4156-97ea-faf7b1db58d7 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.824654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7293e1-6ae0-4156-97ea-faf7b1db58d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.825027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7293e1-6ae0-4156-97ea-faf7b1db58d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.825861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7293e1-6ae0-4156-97ea-faf7b1db58d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:32.827900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7293e1-6ae0-4156-97ea-faf7b1db58d7 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:32.846180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 993/1976] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:32.850571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7293e1-6ae0-4156-97ea-faf7b1db58d7 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:32.864830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7293e1-6ae0-4156-97ea-faf7b1db58d7 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:32.869653 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4b4dafae-b169-42ac-bd8d-70154fa37cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e3f576882845939a4aa708b9bd3269'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:32.870439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4b4dafae-b169-42ac-bd8d-70154fa37cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e3f576882845939a4aa708b9bd3269'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:32.874269 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab6902-17d1-4cb1-810b-ef8969652a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:32.875032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab6902-17d1-4cb1-810b-ef8969652a22 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.875315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab6902-17d1-4cb1-810b-ef8969652a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.875582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab6902-17d1-4cb1-810b-ef8969652a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.877318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab6902-17d1-4cb1-810b-ef8969652a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:32.879123 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab6902-17d1-4cb1-810b-ef8969652a22 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:32.894074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4b4dafae-b169-42ac-bd8d-70154fa37cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e3f576882845939a4aa708b9bd3269'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:32.895053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:32.895856 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4b4dafae-b169-42ac-bd8d-70154fa37cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e3f576882845939a4aa708b9bd3269'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:32.919101 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 994/1977] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:32.921244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab6902-17d1-4cb1-810b-ef8969652a22 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:32.926833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8cab6902-17d1-4cb1-810b-ef8969652a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:32.931230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4b4dafae-b169-42ac-bd8d-70154fa37cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e3f576882845939a4aa708b9bd3269'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:32.979203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab6902-17d1-4cb1-810b-ef8969652a22 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:32.989037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 984/1978] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:32 2022] DELETE /identity/v3/users/10e3f576882845939a4aa708b9bd3269 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:32.994184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095bd0c-c01f-457f-8d1e-6dd1bf6cf69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:32.995518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea36a4-157d-465f-bbe7-6f45489a2488 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:32.995806 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea36a4-157d-465f-bbe7-6f45489a2488 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:32.996104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea36a4-157d-465f-bbe7-6f45489a2488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:32.999424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095bd0c-c01f-457f-8d1e-6dd1bf6cf69b admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:33.000132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095bd0c-c01f-457f-8d1e-6dd1bf6cf69b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:33.002066 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095bd0c-c01f-457f-8d1e-6dd1bf6cf69b admin admin] PATH_INFO: `/v3/projects/18246368c10c473fb0a36c55eecae9a0/users/79f5938295bc4dd1b37ca72464f4a533/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:33.021690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-2bea36a4-157d-465f-bbe7-6f45489a2488 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:33.023079 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2bea36a4-157d-465f-bbe7-6f45489a2488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:33.070977 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095bd0c-c01f-457f-8d1e-6dd1bf6cf69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=18246368c10c473fb0a36c55eecae9a0, user_id=79f5938295bc4dd1b37ca72464f4a533, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:33.075551 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095bd0c-c01f-457f-8d1e-6dd1bf6cf69b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:33.077081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:33.129776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 985/1980] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:33.130443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 995/1980] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:32 2022] PUT /identity/v3/projects/18246368c10c473fb0a36c55eecae9a0/users/79f5938295bc4dd1b37ca72464f4a533/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:33.136940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f4699-ce86-4017-a043-ed4ab8339d3a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:33.137218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f4699-ce86-4017-a043-ed4ab8339d3a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:33.137551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f4699-ce86-4017-a043-ed4ab8339d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:33.141272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095bd0c-c01f-457f-8d1e-6dd1bf6cf69b admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:33.144411 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f095bd0c-c01f-457f-8d1e-6dd1bf6cf69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:33.179861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-cb7f4699-ce86-4017-a043-ed4ab8339d3a None None] MFA Rules not processed for user `79f5938295bc4dd1b37ca72464f4a533`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:33.192916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-cb7f4699-ce86-4017-a043-ed4ab8339d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:33.270276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095bd0c-c01f-457f-8d1e-6dd1bf6cf69b admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:33.274211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec05a93-33dc-4d7a-983e-b48a8fd380b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:33.274853 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec05a93-33dc-4d7a-983e-b48a8fd380b7 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:33.275319 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec05a93-33dc-4d7a-983e-b48a8fd380b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:33.276048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec05a93-33dc-4d7a-983e-b48a8fd380b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:33.323213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 986/1981] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:33.324350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f4699-ce86-4017-a043-ed4ab8339d3a None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:33.400754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec05a93-33dc-4d7a-983e-b48a8fd380b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:33.403291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec05a93-33dc-4d7a-983e-b48a8fd380b7 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:33.431146 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f4699-ce86-4017-a043-ed4ab8339d3a None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:33.439583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 996/1982] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:35:33.449841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1f612-2d3e-4171-a43b-17c893749159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:33.451560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f612-2d3e-4171-a43b-17c893749159 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:33.452030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f612-2d3e-4171-a43b-17c893749159 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:33.452474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f612-2d3e-4171-a43b-17c893749159 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:33.454306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1f612-2d3e-4171-a43b-17c893749159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:33.465633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1f612-2d3e-4171-a43b-17c893749159 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:33.531977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 987/1983] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:33 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:33.535502 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec05a93-33dc-4d7a-983e-b48a8fd380b7 service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:33.550718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec05a93-33dc-4d7a-983e-b48a8fd380b7 service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:33.660917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca4193-ef91-40d7-92c3-11594e9ccb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:33.661846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca4193-ef91-40d7-92c3-11594e9ccb85 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:33.662271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca4193-ef91-40d7-92c3-11594e9ccb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:33.662764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca4193-ef91-40d7-92c3-11594e9ccb85 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:33.663548 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca4193-ef91-40d7-92c3-11594e9ccb85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:33.665954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca4193-ef91-40d7-92c3-11594e9ccb85 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:33.732651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 997/1984] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:33 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:33.732840 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1f612-2d3e-4171-a43b-17c893749159 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:33.749779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1f612-2d3e-4171-a43b-17c893749159 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:33.756131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3eb4bd-cb36-4394-9b19-6cd7a68661ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:33.756757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eb4bd-cb36-4394-9b19-6cd7a68661ec admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:33.757893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eb4bd-cb36-4394-9b19-6cd7a68661ec admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:33.758265 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eb4bd-cb36-4394-9b19-6cd7a68661ec admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:33.759029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3eb4bd-cb36-4394-9b19-6cd7a68661ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:33.764579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3eb4bd-cb36-4394-9b19-6cd7a68661ec admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:33.781988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 988/1985] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:33.787211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca4193-ef91-40d7-92c3-11594e9ccb85 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:33.808032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca4193-ef91-40d7-92c3-11594e9ccb85 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:33.815397 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e7051-0390-4d84-9c15-fc6fc12e8f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:33.816282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e7051-0390-4d84-9c15-fc6fc12e8f59 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:33.816802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e7051-0390-4d84-9c15-fc6fc12e8f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:33.816939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e7051-0390-4d84-9c15-fc6fc12e8f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:33.818097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e7051-0390-4d84-9c15-fc6fc12e8f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:33.821194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e7051-0390-4d84-9c15-fc6fc12e8f59 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:33.854499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 998/1986] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:33.855684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3eb4bd-cb36-4394-9b19-6cd7a68661ec admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:33.869889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3eb4bd-cb36-4394-9b19-6cd7a68661ec admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:33.884594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcf0f4-1f17-4a69-b4bc-f1a167edeb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:33.886303 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcf0f4-1f17-4a69-b4bc-f1a167edeb3b admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:33.887444 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcf0f4-1f17-4a69-b4bc-f1a167edeb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:33.888978 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcf0f4-1f17-4a69-b4bc-f1a167edeb3b admin admin] PATH_INFO: `/v3/projects/3d121b5e75da438da883d3ed9ceff9b4/users/f4be21ad550d431d89aa188df39ec248/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:33.917969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcf0f4-1f17-4a69-b4bc-f1a167edeb3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d121b5e75da438da883d3ed9ceff9b4, user_id=f4be21ad550d431d89aa188df39ec248, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:33.921423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcf0f4-1f17-4a69-b4bc-f1a167edeb3b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:33.933957 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e7051-0390-4d84-9c15-fc6fc12e8f59 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:33.936199 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e84e7051-0390-4d84-9c15-fc6fc12e8f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:33.944647 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 989/1987] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:33 2022] PUT /identity/v3/projects/3d121b5e75da438da883d3ed9ceff9b4/users/f4be21ad550d431d89aa188df39ec248/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:33.954879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcf0f4-1f17-4a69-b4bc-f1a167edeb3b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:33.956753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b6bcf0f4-1f17-4a69-b4bc-f1a167edeb3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:33.970162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:33.977480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e7051-0390-4d84-9c15-fc6fc12e8f59 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:34.002898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:34.078945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcf0f4-1f17-4a69-b4bc-f1a167edeb3b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:34.084192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46df1b-6712-4e33-ade8-699ff70205fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:34.084838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46df1b-6712-4e33-ade8-699ff70205fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:34.085650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46df1b-6712-4e33-ade8-699ff70205fc admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:34.085650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46df1b-6712-4e33-ade8-699ff70205fc admin admin] PATH_INFO: `/v3/users/4d384eabb6b14736bf9b89e28f682b21` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:34.086774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46df1b-6712-4e33-ade8-699ff70205fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d384eabb6b14736bf9b89e28f682b21)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:34.087651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cd4e4-f694-4c91-959a-633363aa0b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:34.088378 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cd4e4-f694-4c91-959a-633363aa0b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:34.088700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46df1b-6712-4e33-ade8-699ff70205fc admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:34.088831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cd4e4-f694-4c91-959a-633363aa0b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:34.089232 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cd4e4-f694-4c91-959a-633363aa0b0f admin admin] PATH_INFO: `/v3/projects/98c9639b46154b1497a2969a1de8ad9a` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:34.091727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cd4e4-f694-4c91-959a-633363aa0b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c9639b46154b1497a2969a1de8ad9a)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:34.093954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cd4e4-f694-4c91-959a-633363aa0b0f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:34.143808 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-eb46df1b-6712-4e33-ade8-699ff70205fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d384eabb6b14736bf9b89e28f682b21'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:34.144629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-eb46df1b-6712-4e33-ade8-699ff70205fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d384eabb6b14736bf9b89e28f682b21'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:34.157157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-eb46df1b-6712-4e33-ade8-699ff70205fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d384eabb6b14736bf9b89e28f682b21'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:34.158537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-eb46df1b-6712-4e33-ade8-699ff70205fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d384eabb6b14736bf9b89e28f682b21'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:34.159619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-182cd4e4-f694-4c91-959a-633363aa0b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c9639b46154b1497a2969a1de8ad9a', 'request_id': 'req-182cd4e4-f694-4c91-959a-633363aa0b0f'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:34.165916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-182cd4e4-f694-4c91-959a-633363aa0b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c9639b46154b1497a2969a1de8ad9a', 'request_id': 'req-182cd4e4-f694-4c91-959a-633363aa0b0f'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:34.175522 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-182cd4e4-f694-4c91-959a-633363aa0b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c9639b46154b1497a2969a1de8ad9a', 'request_id': 'req-182cd4e4-f694-4c91-959a-633363aa0b0f'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:34.176524 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-eb46df1b-6712-4e33-ade8-699ff70205fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d384eabb6b14736bf9b89e28f682b21'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:34.192791 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 990/1988] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:33 2022] DELETE /identity/v3/users/4d384eabb6b14736bf9b89e28f682b21 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:34.192791 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569b58c-7bbf-44c3-ae71-bab2bfd6f370 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:34.192791 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569b58c-7bbf-44c3-ae71-bab2bfd6f370 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:34.192791 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569b58c-7bbf-44c3-ae71-bab2bfd6f370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:34.193490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-182cd4e4-f694-4c91-959a-633363aa0b0f admin admin] The token cache is being invalidate because project 98c9639b46154b1497a2969a1de8ad9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:34.194024 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-182cd4e4-f694-4c91-959a-633363aa0b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:34.195170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-182cd4e4-f694-4c91-959a-633363aa0b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:34.198278 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 999/1989] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:33 2022] DELETE /identity/v3/projects/98c9639b46154b1497a2969a1de8ad9a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:34.199847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc594e-ddb9-4c3a-b624-8213a912ee29 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:34.200345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc594e-ddb9-4c3a-b624-8213a912ee29 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:34.200614 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc594e-ddb9-4c3a-b624-8213a912ee29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:34.226472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-52bc594e-ddb9-4c3a-b624-8213a912ee29 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:34.227840 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-52bc594e-ddb9-4c3a-b624-8213a912ee29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:34.237365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b569b58c-7bbf-44c3-ae71-bab2bfd6f370 None None] MFA Rules not processed for user `f4be21ad550d431d89aa188df39ec248`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:34.238888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b569b58c-7bbf-44c3-ae71-bab2bfd6f370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:34.306499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1000/1990] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:34.307853 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23566269-0032-44f9-8c83-efdd4ca4cb53 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:34.308145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23566269-0032-44f9-8c83-efdd4ca4cb53 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:34.308415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23566269-0032-44f9-8c83-efdd4ca4cb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:34.328757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 991/1991] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:34.329702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569b58c-7bbf-44c3-ae71-bab2bfd6f370 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:34.330339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-23566269-0032-44f9-8c83-efdd4ca4cb53 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:34.331297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b569b58c-7bbf-44c3-ae71-bab2bfd6f370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:34.332013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-23566269-0032-44f9-8c83-efdd4ca4cb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:34.340065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1001/1992] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:34.341432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23566269-0032-44f9-8c83-efdd4ca4cb53 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:34.342689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-23566269-0032-44f9-8c83-efdd4ca4cb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:34.354620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23566269-0032-44f9-8c83-efdd4ca4cb53 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:34.359228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2769d-fa64-4a53-957f-d32dcf62876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:34.360211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2769d-fa64-4a53-957f-d32dcf62876f admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:34.360211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2769d-fa64-4a53-957f-d32dcf62876f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:34.360411 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2769d-fa64-4a53-957f-d32dcf62876f admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:34.360984 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2769d-fa64-4a53-957f-d32dcf62876f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:34.362914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2769d-fa64-4a53-957f-d32dcf62876f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:34.369360 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:34.395461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569b58c-7bbf-44c3-ae71-bab2bfd6f370 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:34.396844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1002/1993] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:34 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:34.398263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14462120-1e1f-4a4a-912a-75b1ee9d6a3c None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:34.398785 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14462120-1e1f-4a4a-912a-75b1ee9d6a3c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:34.399231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14462120-1e1f-4a4a-912a-75b1ee9d6a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:34.415984 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:34.426696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-14462120-1e1f-4a4a-912a-75b1ee9d6a3c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:34.428583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-14462120-1e1f-4a4a-912a-75b1ee9d6a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:34.459674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053ef13-e06f-4956-bc71-1432ce941461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:34.460513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053ef13-e06f-4956-bc71-1432ce941461 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:34.460932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053ef13-e06f-4956-bc71-1432ce941461 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:34.461326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053ef13-e06f-4956-bc71-1432ce941461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:34.517227 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1003/1994] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:34.522544 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14462120-1e1f-4a4a-912a-75b1ee9d6a3c None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:34.535806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14462120-1e1f-4a4a-912a-75b1ee9d6a3c None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:34.541393 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379000a8-12a4-429e-b8e1-0ba220c549c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:34.542283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379000a8-12a4-429e-b8e1-0ba220c549c7 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:34.542640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379000a8-12a4-429e-b8e1-0ba220c549c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:34.542909 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379000a8-12a4-429e-b8e1-0ba220c549c7 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:34.544510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379000a8-12a4-429e-b8e1-0ba220c549c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:34.547919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379000a8-12a4-429e-b8e1-0ba220c549c7 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:34.548689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053ef13-e06f-4956-bc71-1432ce941461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:34.555472 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053ef13-e06f-4956-bc71-1432ce941461 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:34.569793 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 992/1995] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:34.570685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053ef13-e06f-4956-bc71-1432ce941461 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:34.583013 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053ef13-e06f-4956-bc71-1432ce941461 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:34.583887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1004/1996] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:34 2022] POST /identity/v3/users => generated 300 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:34.585607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379000a8-12a4-429e-b8e1-0ba220c549c7 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:34.588847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbbcbe-6c49-41f0-9a80-fdacb5e631dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:34.589453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbbcbe-6c49-41f0-9a80-fdacb5e631dc admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:34.590364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbbcbe-6c49-41f0-9a80-fdacb5e631dc admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:34.590719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbbcbe-6c49-41f0-9a80-fdacb5e631dc admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:34.591371 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbbcbe-6c49-41f0-9a80-fdacb5e631dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:34.591672 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbbcbe-6c49-41f0-9a80-fdacb5e631dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:34.594193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbbcbe-6c49-41f0-9a80-fdacb5e631dc admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:34.599662 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379000a8-12a4-429e-b8e1-0ba220c549c7 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:34.606894 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ebba3-20c2-4c35-9162-8253d1792ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:34.607759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebba3-20c2-4c35-9162-8253d1792ced admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:34.608177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebba3-20c2-4c35-9162-8253d1792ced admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:34.608587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebba3-20c2-4c35-9162-8253d1792ced admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:34.609762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 993/1997] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:34.610413 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ebba3-20c2-4c35-9162-8253d1792ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:34.612223 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ebba3-20c2-4c35-9162-8253d1792ced admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:34.614497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbbcbe-6c49-41f0-9a80-fdacb5e631dc admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:34.625847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbbcbe-6c49-41f0-9a80-fdacb5e631dc admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:34.632187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590007c-ad1c-40bb-bf13-1b2116659b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:34.632866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590007c-ad1c-40bb-bf13-1b2116659b9b admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:34.633153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590007c-ad1c-40bb-bf13-1b2116659b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:34.633834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590007c-ad1c-40bb-bf13-1b2116659b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:34.634395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590007c-ad1c-40bb-bf13-1b2116659b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:34.636413 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590007c-ad1c-40bb-bf13-1b2116659b9b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:34.650645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1005/1998] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:34.652009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ebba3-20c2-4c35-9162-8253d1792ced admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:34.671156 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ebba3-20c2-4c35-9162-8253d1792ced admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:34.674686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 994/1999] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:34 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:34.676018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590007c-ad1c-40bb-bf13-1b2116659b9b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:34.778385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbd27c-c4ff-40da-a781-6a5c10d4fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:34.778385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbd27c-c4ff-40da-a781-6a5c10d4fb5d admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:34.778385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbd27c-c4ff-40da-a781-6a5c10d4fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:34.779109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbd27c-c4ff-40da-a781-6a5c10d4fb5d admin admin] PATH_INFO: `/v3/projects/6c4750df43074c90afedd0aaa12d82b0/users/08a3af510df342a8a58106f2d27f9f4f/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:34.794840 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbd27c-c4ff-40da-a781-6a5c10d4fb5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4750df43074c90afedd0aaa12d82b0, user_id=08a3af510df342a8a58106f2d27f9f4f, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:34.798025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbd27c-c4ff-40da-a781-6a5c10d4fb5d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:34.831871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1006/2000] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:34 2022] PUT /identity/v3/projects/6c4750df43074c90afedd0aaa12d82b0/users/08a3af510df342a8a58106f2d27f9f4f/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:34.835837 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbd27c-c4ff-40da-a781-6a5c10d4fb5d admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:34.868579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590007c-ad1c-40bb-bf13-1b2116659b9b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:34.880403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:35.002622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f93822-aa5f-49ca-8c5e-a14d520bae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:35.003576 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f93822-aa5f-49ca-8c5e-a14d520bae44 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:35.004075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f93822-aa5f-49ca-8c5e-a14d520bae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:35.004488 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f93822-aa5f-49ca-8c5e-a14d520bae44 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:35.005680 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f93822-aa5f-49ca-8c5e-a14d520bae44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:35.009462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f93822-aa5f-49ca-8c5e-a14d520bae44 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:35.030702 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbd27c-c4ff-40da-a781-6a5c10d4fb5d admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:35.036236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795151f8-438f-4aa9-8cc0-1f2ee1e06aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:35.037079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795151f8-438f-4aa9-8cc0-1f2ee1e06aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:35.037532 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795151f8-438f-4aa9-8cc0-1f2ee1e06aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:35.037873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795151f8-438f-4aa9-8cc0-1f2ee1e06aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:35.038679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795151f8-438f-4aa9-8cc0-1f2ee1e06aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:35.040591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795151f8-438f-4aa9-8cc0-1f2ee1e06aa5 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:35.043347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:35.048847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 995/2001] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:34 2022] POST /identity/v3/users => generated 288 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:35.052470 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f93822-aa5f-49ca-8c5e-a14d520bae44 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:35.056492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-23f93822-aa5f-49ca-8c5e-a14d520bae44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:35.063022 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1007/2002] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:35.064432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795151f8-438f-4aa9-8cc0-1f2ee1e06aa5 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:35.072734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f93822-aa5f-49ca-8c5e-a14d520bae44 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:35.076988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795151f8-438f-4aa9-8cc0-1f2ee1e06aa5 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:35.077952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bafb0-efab-4625-96dc-92f2d98d3ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:35.079103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bafb0-efab-4625-96dc-92f2d98d3ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:35.079103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bafb0-efab-4625-96dc-92f2d98d3ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:35.079462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bafb0-efab-4625-96dc-92f2d98d3ff3 admin admin] PATH_INFO: `/v3/users/0c9f9b4989804a6fa0945910590c8063` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:35.081662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bafb0-efab-4625-96dc-92f2d98d3ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c9f9b4989804a6fa0945910590c8063)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:35.084133 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe89175-1903-4c2d-9118-128fd86c3c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:35.084432 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bafb0-efab-4625-96dc-92f2d98d3ff3 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:35.084948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe89175-1903-4c2d-9118-128fd86c3c9e admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:35.085327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe89175-1903-4c2d-9118-128fd86c3c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:35.085700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe89175-1903-4c2d-9118-128fd86c3c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:35.087072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe89175-1903-4c2d-9118-128fd86c3c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:35.089876 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe89175-1903-4c2d-9118-128fd86c3c9e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:35.104712 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1008/2003] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:35.106532 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe89175-1903-4c2d-9118-128fd86c3c9e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:35.117553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe89175-1903-4c2d-9118-128fd86c3c9e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:35.123278 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc73fe-136e-4573-8cef-4aeddc2399ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:35.123947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc73fe-136e-4573-8cef-4aeddc2399ff admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:35.124228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc73fe-136e-4573-8cef-4aeddc2399ff admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:35.124504 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc73fe-136e-4573-8cef-4aeddc2399ff admin admin] PATH_INFO: `/v3/projects/6c4750df43074c90afedd0aaa12d82b0/users/08a3af510df342a8a58106f2d27f9f4f/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:35.126467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc73fe-136e-4573-8cef-4aeddc2399ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4750df43074c90afedd0aaa12d82b0, user_id=08a3af510df342a8a58106f2d27f9f4f, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:35.131987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc73fe-136e-4573-8cef-4aeddc2399ff admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:35.152073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1009/2004] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:35 2022] PUT /identity/v3/projects/6c4750df43074c90afedd0aaa12d82b0/users/08a3af510df342a8a58106f2d27f9f4f/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:35.153201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc73fe-136e-4573-8cef-4aeddc2399ff admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:35.174703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e83bafb0-efab-4625-96dc-92f2d98d3ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c9f9b4989804a6fa0945910590c8063'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:35.175644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e83bafb0-efab-4625-96dc-92f2d98d3ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c9f9b4989804a6fa0945910590c8063'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:35.185747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e83bafb0-efab-4625-96dc-92f2d98d3ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c9f9b4989804a6fa0945910590c8063'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:35.186404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e83bafb0-efab-4625-96dc-92f2d98d3ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c9f9b4989804a6fa0945910590c8063'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:35.205446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e83bafb0-efab-4625-96dc-92f2d98d3ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c9f9b4989804a6fa0945910590c8063'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:35.221789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 996/2005] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:35 2022] DELETE /identity/v3/users/0c9f9b4989804a6fa0945910590c8063 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:35.223568 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eab37-a131-4e3d-a4ec-72a972726b32 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:35.224044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eab37-a131-4e3d-a4ec-72a972726b32 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:35.225046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eab37-a131-4e3d-a4ec-72a972726b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:35.248251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc73fe-136e-4573-8cef-4aeddc2399ff admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:35.266081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-366eab37-a131-4e3d-a4ec-72a972726b32 None None] MFA Rules not processed for user `08a3af510df342a8a58106f2d27f9f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:35.267429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-366eab37-a131-4e3d-a4ec-72a972726b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:35.376847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fe84e-434d-4226-ac86-c00f408f8a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:35.378333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fe84e-434d-4226-ac86-c00f408f8a56 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:35.378660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fe84e-434d-4226-ac86-c00f408f8a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:35.378930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fe84e-434d-4226-ac86-c00f408f8a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:35.382402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fe84e-434d-4226-ac86-c00f408f8a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:35.386770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fe84e-434d-4226-ac86-c00f408f8a56 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:35.392416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:35.410621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1010/2006] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:35.410621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeefcd9-2239-4f29-b4b4-56a39fc36a5d None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:35.410621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeefcd9-2239-4f29-b4b4-56a39fc36a5d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:35.410621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeefcd9-2239-4f29-b4b4-56a39fc36a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:35.419066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 997/2007] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:35.419066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eab37-a131-4e3d-a4ec-72a972726b32 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:35.419066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-366eab37-a131-4e3d-a4ec-72a972726b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:35.460721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-4eeefcd9-2239-4f29-b4b4-56a39fc36a5d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:35.463962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4eeefcd9-2239-4f29-b4b4-56a39fc36a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:35.486789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eab37-a131-4e3d-a4ec-72a972726b32 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:35.488559 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1011/2008] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:35.489853 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeefcd9-2239-4f29-b4b4-56a39fc36a5d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:35.492833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4eeefcd9-2239-4f29-b4b4-56a39fc36a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:35.498592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0845a6-f8c9-4995-9f9b-31c63a4e9245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:35.499292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0845a6-f8c9-4995-9f9b-31c63a4e9245 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:35.499722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0845a6-f8c9-4995-9f9b-31c63a4e9245 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:35.502408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0845a6-f8c9-4995-9f9b-31c63a4e9245 admin admin] PATH_INFO: `/v3/projects/2d9879992db64d0bbc407ae36253d18e/users/7f753d4f6b2c4936b46968cc378e0c26/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:35.533640 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0845a6-f8c9-4995-9f9b-31c63a4e9245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9879992db64d0bbc407ae36253d18e, user_id=7f753d4f6b2c4936b46968cc378e0c26, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:35.537300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0845a6-f8c9-4995-9f9b-31c63a4e9245 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:35.562114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 998/2009] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:35 2022] PUT /identity/v3/projects/2d9879992db64d0bbc407ae36253d18e/users/7f753d4f6b2c4936b46968cc378e0c26/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:35.564807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0845a6-f8c9-4995-9f9b-31c63a4e9245 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:35.566749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2b0845a6-f8c9-4995-9f9b-31c63a4e9245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:35.655757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeefcd9-2239-4f29-b4b4-56a39fc36a5d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:35.706456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:35.718873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0845a6-f8c9-4995-9f9b-31c63a4e9245 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:35.731437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:35.732253 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:35.732537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:35.732842 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] PATH_INFO: `/v3/projects/372f0637564b4df88d610afea4585f3b` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:35.734089 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=372f0637564b4df88d610afea4585f3b)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:35.736217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:35.744067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a919d-c14a-4dff-9bc7-dde80f4326cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:35.744764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a919d-c14a-4dff-9bc7-dde80f4326cb service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:35.745116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a919d-c14a-4dff-9bc7-dde80f4326cb service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:35.745577 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a919d-c14a-4dff-9bc7-dde80f4326cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:35.796396 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '372f0637564b4df88d610afea4585f3b', 'request_id': 'req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:35.803826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '372f0637564b4df88d610afea4585f3b', 'request_id': 'req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:35.814767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '372f0637564b4df88d610afea4585f3b', 'request_id': 'req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:35.819687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a919d-c14a-4dff-9bc7-dde80f4326cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:35.821134 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a919d-c14a-4dff-9bc7-dde80f4326cb service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:35.827803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] The token cache is being invalidate because project 372f0637564b4df88d610afea4585f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:35.828181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:35.828899 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:35.831793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1012/2010] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:35.833100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb073917-ad5f-40a8-bab9-4ea5adf9bce1 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:35.833837 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb073917-ad5f-40a8-bab9-4ea5adf9bce1 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:35.833837 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb073917-ad5f-40a8-bab9-4ea5adf9bce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:35.835733 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 999/2011] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:35 2022] DELETE /identity/v3/projects/372f0637564b4df88d610afea4585f3b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:35.836867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:35.839124 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:35.867037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-fb073917-ad5f-40a8-bab9-4ea5adf9bce1 None None] MFA Rules not processed for user `7f753d4f6b2c4936b46968cc378e0c26`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:35.868410 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-fb073917-ad5f-40a8-bab9-4ea5adf9bce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:36.013320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc6d64-3b62-40fe-82d2-20f3ca9498ec admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:36.013915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1013/2012] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:36.015073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb073917-ad5f-40a8-bab9-4ea5adf9bce1 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:36.017630 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-fb073917-ad5f-40a8-bab9-4ea5adf9bce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:36.026637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df62a0-f8c1-4aa9-bdbb-56dfead6b1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:36.026828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df62a0-f8c1-4aa9-bdbb-56dfead6b1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:36.027475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df62a0-f8c1-4aa9-bdbb-56dfead6b1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:36.027475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df62a0-f8c1-4aa9-bdbb-56dfead6b1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:36.031428 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-64df62a0-f8c1-4aa9-bdbb-56dfead6b1a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:36.059953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:36.128942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb073917-ad5f-40a8-bab9-4ea5adf9bce1 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:36.135102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:36.135850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:36.136136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:36.136412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] PATH_INFO: `/v3/users/d7216c831cf548d0a2cfa370f10351b3` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:36.137665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7216c831cf548d0a2cfa370f10351b3)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:36.139988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:36.145989 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df62a0-f8c1-4aa9-bdbb-56dfead6b1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:36.147948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df62a0-f8c1-4aa9-bdbb-56dfead6b1a8 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:36.151921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:36.162940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1000/2013] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:36.164183 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df62a0-f8c1-4aa9-bdbb-56dfead6b1a8 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:36.165866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-64df62a0-f8c1-4aa9-bdbb-56dfead6b1a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:36.182812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df62a0-f8c1-4aa9-bdbb-56dfead6b1a8 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:36.188420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029e987-ba29-4ac3-b004-ca908ffb8e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:36.189068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029e987-ba29-4ac3-b004-ca908ffb8e52 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:36.189414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029e987-ba29-4ac3-b004-ca908ffb8e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:36.189753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029e987-ba29-4ac3-b004-ca908ffb8e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:36.190482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029e987-ba29-4ac3-b004-ca908ffb8e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:36.192736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029e987-ba29-4ac3-b004-ca908ffb8e52 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:36.212031 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7216c831cf548d0a2cfa370f10351b3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:36.213708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7216c831cf548d0a2cfa370f10351b3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:36.227328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1001/2014] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:36 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:36.230734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029e987-ba29-4ac3-b004-ca908ffb8e52 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:36.231024 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7216c831cf548d0a2cfa370f10351b3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:36.253034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7216c831cf548d0a2cfa370f10351b3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:36.254119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7216c831cf548d0a2cfa370f10351b3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:36.288402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1014/2015] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:36 2022] DELETE /identity/v3/users/d7216c831cf548d0a2cfa370f10351b3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:36.333546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029e987-ba29-4ac3-b004-ca908ffb8e52 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:36.451479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc3456-957e-4524-9498-abb6051c5fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:36.452211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3456-957e-4524-9498-abb6051c5fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:36.452492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3456-957e-4524-9498-abb6051c5fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:36.453388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3456-957e-4524-9498-abb6051c5fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:36.454359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc3456-957e-4524-9498-abb6051c5fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:36.457223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc3456-957e-4524-9498-abb6051c5fd2 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:36.515979 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:36.517441 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1002/2016] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:36 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:36.517959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:36.546916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b95c2-74dc-450f-83a6-1503cf4ba8b4 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:36.556348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bad90a-dec4-405b-84c4-29c419b079bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:36.557852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bad90a-dec4-405b-84c4-29c419b079bb admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:36.558202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bad90a-dec4-405b-84c4-29c419b079bb admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:36.558692 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bad90a-dec4-405b-84c4-29c419b079bb admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:36.559510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bad90a-dec4-405b-84c4-29c419b079bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:36.562531 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bad90a-dec4-405b-84c4-29c419b079bb admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:36.583856 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc3456-957e-4524-9498-abb6051c5fd2 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:36.599146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1015/2017] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:36.600638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc3456-957e-4524-9498-abb6051c5fd2 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:36.623067 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf07bd-06bc-49bf-a0e0-1939aa4822a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:36.623756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf07bd-06bc-49bf-a0e0-1939aa4822a9 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:36.624037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf07bd-06bc-49bf-a0e0-1939aa4822a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:36.624308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf07bd-06bc-49bf-a0e0-1939aa4822a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:36.625450 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf07bd-06bc-49bf-a0e0-1939aa4822a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:36.627351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf07bd-06bc-49bf-a0e0-1939aa4822a9 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:36.641416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1003/2018] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:36.645358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bad90a-dec4-405b-84c4-29c419b079bb admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:36.658596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bad90a-dec4-405b-84c4-29c419b079bb admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:36.670873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1288e9-aa39-40a8-a1ac-08f74171c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:36.671740 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1288e9-aa39-40a8-a1ac-08f74171c9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:36.673248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf07bd-06bc-49bf-a0e0-1939aa4822a9 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:36.675270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-edaf07bd-06bc-49bf-a0e0-1939aa4822a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:36.675606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1288e9-aa39-40a8-a1ac-08f74171c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:36.676249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1288e9-aa39-40a8-a1ac-08f74171c9c9 admin admin] PATH_INFO: `/v3/projects/aaa6e1d88fbd468d9055e50bddebdbad/users/bb7ee55354da45d6802a241289bbabfa/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:36.701879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf07bd-06bc-49bf-a0e0-1939aa4822a9 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:36.714765 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1288e9-aa39-40a8-a1ac-08f74171c9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa6e1d88fbd468d9055e50bddebdbad, user_id=bb7ee55354da45d6802a241289bbabfa, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:36.719295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1288e9-aa39-40a8-a1ac-08f74171c9c9 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:36.733770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550d732-edd6-4120-8037-4cb9f7f53588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:36.734440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550d732-edd6-4120-8037-4cb9f7f53588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:36.734757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550d732-edd6-4120-8037-4cb9f7f53588 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:36.735080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550d732-edd6-4120-8037-4cb9f7f53588 admin admin] PATH_INFO: `/v3/projects/ffa5f7584712419399cff407c191d049` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:36.736796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550d732-edd6-4120-8037-4cb9f7f53588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa5f7584712419399cff407c191d049)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:36.741049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550d732-edd6-4120-8037-4cb9f7f53588 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:36.756309 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:36.758103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1016/2019] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:36 2022] PUT /identity/v3/projects/aaa6e1d88fbd468d9055e50bddebdbad/users/bb7ee55354da45d6802a241289bbabfa/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:36.760051 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1288e9-aa39-40a8-a1ac-08f74171c9c9 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:36.762780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5e1288e9-aa39-40a8-a1ac-08f74171c9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:36.829937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-7550d732-edd6-4120-8037-4cb9f7f53588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa5f7584712419399cff407c191d049', 'request_id': 'req-7550d732-edd6-4120-8037-4cb9f7f53588'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:36.836082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-7550d732-edd6-4120-8037-4cb9f7f53588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa5f7584712419399cff407c191d049', 'request_id': 'req-7550d732-edd6-4120-8037-4cb9f7f53588'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:36.847617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-7550d732-edd6-4120-8037-4cb9f7f53588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa5f7584712419399cff407c191d049', 'request_id': 'req-7550d732-edd6-4120-8037-4cb9f7f53588'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:36.852634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1288e9-aa39-40a8-a1ac-08f74171c9c9 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:36.863393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-7550d732-edd6-4120-8037-4cb9f7f53588 admin admin] The token cache is being invalidate because project ffa5f7584712419399cff407c191d049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:36.863689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-7550d732-edd6-4120-8037-4cb9f7f53588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:36.864353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-7550d732-edd6-4120-8037-4cb9f7f53588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:36.867281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1004/2020] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:36 2022] DELETE /identity/v3/projects/ffa5f7584712419399cff407c191d049 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:36.868369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99a444-0851-43a4-9fc3-9d888797eae6 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:36.868650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99a444-0851-43a4-9fc3-9d888797eae6 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:36.868924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99a444-0851-43a4-9fc3-9d888797eae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:36.929070 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3472554-55be-4192-8513-38c7a0790c64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:36.929886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3472554-55be-4192-8513-38c7a0790c64 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:36.930622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3472554-55be-4192-8513-38c7a0790c64 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:36.930912 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3472554-55be-4192-8513-38c7a0790c64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:36.933013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e3472554-55be-4192-8513-38c7a0790c64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:36.934878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-5f99a444-0851-43a4-9fc3-9d888797eae6 None None] MFA Rules not processed for user `bb7ee55354da45d6802a241289bbabfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:36.936177 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5f99a444-0851-43a4-9fc3-9d888797eae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:36.958081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:37.019630 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3472554-55be-4192-8513-38c7a0790c64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:37.023239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3472554-55be-4192-8513-38c7a0790c64 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:37.035016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1017/2021] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:37.036242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3472554-55be-4192-8513-38c7a0790c64 service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:37.037818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e3472554-55be-4192-8513-38c7a0790c64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:37.080520 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1005/2022] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:37.081755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99a444-0851-43a4-9fc3-9d888797eae6 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:37.083478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5f99a444-0851-43a4-9fc3-9d888797eae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:37.127601 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3472554-55be-4192-8513-38c7a0790c64 service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:37.137081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:37.137966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:37.138389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:37.139756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] PATH_INFO: `/v3/users/6e981ed486bc4a29a23f579f67ac32c4` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:37.141212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e981ed486bc4a29a23f579f67ac32c4)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:37.144431 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:37.189819 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99a444-0851-43a4-9fc3-9d888797eae6 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:37.196824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd5644-318b-4d06-ab97-3a66d1773c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:37.197495 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd5644-318b-4d06-ab97-3a66d1773c69 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:37.197914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd5644-318b-4d06-ab97-3a66d1773c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:37.198199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd5644-318b-4d06-ab97-3a66d1773c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:37.198916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd5644-318b-4d06-ab97-3a66d1773c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:37.201207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd5644-318b-4d06-ab97-3a66d1773c69 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:37.247107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1006/2023] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:37 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:37.247107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd5644-318b-4d06-ab97-3a66d1773c69 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:37.247414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e981ed486bc4a29a23f579f67ac32c4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:37.247520 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-72dd5644-318b-4d06-ab97-3a66d1773c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:37.248079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e981ed486bc4a29a23f579f67ac32c4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:37.260193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e981ed486bc4a29a23f579f67ac32c4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:37.262051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:37.274865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e981ed486bc4a29a23f579f67ac32c4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:37.275824 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e981ed486bc4a29a23f579f67ac32c4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:37.309900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1018/2024] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:37 2022] DELETE /identity/v3/users/6e981ed486bc4a29a23f579f67ac32c4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:37.313570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:37.315269 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:37.386797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd5644-318b-4d06-ab97-3a66d1773c69 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:37.419227 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:37.492826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334d2c7-9188-450e-ac73-937ce09cf419 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:37.508607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8de517-3337-4f14-a190-b77d6d52deba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:37.509892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8de517-3337-4f14-a190-b77d6d52deba admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:37.511304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8de517-3337-4f14-a190-b77d6d52deba admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:37.511757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8de517-3337-4f14-a190-b77d6d52deba admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:37.513619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8de517-3337-4f14-a190-b77d6d52deba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:37.516615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:37.517268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:37.518439 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:37.518776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9 admin admin] PATH_INFO: `/v3/projects/2eaaa8c6f5ea41589bc436611fe8f814` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:37.519505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8de517-3337-4f14-a190-b77d6d52deba admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:37.520480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eaaa8c6f5ea41589bc436611fe8f814)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:37.522915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:37.555671 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1019/2025] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:37 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:37.560036 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8de517-3337-4f14-a190-b77d6d52deba admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:37.576150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8de517-3337-4f14-a190-b77d6d52deba admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:37.597453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eaaa8c6f5ea41589bc436611fe8f814', 'request_id': 'req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:37.607063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eaaa8c6f5ea41589bc436611fe8f814', 'request_id': 'req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:37.617707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eaaa8c6f5ea41589bc436611fe8f814', 'request_id': 'req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:37.639335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9 admin admin] The token cache is being invalidate because project 2eaaa8c6f5ea41589bc436611fe8f814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:37.644476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:37.644476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-88c9c8a6-b184-4989-b27f-6d396fdf6cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:37.644476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1007/2026] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:37 2022] DELETE /identity/v3/projects/2eaaa8c6f5ea41589bc436611fe8f814 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:37.647984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a3e3-d584-4ec9-bb33-bae7f850ceae None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:37.648395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a3e3-d584-4ec9-bb33-bae7f850ceae None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:37.648747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a3e3-d584-4ec9-bb33-bae7f850ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:37.706010 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-df46a3e3-d584-4ec9-bb33-bae7f850ceae None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:37.710105 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-df46a3e3-d584-4ec9-bb33-bae7f850ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:37.743249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb60724-464e-4877-a3b3-ed262d2094de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:37.743882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb60724-464e-4877-a3b3-ed262d2094de admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:37.744160 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb60724-464e-4877-a3b3-ed262d2094de admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:37.744697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb60724-464e-4877-a3b3-ed262d2094de admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:37.745079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb60724-464e-4877-a3b3-ed262d2094de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:37.747213 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb60724-464e-4877-a3b3-ed262d2094de admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:37.773036 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1020/2027] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:37.773958 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb60724-464e-4877-a3b3-ed262d2094de admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:37.778773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-bdb60724-464e-4877-a3b3-ed262d2094de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:37.799176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb60724-464e-4877-a3b3-ed262d2094de admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:37.804750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac3d35-25c7-4518-9dfe-2fff5e0d4474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:37.805645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac3d35-25c7-4518-9dfe-2fff5e0d4474 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:37.805926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac3d35-25c7-4518-9dfe-2fff5e0d4474 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:37.806198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac3d35-25c7-4518-9dfe-2fff5e0d4474 admin admin] PATH_INFO: `/v3/projects/a047b2d7e36c4a64adae44071ee7dda5/users/136f81c2c78d4bd3a618779d69bb79ed/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:37.814413 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:37.840813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac3d35-25c7-4518-9dfe-2fff5e0d4474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a047b2d7e36c4a64adae44071ee7dda5, user_id=136f81c2c78d4bd3a618779d69bb79ed, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:37.844113 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac3d35-25c7-4518-9dfe-2fff5e0d4474 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:37.851403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1008/2028] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:37.858973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ce82-bae4-4c06-833b-6bc1dd93b501 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:37.859265 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ce82-bae4-4c06-833b-6bc1dd93b501 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:37.859539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ce82-bae4-4c06-833b-6bc1dd93b501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:37.872439 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1021/2029] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:37 2022] PUT /identity/v3/projects/a047b2d7e36c4a64adae44071ee7dda5/users/136f81c2c78d4bd3a618779d69bb79ed/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:37.873649 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac3d35-25c7-4518-9dfe-2fff5e0d4474 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:37.888466 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-00c7ce82-bae4-4c06-833b-6bc1dd93b501 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:37.890555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-00c7ce82-bae4-4c06-833b-6bc1dd93b501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:37.958981 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac3d35-25c7-4518-9dfe-2fff5e0d4474 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:37.965951 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e86d25-8592-4d65-b9d2-5288b25857e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:37.967145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e86d25-8592-4d65-b9d2-5288b25857e4 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:37.967580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e86d25-8592-4d65-b9d2-5288b25857e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:37.968001 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e86d25-8592-4d65-b9d2-5288b25857e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:37.968803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e86d25-8592-4d65-b9d2-5288b25857e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:37.971064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e86d25-8592-4d65-b9d2-5288b25857e4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:37.976421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1009/2030] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:37.977722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7ce82-bae4-4c06-833b-6bc1dd93b501 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:37.984153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1022/2031] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:37.985352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e86d25-8592-4d65-b9d2-5288b25857e4 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:37.989031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-00c7ce82-bae4-4c06-833b-6bc1dd93b501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:38.003538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7ce82-bae4-4c06-833b-6bc1dd93b501 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:38.008378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:38.009145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:38.009506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:38.009856 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] PATH_INFO: `/v3/projects/44a22666296641e494ef5e124af5e18d` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:38.011376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e86d25-8592-4d65-b9d2-5288b25857e4 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:38.011553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a22666296641e494ef5e124af5e18d)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:38.013894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:38.022622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766ed87-2126-4ba7-90e2-ef567247ba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:38.023529 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766ed87-2126-4ba7-90e2-ef567247ba1e admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:38.040541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766ed87-2126-4ba7-90e2-ef567247ba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:38.041201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766ed87-2126-4ba7-90e2-ef567247ba1e admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:38.042249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766ed87-2126-4ba7-90e2-ef567247ba1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:38.042964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766ed87-2126-4ba7-90e2-ef567247ba1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:38.045088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766ed87-2126-4ba7-90e2-ef567247ba1e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:38.070260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1023/2032] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:38.071154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766ed87-2126-4ba7-90e2-ef567247ba1e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:38.082030 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766ed87-2126-4ba7-90e2-ef567247ba1e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:38.088918 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a22666296641e494ef5e124af5e18d', 'request_id': 'req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:38.134697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a22666296641e494ef5e124af5e18d', 'request_id': 'req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:38.141388 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:38.158274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a22666296641e494ef5e124af5e18d', 'request_id': 'req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:38.193356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] The token cache is being invalidate because project 44a22666296641e494ef5e124af5e18d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:38.193691 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:38.196778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:38.201518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1010/2033] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:37 2022] DELETE /identity/v3/projects/44a22666296641e494ef5e124af5e18d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:38.207436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:38.211048 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:38.248135 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f58036-9800-424b-b312-0cb532432163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:38.249246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f58036-9800-424b-b312-0cb532432163 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:38.249526 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f58036-9800-424b-b312-0cb532432163 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:38.249797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f58036-9800-424b-b312-0cb532432163 admin admin] PATH_INFO: `/v3/projects/a047b2d7e36c4a64adae44071ee7dda5/users/136f81c2c78d4bd3a618779d69bb79ed/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:38.251904 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f58036-9800-424b-b312-0cb532432163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a047b2d7e36c4a64adae44071ee7dda5, user_id=136f81c2c78d4bd3a618779d69bb79ed, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:38.254949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f58036-9800-424b-b312-0cb532432163 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:38.268737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1024/2034] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:38 2022] PUT /identity/v3/projects/a047b2d7e36c4a64adae44071ee7dda5/users/136f81c2c78d4bd3a618779d69bb79ed/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:38.269550 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f61dc-f31b-4329-b3f0-760610e16324 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:38.269836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f61dc-f31b-4329-b3f0-760610e16324 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:38.270108 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f61dc-f31b-4329-b3f0-760610e16324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:38.294058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f59f61dc-f31b-4329-b3f0-760610e16324 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:38.295314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f59f61dc-f31b-4329-b3f0-760610e16324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:38.342455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8ae4b-57f4-457c-94d0-bf55eab3ac9f admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:38.364843 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:38.395857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1025/2035] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:38.397433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93df033-1487-4853-a8d4-329f78dfb42a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:38.397830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93df033-1487-4853-a8d4-329f78dfb42a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:38.398208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93df033-1487-4853-a8d4-329f78dfb42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:38.420914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a670259-8766-48fd-94d9-b4ce9bf775ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:38.422543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a670259-8766-48fd-94d9-b4ce9bf775ed admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:38.422851 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a670259-8766-48fd-94d9-b4ce9bf775ed admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:38.423244 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a670259-8766-48fd-94d9-b4ce9bf775ed admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:38.424146 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a670259-8766-48fd-94d9-b4ce9bf775ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:38.426668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a670259-8766-48fd-94d9-b4ce9bf775ed admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:38.433688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-e93df033-1487-4853-a8d4-329f78dfb42a None None] MFA Rules not processed for user `136f81c2c78d4bd3a618779d69bb79ed`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:38.438671 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e93df033-1487-4853-a8d4-329f78dfb42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:38.468618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1011/2036] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:38 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:38.470233 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed218b-6b51-414a-b6b1-f49c2114b3bd None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:38.470683 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed218b-6b51-414a-b6b1-f49c2114b3bd None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:38.471261 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed218b-6b51-414a-b6b1-f49c2114b3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:38.496494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-e3ed218b-6b51-414a-b6b1-f49c2114b3bd None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:38.498039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e3ed218b-6b51-414a-b6b1-f49c2114b3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:38.536482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1026/2037] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:38.542026 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93df033-1487-4853-a8d4-329f78dfb42a None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:38.555761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93df033-1487-4853-a8d4-329f78dfb42a None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:38.591356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1012/2038] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:38.591356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed218b-6b51-414a-b6b1-f49c2114b3bd None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:38.591356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e3ed218b-6b51-414a-b6b1-f49c2114b3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:38.618931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:38.647818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08925c2c-8094-4e7c-ac2a-7ab628b2a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:38.648357 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08925c2c-8094-4e7c-ac2a-7ab628b2a0cf admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:38.649105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08925c2c-8094-4e7c-ac2a-7ab628b2a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:38.649105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08925c2c-8094-4e7c-ac2a-7ab628b2a0cf admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:38.649684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08925c2c-8094-4e7c-ac2a-7ab628b2a0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:38.651665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08925c2c-8094-4e7c-ac2a-7ab628b2a0cf admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:38.690069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1027/2039] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:38 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:38.691020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08925c2c-8094-4e7c-ac2a-7ab628b2a0cf admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:38.698135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed218b-6b51-414a-b6b1-f49c2114b3bd None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:38.704861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08925c2c-8094-4e7c-ac2a-7ab628b2a0cf admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:38.705182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0c5b7-b559-4603-bbe5-607127742ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:38.707365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0c5b7-b559-4603-bbe5-607127742ecd service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:38.708461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0c5b7-b559-4603-bbe5-607127742ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:38.709864 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0c5b7-b559-4603-bbe5-607127742ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:38.711964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7bce3-66e3-4ec9-b506-17b5b665ab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:38.713358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7bce3-66e3-4ec9-b506-17b5b665ab13 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:38.716742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5fc0c5b7-b559-4603-bbe5-607127742ecd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:38.724103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7bce3-66e3-4ec9-b506-17b5b665ab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:38.725519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7bce3-66e3-4ec9-b506-17b5b665ab13 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:38.726763 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7bce3-66e3-4ec9-b506-17b5b665ab13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:38.728738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7bce3-66e3-4ec9-b506-17b5b665ab13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:38.733016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7bce3-66e3-4ec9-b506-17b5b665ab13 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:38.775499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1028/2040] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:38.776572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7bce3-66e3-4ec9-b506-17b5b665ab13 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:38.788571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7bce3-66e3-4ec9-b506-17b5b665ab13 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:38.807376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b40a85-8d4a-494e-8dac-969032bbdd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:38.809653 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40a85-8d4a-494e-8dac-969032bbdd2b admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:38.812377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40a85-8d4a-494e-8dac-969032bbdd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:38.814629 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40a85-8d4a-494e-8dac-969032bbdd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:38.815297 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b40a85-8d4a-494e-8dac-969032bbdd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:38.819541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b40a85-8d4a-494e-8dac-969032bbdd2b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:38.849263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1029/2041] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:38.853417 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b40a85-8d4a-494e-8dac-969032bbdd2b admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:38.887152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b40a85-8d4a-494e-8dac-969032bbdd2b admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:38.892090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faa765-9d36-4997-b2b3-8052dd110810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:38.892712 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faa765-9d36-4997-b2b3-8052dd110810 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:38.892989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faa765-9d36-4997-b2b3-8052dd110810 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:38.893359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faa765-9d36-4997-b2b3-8052dd110810 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:38.894014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faa765-9d36-4997-b2b3-8052dd110810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:38.896123 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faa765-9d36-4997-b2b3-8052dd110810 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:38.911232 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0c5b7-b559-4603-bbe5-607127742ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:38.914872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0c5b7-b559-4603-bbe5-607127742ecd service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:38.940442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1013/2042] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:38.941400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0c5b7-b559-4603-bbe5-607127742ecd service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:38.953775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:38.954538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1030/2043] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:38 2022] POST /identity/v3/projects => generated 407 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:38.959536 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faa765-9d36-4997-b2b3-8052dd110810 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:38.970184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0c5b7-b559-4603-bbe5-607127742ecd service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:39.096155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faa765-9d36-4997-b2b3-8052dd110810 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:39.107882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8d1ee-7bf4-4983-a53a-8415835b829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:39.108513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8d1ee-7bf4-4983-a53a-8415835b829c admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:39.111043 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8d1ee-7bf4-4983-a53a-8415835b829c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:39.111439 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8d1ee-7bf4-4983-a53a-8415835b829c admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:39.112320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8d1ee-7bf4-4983-a53a-8415835b829c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:39.117398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8d1ee-7bf4-4983-a53a-8415835b829c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:39.145417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735f4d1-eebf-4dab-97f2-19215c146af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:39.147018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735f4d1-eebf-4dab-97f2-19215c146af9 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:39.147406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735f4d1-eebf-4dab-97f2-19215c146af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:39.147699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735f4d1-eebf-4dab-97f2-19215c146af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:39.150739 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735f4d1-eebf-4dab-97f2-19215c146af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:39.156791 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735f4d1-eebf-4dab-97f2-19215c146af9 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:39.164783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1031/2044] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:38 2022] POST /identity/v3/users => generated 304 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:39.168640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8d1ee-7bf4-4983-a53a-8415835b829c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:39.191088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1014/2045] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:39.192065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8d1ee-7bf4-4983-a53a-8415835b829c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:39.197072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735f4d1-eebf-4dab-97f2-19215c146af9 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:39.204940 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170b54a-f29f-4b1e-bece-1329dc9f4014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:39.207730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170b54a-f29f-4b1e-bece-1329dc9f4014 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:39.208128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170b54a-f29f-4b1e-bece-1329dc9f4014 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:39.209296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170b54a-f29f-4b1e-bece-1329dc9f4014 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:39.210063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170b54a-f29f-4b1e-bece-1329dc9f4014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:39.214212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170b54a-f29f-4b1e-bece-1329dc9f4014 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:39.244408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735f4d1-eebf-4dab-97f2-19215c146af9 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:39.252677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1032/2046] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:39.256860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170b54a-f29f-4b1e-bece-1329dc9f4014 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:39.259871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeceb0c5-efc5-474e-b006-03d048c6385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:39.260565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceb0c5-efc5-474e-b006-03d048c6385c admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:39.260850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceb0c5-efc5-474e-b006-03d048c6385c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:39.261131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceb0c5-efc5-474e-b006-03d048c6385c admin admin] PATH_INFO: `/v3/projects/1881c20c83d64d4ea321e7d8393318a0/users/b7f65984e7074150b07e59952fce73e6/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:39.276271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170b54a-f29f-4b1e-bece-1329dc9f4014 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:39.293118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476a372-efd5-4c10-b904-486c77e18af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:39.293967 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476a372-efd5-4c10-b904-486c77e18af8 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:39.294318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476a372-efd5-4c10-b904-486c77e18af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:39.294619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476a372-efd5-4c10-b904-486c77e18af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:39.296864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476a372-efd5-4c10-b904-486c77e18af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:39.299126 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeceb0c5-efc5-474e-b006-03d048c6385c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1881c20c83d64d4ea321e7d8393318a0, user_id=b7f65984e7074150b07e59952fce73e6, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:39.300604 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476a372-efd5-4c10-b904-486c77e18af8 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:39.304457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeceb0c5-efc5-474e-b006-03d048c6385c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:39.328164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1033/2047] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:39.328801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1015/2048] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:39 2022] PUT /identity/v3/projects/1881c20c83d64d4ea321e7d8393318a0/users/b7f65984e7074150b07e59952fce73e6/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:39.342700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476a372-efd5-4c10-b904-486c77e18af8 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:39.345711 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d0c49-9a31-408a-97b6-f350d8b028d1 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:39.346001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d0c49-9a31-408a-97b6-f350d8b028d1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:39.346275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d0c49-9a31-408a-97b6-f350d8b028d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:39.373784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476a372-efd5-4c10-b904-486c77e18af8 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:39.410573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-fb7d0c49-9a31-408a-97b6-f350d8b028d1 None None] MFA Rules not processed for user `b7f65984e7074150b07e59952fce73e6`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:39.414038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-fb7d0c49-9a31-408a-97b6-f350d8b028d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:39.478934 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:39.495819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cc085-8298-4342-9975-266a52935b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:39.498451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cc085-8298-4342-9975-266a52935b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:39.499753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cc085-8298-4342-9975-266a52935b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:39.500322 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cc085-8298-4342-9975-266a52935b82 admin admin] PATH_INFO: `/v3/projects/2735fc53775345b68cfff1bc6294d20b/users/de536bb5f63b4c6fbeb59ed7fd369587/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:39.530306 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cc085-8298-4342-9975-266a52935b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2735fc53775345b68cfff1bc6294d20b, user_id=de536bb5f63b4c6fbeb59ed7fd369587, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:39.535155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cc085-8298-4342-9975-266a52935b82 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:39.539581 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1016/2049] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:39.548239 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d0c49-9a31-408a-97b6-f350d8b028d1 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:39.569311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1034/2050] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:39 2022] PUT /identity/v3/projects/2735fc53775345b68cfff1bc6294d20b/users/de536bb5f63b4c6fbeb59ed7fd369587/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:39.572105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922152-1260-4ac6-abe1-50506916e3dc None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:39.572105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922152-1260-4ac6-abe1-50506916e3dc None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:39.572105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922152-1260-4ac6-abe1-50506916e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:39.597775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d0c49-9a31-408a-97b6-f350d8b028d1 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:39.616277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-df922152-1260-4ac6-abe1-50506916e3dc None None] MFA Rules not processed for user `de536bb5f63b4c6fbeb59ed7fd369587`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:39.618273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-df922152-1260-4ac6-abe1-50506916e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:39.765209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303381a-9f80-409e-bcf0-b2991354bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:39.766296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303381a-9f80-409e-bcf0-b2991354bc6a admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:39.767066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303381a-9f80-409e-bcf0-b2991354bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:39.767388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303381a-9f80-409e-bcf0-b2991354bc6a admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:39.768231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303381a-9f80-409e-bcf0-b2991354bc6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:39.770433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303381a-9f80-409e-bcf0-b2991354bc6a admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:39.781450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1035/2051] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:39 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:39.782301 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df922152-1260-4ac6-abe1-50506916e3dc None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:39.782781 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:39.805925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df922152-1260-4ac6-abe1-50506916e3dc None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:39.814383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1017/2052] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:39 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:39.817312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303381a-9f80-409e-bcf0-b2991354bc6a admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:39.819075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7d737-c63f-4d3d-afc2-c2464220c260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:39.821078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7d737-c63f-4d3d-afc2-c2464220c260 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:39.821078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7d737-c63f-4d3d-afc2-c2464220c260 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:39.821579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7d737-c63f-4d3d-afc2-c2464220c260 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:39.822277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7d737-c63f-4d3d-afc2-c2464220c260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:39.828596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7d737-c63f-4d3d-afc2-c2464220c260 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:39.879095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1036/2053] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:39 2022] POST /identity/v3/projects => generated 407 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:39.881184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7d737-c63f-4d3d-afc2-c2464220c260 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:39.928432 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303381a-9f80-409e-bcf0-b2991354bc6a admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:39.981631 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7d737-c63f-4d3d-afc2-c2464220c260 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:39.986864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1c0b1-71d8-461a-8dbc-2cb56a3703b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:39.987705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1c0b1-71d8-461a-8dbc-2cb56a3703b9 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:39.988757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1c0b1-71d8-461a-8dbc-2cb56a3703b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:39.989215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1c0b1-71d8-461a-8dbc-2cb56a3703b9 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:39.989870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1c0b1-71d8-461a-8dbc-2cb56a3703b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:39.991847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1c0b1-71d8-461a-8dbc-2cb56a3703b9 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.012454 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c3185-7d9b-4723-ae00-f8b666c1e7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.013246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c3185-7d9b-4723-ae00-f8b666c1e7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.013527 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c3185-7d9b-4723-ae00-f8b666c1e7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.013843 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c3185-7d9b-4723-ae00-f8b666c1e7f0 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.014557 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c3185-7d9b-4723-ae00-f8b666c1e7f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.016654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c3185-7d9b-4723-ae00-f8b666c1e7f0 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.021457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1037/2054] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:39 2022] POST /identity/v3/users => generated 310 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:40.022742 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1c0b1-71d8-461a-8dbc-2cb56a3703b9 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.035300 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1c0b1-71d8-461a-8dbc-2cb56a3703b9 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.041366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3f845-59d4-4bf6-932a-86e9035cf0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.041979 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3f845-59d4-4bf6-932a-86e9035cf0da admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.042344 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3f845-59d4-4bf6-932a-86e9035cf0da admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.042651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3f845-59d4-4bf6-932a-86e9035cf0da admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.044164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3f845-59d4-4bf6-932a-86e9035cf0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.046985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3f845-59d4-4bf6-932a-86e9035cf0da admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.051525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1018/2055] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:39 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:40.052993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c3185-7d9b-4723-ae00-f8b666c1e7f0 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.064082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1038/2056] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:40.065299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3f845-59d4-4bf6-932a-86e9035cf0da admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.074857 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c3185-7d9b-4723-ae00-f8b666c1e7f0 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.076074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3f845-59d4-4bf6-932a-86e9035cf0da admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.082057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186038fc-d28c-4a84-a5f7-e105ac722b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.082749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186038fc-d28c-4a84-a5f7-e105ac722b16 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.083072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186038fc-d28c-4a84-a5f7-e105ac722b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.083347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186038fc-d28c-4a84-a5f7-e105ac722b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.089177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a6f7-0530-4a6c-95ed-537854f0f3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.091219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a6f7-0530-4a6c-95ed-537854f0f3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.091711 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a6f7-0530-4a6c-95ed-537854f0f3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.092182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a6f7-0530-4a6c-95ed-537854f0f3c7 admin admin] PATH_INFO: `/v3/projects/27d248cf4b464f9da58e5ba893a39c6e/users/e60ee4b856294e89a3d8e2d6f575a733/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.095095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186038fc-d28c-4a84-a5f7-e105ac722b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.098625 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186038fc-d28c-4a84-a5f7-e105ac722b16 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.111259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0a6f7-0530-4a6c-95ed-537854f0f3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d248cf4b464f9da58e5ba893a39c6e, user_id=e60ee4b856294e89a3d8e2d6f575a733, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.112427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1019/2057] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:40.114437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0a6f7-0530-4a6c-95ed-537854f0f3c7 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.117614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186038fc-d28c-4a84-a5f7-e105ac722b16 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.126629 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:40.131921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186038fc-d28c-4a84-a5f7-e105ac722b16 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.132869 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1039/2058] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:40 2022] PUT /identity/v3/projects/27d248cf4b464f9da58e5ba893a39c6e/users/e60ee4b856294e89a3d8e2d6f575a733/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:40.137142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a6f7-0530-4a6c-95ed-537854f0f3c7 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.210698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88be48-b96a-4370-b56f-b186cdd511d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.211277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a6f7-0530-4a6c-95ed-537854f0f3c7 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.211389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88be48-b96a-4370-b56f-b186cdd511d8 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.211648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88be48-b96a-4370-b56f-b186cdd511d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.211990 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88be48-b96a-4370-b56f-b186cdd511d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.212573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88be48-b96a-4370-b56f-b186cdd511d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.214294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88be48-b96a-4370-b56f-b186cdd511d8 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.216362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a2a15-6409-48ce-950f-c96671571a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.216986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a2a15-6409-48ce-950f-c96671571a44 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.217303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a2a15-6409-48ce-950f-c96671571a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.217587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a2a15-6409-48ce-950f-c96671571a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.218278 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a2a15-6409-48ce-950f-c96671571a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.219985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a2a15-6409-48ce-950f-c96671571a44 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.226618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1020/2059] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:40.233248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88be48-b96a-4370-b56f-b186cdd511d8 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.239042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1040/2060] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:40.242971 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a2a15-6409-48ce-950f-c96671571a44 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.246841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88be48-b96a-4370-b56f-b186cdd511d8 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.255606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc99b49-722b-4d4e-b7b8-66c18c9ff02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.256286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a2a15-6409-48ce-950f-c96671571a44 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.256483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc99b49-722b-4d4e-b7b8-66c18c9ff02c admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.256832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc99b49-722b-4d4e-b7b8-66c18c9ff02c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.257219 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc99b49-722b-4d4e-b7b8-66c18c9ff02c admin admin] PATH_INFO: `/v3/projects/05452fa002bd49d08bd25fd083e77540/users/3e2099c6d6f24b3aa592ede87297b588/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.263019 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970a3ee-324c-46a8-80b5-829b330eaad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.263784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970a3ee-324c-46a8-80b5-829b330eaad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.264140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970a3ee-324c-46a8-80b5-829b330eaad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.264482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970a3ee-324c-46a8-80b5-829b330eaad4 admin admin] PATH_INFO: `/v3/projects/27d248cf4b464f9da58e5ba893a39c6e/users/e60ee4b856294e89a3d8e2d6f575a733/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.266601 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970a3ee-324c-46a8-80b5-829b330eaad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d248cf4b464f9da58e5ba893a39c6e, user_id=e60ee4b856294e89a3d8e2d6f575a733, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.267517 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:40.270309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970a3ee-324c-46a8-80b5-829b330eaad4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.276138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc99b49-722b-4d4e-b7b8-66c18c9ff02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=05452fa002bd49d08bd25fd083e77540, user_id=3e2099c6d6f24b3aa592ede87297b588, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.279955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc99b49-722b-4d4e-b7b8-66c18c9ff02c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.286596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1041/2061] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:40 2022] PUT /identity/v3/projects/27d248cf4b464f9da58e5ba893a39c6e/users/e60ee4b856294e89a3d8e2d6f575a733/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:40.296065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aa248-4fa1-4f50-b287-264eb9115382 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.296479 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aa248-4fa1-4f50-b287-264eb9115382 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.304799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1021/2062] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:40 2022] PUT /identity/v3/projects/05452fa002bd49d08bd25fd083e77540/users/3e2099c6d6f24b3aa592ede87297b588/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:40.304983 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aa248-4fa1-4f50-b287-264eb9115382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.309543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dab05-d031-4a2a-8ed7-4a3c53d9a70a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.309955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dab05-d031-4a2a-8ed7-4a3c53d9a70a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.310226 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dab05-d031-4a2a-8ed7-4a3c53d9a70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.349187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-135aa248-4fa1-4f50-b287-264eb9115382 None None] MFA Rules not processed for user `e60ee4b856294e89a3d8e2d6f575a733`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:40.350667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-135aa248-4fa1-4f50-b287-264eb9115382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:40.354767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-747dab05-d031-4a2a-8ed7-4a3c53d9a70a None None] MFA Rules not processed for user `3e2099c6d6f24b3aa592ede87297b588`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:40.356002 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-747dab05-d031-4a2a-8ed7-4a3c53d9a70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:40.433471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1022/2063] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:40.434415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dab05-d031-4a2a-8ed7-4a3c53d9a70a None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.451166 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1042/2064] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:40 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:40.464811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135aa248-4fa1-4f50-b287-264eb9115382 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.516565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dab05-d031-4a2a-8ed7-4a3c53d9a70a None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.521422 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bf94b-05ef-4f7e-91cd-873da7a6e77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.522046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bf94b-05ef-4f7e-91cd-873da7a6e77d admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.522329 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bf94b-05ef-4f7e-91cd-873da7a6e77d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.522655 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bf94b-05ef-4f7e-91cd-873da7a6e77d admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.523337 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bf94b-05ef-4f7e-91cd-873da7a6e77d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.525283 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bf94b-05ef-4f7e-91cd-873da7a6e77d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.529334 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135aa248-4fa1-4f50-b287-264eb9115382 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.534726 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e738705-be71-46d1-bc67-80bd340226de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.535404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e738705-be71-46d1-bc67-80bd340226de service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.535747 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e738705-be71-46d1-bc67-80bd340226de service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.536081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e738705-be71-46d1-bc67-80bd340226de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.545812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e738705-be71-46d1-bc67-80bd340226de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.547371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e738705-be71-46d1-bc67-80bd340226de service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.558145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1043/2065] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:40 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:35:40.564732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1023/2066] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:40 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:40.565844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e738705-be71-46d1-bc67-80bd340226de service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.582046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e738705-be71-46d1-bc67-80bd340226de service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.592855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:40.679843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1897ac-b9d0-445a-be87-c08ac7c4db64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.680577 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1897ac-b9d0-445a-be87-c08ac7c4db64 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.680867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1897ac-b9d0-445a-be87-c08ac7c4db64 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.681350 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1897ac-b9d0-445a-be87-c08ac7c4db64 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.682806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1897ac-b9d0-445a-be87-c08ac7c4db64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.686553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1897ac-b9d0-445a-be87-c08ac7c4db64 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.723591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1044/2067] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:40 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:40.726829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bf94b-05ef-4f7e-91cd-873da7a6e77d admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.745927 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bf94b-05ef-4f7e-91cd-873da7a6e77d admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.752885 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f7adb-1538-4c54-aa05-37de28970013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.753597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f7adb-1538-4c54-aa05-37de28970013 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.753977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f7adb-1538-4c54-aa05-37de28970013 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.754345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f7adb-1538-4c54-aa05-37de28970013 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.755149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f7adb-1538-4c54-aa05-37de28970013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.757848 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f7adb-1538-4c54-aa05-37de28970013 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.784072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1897ac-b9d0-445a-be87-c08ac7c4db64 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.792212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1024/2068] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:40.793540 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f7adb-1538-4c54-aa05-37de28970013 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.798091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1897ac-b9d0-445a-be87-c08ac7c4db64 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.804101 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51454918-02c7-407d-a00d-381ef5873ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.804763 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51454918-02c7-407d-a00d-381ef5873ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.805043 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51454918-02c7-407d-a00d-381ef5873ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.805322 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51454918-02c7-407d-a00d-381ef5873ef6 admin admin] PATH_INFO: `/v3/projects/afa8c2802e9a417d85aaaa4cc252cd58/users/28bf697b273d423bba9f82a70cf4e118/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.824275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51454918-02c7-407d-a00d-381ef5873ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa8c2802e9a417d85aaaa4cc252cd58, user_id=28bf697b273d423bba9f82a70cf4e118, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.827745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51454918-02c7-407d-a00d-381ef5873ef6 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.854296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1045/2069] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:40 2022] PUT /identity/v3/projects/afa8c2802e9a417d85aaaa4cc252cd58/users/28bf697b273d423bba9f82a70cf4e118/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:40.855424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51454918-02c7-407d-a00d-381ef5873ef6 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:40.875930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f7adb-1538-4c54-aa05-37de28970013 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.882208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:40.953776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51454918-02c7-407d-a00d-381ef5873ef6 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:40.960313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3848d2-7d40-44cc-a01c-8959e937a0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.961238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3848d2-7d40-44cc-a01c-8959e937a0cb admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.961801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3848d2-7d40-44cc-a01c-8959e937a0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.962079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3848d2-7d40-44cc-a01c-8959e937a0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.965331 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3848d2-7d40-44cc-a01c-8959e937a0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:40.965331 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3848d2-7d40-44cc-a01c-8959e937a0cb admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:40.985061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8a52b-9860-4398-997b-b129ed898bd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:40.985664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8a52b-9860-4398-997b-b129ed898bd3 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:40.985941 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8a52b-9860-4398-997b-b129ed898bd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:40.986208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8a52b-9860-4398-997b-b129ed898bd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:40.986644 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1046/2070] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:40.991621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3848d2-7d40-44cc-a01c-8959e937a0cb admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:41.014229 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3848d2-7d40-44cc-a01c-8959e937a0cb admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:41.022765 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff912c61-30f5-44d0-970a-e241e98ab749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:41.024006 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff912c61-30f5-44d0-970a-e241e98ab749 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:41.024006 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff912c61-30f5-44d0-970a-e241e98ab749 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:41.024205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff912c61-30f5-44d0-970a-e241e98ab749 admin admin] PATH_INFO: `/v3/projects/afa8c2802e9a417d85aaaa4cc252cd58/users/28bf697b273d423bba9f82a70cf4e118/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:41.026840 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff912c61-30f5-44d0-970a-e241e98ab749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa8c2802e9a417d85aaaa4cc252cd58, user_id=28bf697b273d423bba9f82a70cf4e118, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:41.030352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff912c61-30f5-44d0-970a-e241e98ab749 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:41.054547 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1047/2071] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:40 2022] PUT /identity/v3/projects/afa8c2802e9a417d85aaaa4cc252cd58/users/28bf697b273d423bba9f82a70cf4e118/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:41.060510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c86ba-548d-42e6-8d27-b7c38046bb87 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:41.061386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c86ba-548d-42e6-8d27-b7c38046bb87 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:41.061884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c86ba-548d-42e6-8d27-b7c38046bb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:41.100750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8a52b-9860-4398-997b-b129ed898bd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:41.102436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8a52b-9860-4398-997b-b129ed898bd3 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:41.108979 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f43c86ba-548d-42e6-8d27-b7c38046bb87 None None] MFA Rules not processed for user `28bf697b273d423bba9f82a70cf4e118`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:41.111671 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f43c86ba-548d-42e6-8d27-b7c38046bb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:41.116836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1025/2072] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:40 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:41.166408 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:41.200963 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1048/2073] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:41.235650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8a52b-9860-4398-997b-b129ed898bd3 service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:41.239067 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-27d8a52b-9860-4398-997b-b129ed898bd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:41.253291 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8a52b-9860-4398-997b-b129ed898bd3 service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:41.335084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adece1-06f9-4e92-a154-a07f8ce9cece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:41.335811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adece1-06f9-4e92-a154-a07f8ce9cece service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:41.336048 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adece1-06f9-4e92-a154-a07f8ce9cece service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:41.336308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adece1-06f9-4e92-a154-a07f8ce9cece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:41.421899 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adece1-06f9-4e92-a154-a07f8ce9cece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:41.424948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adece1-06f9-4e92-a154-a07f8ce9cece service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:41.442675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1026/2074] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:41.486304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c86ba-548d-42e6-8d27-b7c38046bb87 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:41.504899 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c86ba-548d-42e6-8d27-b7c38046bb87 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:41.516617 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafb466-bd61-444a-8473-61219d7acba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:41.517484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafb466-bd61-444a-8473-61219d7acba8 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:41.517783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafb466-bd61-444a-8473-61219d7acba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:41.518093 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafb466-bd61-444a-8473-61219d7acba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:41.528974 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5fafb466-bd61-444a-8473-61219d7acba8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:41.664049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafb466-bd61-444a-8473-61219d7acba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:41.667403 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafb466-bd61-444a-8473-61219d7acba8 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:41.685430 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1049/2075] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:42.487128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adece1-06f9-4e92-a154-a07f8ce9cece service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:42.496936 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adece1-06f9-4e92-a154-a07f8ce9cece service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:42.500116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafb466-bd61-444a-8473-61219d7acba8 service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:42.501253 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fc45e-25cb-454f-87fd-35839862c790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:42.501919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc45e-25cb-454f-87fd-35839862c790 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:42.502277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc45e-25cb-454f-87fd-35839862c790 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:42.502641 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc45e-25cb-454f-87fd-35839862c790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:42.504490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-057fc45e-25cb-454f-87fd-35839862c790 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:42.508702 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafb466-bd61-444a-8473-61219d7acba8 service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:42.515041 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1772b13-3cd5-4acc-b85b-c37ff9303b3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:42.516388 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1772b13-3cd5-4acc-b85b-c37ff9303b3b service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:42.516675 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1772b13-3cd5-4acc-b85b-c37ff9303b3b service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:42.516950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1772b13-3cd5-4acc-b85b-c37ff9303b3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:42.519610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:42.573981 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fc45e-25cb-454f-87fd-35839862c790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:42.575995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fc45e-25cb-454f-87fd-35839862c790 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:42.585218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1027/2076] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:42.586179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1772b13-3cd5-4acc-b85b-c37ff9303b3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:42.587775 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1772b13-3cd5-4acc-b85b-c37ff9303b3b service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:42.598401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1050/2077] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:35:43.359810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fc45e-25cb-454f-87fd-35839862c790 service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:43.368318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fc45e-25cb-454f-87fd-35839862c790 service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:43.372620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c473dd8-4371-41c6-a6ab-1a4198ed358f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:43.373218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c473dd8-4371-41c6-a6ab-1a4198ed358f service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:43.373494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c473dd8-4371-41c6-a6ab-1a4198ed358f service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:43.373762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c473dd8-4371-41c6-a6ab-1a4198ed358f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:43.452600 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c473dd8-4371-41c6-a6ab-1a4198ed358f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:43.454233 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c473dd8-4371-41c6-a6ab-1a4198ed358f service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:43.466930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1028/2078] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:44.232268 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1772b13-3cd5-4acc-b85b-c37ff9303b3b service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:44.241030 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1772b13-3cd5-4acc-b85b-c37ff9303b3b service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:44.245148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196d2a1-4181-4908-a71d-04f6d528d010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:44.245842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196d2a1-4181-4908-a71d-04f6d528d010 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:44.246200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196d2a1-4181-4908-a71d-04f6d528d010 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:44.247169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196d2a1-4181-4908-a71d-04f6d528d010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:44.257247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196d2a1-4181-4908-a71d-04f6d528d010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:44.258939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196d2a1-4181-4908-a71d-04f6d528d010 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:44.270313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1051/2079] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:45.028343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c473dd8-4371-41c6-a6ab-1a4198ed358f service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:45.029765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6c473dd8-4371-41c6-a6ab-1a4198ed358f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:45.109722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c473dd8-4371-41c6-a6ab-1a4198ed358f service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:45.114327 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:45.115002 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:45.115785 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:45.115785 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] PATH_INFO: `/v3/users/79f5938295bc4dd1b37ca72464f4a533` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:45.116848 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f5938295bc4dd1b37ca72464f4a533)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:45.119409 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:45.192294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f5938295bc4dd1b37ca72464f4a533'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:45.193011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f5938295bc4dd1b37ca72464f4a533'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:45.204264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f5938295bc4dd1b37ca72464f4a533'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:45.205038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f5938295bc4dd1b37ca72464f4a533'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:45.207753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:45.249942 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f5938295bc4dd1b37ca72464f4a533'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:45.265116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1029/2080] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:45 2022] DELETE /identity/v3/users/79f5938295bc4dd1b37ca72464f4a533 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:45.269355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81160c-2a51-46e9-ad52-843ef8e41901 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:45.269876 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81160c-2a51-46e9-ad52-843ef8e41901 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:45.269876 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81160c-2a51-46e9-ad52-843ef8e41901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:45.289847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-bc81160c-2a51-46e9-ad52-843ef8e41901 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:45.291272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-bc81160c-2a51-46e9-ad52-843ef8e41901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:45.367376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1052/2081] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:45.382570 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:45.382570 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:45.480948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14e942-407b-45b7-a41b-58e4b18172fc admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:45.488019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96418f-f301-4f46-9cc7-8fe7107172c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:45.489940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96418f-f301-4f46-9cc7-8fe7107172c9 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:45.490433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96418f-f301-4f46-9cc7-8fe7107172c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:45.490923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96418f-f301-4f46-9cc7-8fe7107172c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:45.505300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96418f-f301-4f46-9cc7-8fe7107172c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:45.508147 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96418f-f301-4f46-9cc7-8fe7107172c9 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:45.534660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1030/2082] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:45.853137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81160c-2a51-46e9-ad52-843ef8e41901 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:45.854727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-bc81160c-2a51-46e9-ad52-843ef8e41901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:45.863475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:45.867414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81160c-2a51-46e9-ad52-843ef8e41901 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:45.873132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:45.874027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:45.874304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:45.874604 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] PATH_INFO: `/v3/projects/18246368c10c473fb0a36c55eecae9a0` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:45.875809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18246368c10c473fb0a36c55eecae9a0)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:45.877763 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:45.941375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18246368c10c473fb0a36c55eecae9a0', 'request_id': 'req-9d905a2b-37ad-4496-94b1-b4484e8707f8'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:45.955532 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18246368c10c473fb0a36c55eecae9a0', 'request_id': 'req-9d905a2b-37ad-4496-94b1-b4484e8707f8'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:45.967647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18246368c10c473fb0a36c55eecae9a0', 'request_id': 'req-9d905a2b-37ad-4496-94b1-b4484e8707f8'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:45.981958 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] The token cache is being invalidate because project 18246368c10c473fb0a36c55eecae9a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:45.982252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:45.982971 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:45.984674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1053/2083] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:45 2022] DELETE /identity/v3/projects/18246368c10c473fb0a36c55eecae9a0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:45.988872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96418f-f301-4f46-9cc7-8fe7107172c9 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:46.000307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96418f-f301-4f46-9cc7-8fe7107172c9 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:46.083647 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:46.084267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:46.084557 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:46.084836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] PATH_INFO: `/v3/users/f4be21ad550d431d89aa188df39ec248` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:46.086000 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4be21ad550d431d89aa188df39ec248)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:46.088009 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:46.143222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4be21ad550d431d89aa188df39ec248'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.144413 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4be21ad550d431d89aa188df39ec248'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.155828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4be21ad550d431d89aa188df39ec248'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.156563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4be21ad550d431d89aa188df39ec248'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.169975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4be21ad550d431d89aa188df39ec248'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.175489 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:46.185686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1031/2084] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:45 2022] DELETE /identity/v3/users/f4be21ad550d431d89aa188df39ec248 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:46.460269 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:46.461826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:46.475977 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d905a2b-37ad-4496-94b1-b4484e8707f8 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:46.534117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:46.534780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:46.535057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:46.535326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] PATH_INFO: `/v3/projects/3d121b5e75da438da883d3ed9ceff9b4` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:46.536510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d121b5e75da438da883d3ed9ceff9b4)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:46.538309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:46.590998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d121b5e75da438da883d3ed9ceff9b4', 'request_id': 'req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.598739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d121b5e75da438da883d3ed9ceff9b4', 'request_id': 'req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.608526 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d121b5e75da438da883d3ed9ceff9b4', 'request_id': 'req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.624637 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] The token cache is being invalidate because project 3d121b5e75da438da883d3ed9ceff9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:46.625124 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.626131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.628138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1054/2085] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:46 2022] DELETE /identity/v3/projects/3d121b5e75da438da883d3ed9ceff9b4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:46.632327 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:46.634782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:46.654836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e93dc-52c3-49c9-b7c0-554d00aef460 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:46.746406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:46.748513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043bd5f-a159-45e8-98db-4334d8297b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:46.749038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:46.750162 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043bd5f-a159-45e8-98db-4334d8297b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:46.750338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043bd5f-a159-45e8-98db-4334d8297b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:46.750628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043bd5f-a159-45e8-98db-4334d8297b4e admin admin] PATH_INFO: `/v3/users/08a3af510df342a8a58106f2d27f9f4f` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:46.751808 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043bd5f-a159-45e8-98db-4334d8297b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a3af510df342a8a58106f2d27f9f4f)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:46.753739 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043bd5f-a159-45e8-98db-4334d8297b4e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:46.776366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15436290-26d6-4d8f-a1e2-8da8e1ad1ba4 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:46.786486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:46.787442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:46.787942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:46.788402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] PATH_INFO: `/v3/users/7f753d4f6b2c4936b46968cc378e0c26` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:46.790419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f753d4f6b2c4936b46968cc378e0c26)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:46.794693 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:46.813011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d043bd5f-a159-45e8-98db-4334d8297b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a3af510df342a8a58106f2d27f9f4f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.814023 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d043bd5f-a159-45e8-98db-4334d8297b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a3af510df342a8a58106f2d27f9f4f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.816772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:46.825847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d043bd5f-a159-45e8-98db-4334d8297b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a3af510df342a8a58106f2d27f9f4f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.826872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d043bd5f-a159-45e8-98db-4334d8297b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a3af510df342a8a58106f2d27f9f4f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.845261 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d043bd5f-a159-45e8-98db-4334d8297b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a3af510df342a8a58106f2d27f9f4f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.860216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1032/2086] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:46 2022] DELETE /identity/v3/users/08a3af510df342a8a58106f2d27f9f4f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:46.868462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f753d4f6b2c4936b46968cc378e0c26'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.869631 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f753d4f6b2c4936b46968cc378e0c26'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.884437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f753d4f6b2c4936b46968cc378e0c26'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.899871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f753d4f6b2c4936b46968cc378e0c26'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.900887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f753d4f6b2c4936b46968cc378e0c26'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:46.924468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1055/2087] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:46 2022] DELETE /identity/v3/users/7f753d4f6b2c4936b46968cc378e0c26 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:46.929149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac8a98-c27b-4be9-851c-f8b2cdd31777 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:46.929435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac8a98-c27b-4be9-851c-f8b2cdd31777 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:46.929707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac8a98-c27b-4be9-851c-f8b2cdd31777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:46.949756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-1bac8a98-c27b-4be9-851c-f8b2cdd31777 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:46.950997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1bac8a98-c27b-4be9-851c-f8b2cdd31777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:47.022552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1033/2088] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:47.032574 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:47.034252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:47.119092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1938bf-1a7d-4be5-8c8b-ef9fa3333001 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:47.124829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8ab39-d12a-4c59-8065-f11288819add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:47.125446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8ab39-d12a-4c59-8065-f11288819add service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:47.125851 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8ab39-d12a-4c59-8065-f11288819add service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:47.126128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8ab39-d12a-4c59-8065-f11288819add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:47.139261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8ab39-d12a-4c59-8065-f11288819add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:47.140771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8ab39-d12a-4c59-8065-f11288819add service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:47.160281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1056/2089] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:47.214459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac8a98-c27b-4be9-851c-f8b2cdd31777 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:47.217060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1bac8a98-c27b-4be9-851c-f8b2cdd31777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:47.235969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac8a98-c27b-4be9-851c-f8b2cdd31777 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:47.252445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:47.254807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:47.256464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:47.256829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c admin admin] PATH_INFO: `/v3/projects/6c4750df43074c90afedd0aaa12d82b0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:47.259783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4750df43074c90afedd0aaa12d82b0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:47.263255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:47.280955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:47.355385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4750df43074c90afedd0aaa12d82b0', 'request_id': 'req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.363858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4750df43074c90afedd0aaa12d82b0', 'request_id': 'req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.376287 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4750df43074c90afedd0aaa12d82b0', 'request_id': 'req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.410916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c admin admin] The token cache is being invalidate because project 6c4750df43074c90afedd0aaa12d82b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:47.411215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.414908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0042e4dc-0e4c-42ef-8da1-56a9b39d458c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.419373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8ab39-d12a-4c59-8065-f11288819add service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:47.420130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1034/2090] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:47 2022] DELETE /identity/v3/projects/6c4750df43074c90afedd0aaa12d82b0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:47.421537 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f1a8ab39-d12a-4c59-8065-f11288819add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:47.426083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414896-926a-423d-89ac-9bc34c7228f6 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:47.426660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414896-926a-423d-89ac-9bc34c7228f6 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:47.427073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414896-926a-423d-89ac-9bc34c7228f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:47.439094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8ab39-d12a-4c59-8065-f11288819add service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:47.456687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-d5414896-926a-423d-89ac-9bc34c7228f6 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:47.462653 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d5414896-926a-423d-89ac-9bc34c7228f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:47.520024 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:47.520982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:47.521286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:47.523246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] PATH_INFO: `/v3/users/de536bb5f63b4c6fbeb59ed7fd369587` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:47.526540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=de536bb5f63b4c6fbeb59ed7fd369587)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:47.530347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:47.552037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1035/2091] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:47.562058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2208d5-9e09-482a-946c-2149b8f94e91 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:47.562392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2208d5-9e09-482a-946c-2149b8f94e91 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:47.562644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2208d5-9e09-482a-946c-2149b8f94e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:47.596102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-af2208d5-9e09-482a-946c-2149b8f94e91 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:47.597477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-af2208d5-9e09-482a-946c-2149b8f94e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:47.607746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:47.609161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1036/2092] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:47.610566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2208d5-9e09-482a-946c-2149b8f94e91 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:47.611664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-af2208d5-9e09-482a-946c-2149b8f94e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:47.625219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de536bb5f63b4c6fbeb59ed7fd369587'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.625826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de536bb5f63b4c6fbeb59ed7fd369587'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.628803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2208d5-9e09-482a-946c-2149b8f94e91 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:47.635357 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de536bb5f63b4c6fbeb59ed7fd369587'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.641820 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af12a73-c041-4234-b455-e2a8e0c2f2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:47.642624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af12a73-c041-4234-b455-e2a8e0c2f2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:47.643097 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af12a73-c041-4234-b455-e2a8e0c2f2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:47.643504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af12a73-c041-4234-b455-e2a8e0c2f2ef admin admin] PATH_INFO: `/v3/projects/2d9879992db64d0bbc407ae36253d18e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:47.644792 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af12a73-c041-4234-b455-e2a8e0c2f2ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9879992db64d0bbc407ae36253d18e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:47.644912 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de536bb5f63b4c6fbeb59ed7fd369587'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.646549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de536bb5f63b4c6fbeb59ed7fd369587'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.647665 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af12a73-c041-4234-b455-e2a8e0c2f2ef admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:47.671993 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1057/2093] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:47 2022] DELETE /identity/v3/users/de536bb5f63b4c6fbeb59ed7fd369587 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:47.673133 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:47.675348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:47.708164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9af12a73-c041-4234-b455-e2a8e0c2f2ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9879992db64d0bbc407ae36253d18e', 'request_id': 'req-9af12a73-c041-4234-b455-e2a8e0c2f2ef'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.715093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9af12a73-c041-4234-b455-e2a8e0c2f2ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9879992db64d0bbc407ae36253d18e', 'request_id': 'req-9af12a73-c041-4234-b455-e2a8e0c2f2ef'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.724241 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9af12a73-c041-4234-b455-e2a8e0c2f2ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9879992db64d0bbc407ae36253d18e', 'request_id': 'req-9af12a73-c041-4234-b455-e2a8e0c2f2ef'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.740875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9af12a73-c041-4234-b455-e2a8e0c2f2ef admin admin] The token cache is being invalidate because project 2d9879992db64d0bbc407ae36253d18e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:47.741734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9af12a73-c041-4234-b455-e2a8e0c2f2ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.742003 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9af12a73-c041-4234-b455-e2a8e0c2f2ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.744043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1037/2094] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:47 2022] DELETE /identity/v3/projects/2d9879992db64d0bbc407ae36253d18e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:47.745921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ffc12-ef09-4e29-8779-0c20437858bf None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:47.746930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ffc12-ef09-4e29-8779-0c20437858bf None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:47.748386 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ffc12-ef09-4e29-8779-0c20437858bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:47.757336 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b6a0e-25c3-49eb-8adf-c0757d2af9ac admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:47.773965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b19ffc12-ef09-4e29-8779-0c20437858bf None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:47.775224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b19ffc12-ef09-4e29-8779-0c20437858bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:47.786427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:47.821210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d0428-b7c1-4ba7-8a32-adb13f144ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:47.821825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d0428-b7c1-4ba7-8a32-adb13f144ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:47.822107 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d0428-b7c1-4ba7-8a32-adb13f144ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:47.822379 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d0428-b7c1-4ba7-8a32-adb13f144ce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:47.823061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d0428-b7c1-4ba7-8a32-adb13f144ce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:47.823370 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d0428-b7c1-4ba7-8a32-adb13f144ce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:47.825501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d0428-b7c1-4ba7-8a32-adb13f144ce9 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:47.837662 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1058/2095] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:47.838826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d0428-b7c1-4ba7-8a32-adb13f144ce9 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:47.841294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-766d0428-b7c1-4ba7-8a32-adb13f144ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:47.854033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d0428-b7c1-4ba7-8a32-adb13f144ce9 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:47.857396 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1038/2096] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:47.860764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ffc12-ef09-4e29-8779-0c20437858bf None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:47.860764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b19ffc12-ef09-4e29-8779-0c20437858bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:47.868641 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:47.869425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:47.869711 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:47.869987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] PATH_INFO: `/v3/users/bb7ee55354da45d6802a241289bbabfa` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:47.871378 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7ee55354da45d6802a241289bbabfa)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:47.873305 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:47.874158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ffc12-ef09-4e29-8779-0c20437858bf None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:47.881100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918898a8-8cfc-45aa-a460-fb34d102eab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:47.881861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918898a8-8cfc-45aa-a460-fb34d102eab4 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:47.882240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918898a8-8cfc-45aa-a460-fb34d102eab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:47.882648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918898a8-8cfc-45aa-a460-fb34d102eab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:47.883390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918898a8-8cfc-45aa-a460-fb34d102eab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:47.885902 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918898a8-8cfc-45aa-a460-fb34d102eab4 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:47.925653 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1039/2097] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:47 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:47.925653 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918898a8-8cfc-45aa-a460-fb34d102eab4 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:47.925653 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-918898a8-8cfc-45aa-a460-fb34d102eab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:47.935582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7ee55354da45d6802a241289bbabfa'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.937215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7ee55354da45d6802a241289bbabfa'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.938725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:47.950255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7ee55354da45d6802a241289bbabfa'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.962177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7ee55354da45d6802a241289bbabfa'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.963492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7ee55354da45d6802a241289bbabfa'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:47.988218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1059/2098] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:47 2022] DELETE /identity/v3/users/bb7ee55354da45d6802a241289bbabfa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:47.989387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:47.990389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:48.009311 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918898a8-8cfc-45aa-a460-fb34d102eab4 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:48.076157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d42d80-7876-48cb-980f-032c786e6beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:48.077051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d42d80-7876-48cb-980f-032c786e6beb service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:48.077334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d42d80-7876-48cb-980f-032c786e6beb service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:48.077612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d42d80-7876-48cb-980f-032c786e6beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:48.079924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b7d42d80-7876-48cb-980f-032c786e6beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:48.093987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce10096-67ad-474f-b94e-53c33e3c9f66 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:48.101010 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de9467-dca9-45f7-a81b-8240c021a75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:48.102798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de9467-dca9-45f7-a81b-8240c021a75f admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:48.102798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de9467-dca9-45f7-a81b-8240c021a75f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:48.102798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de9467-dca9-45f7-a81b-8240c021a75f admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:48.103359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de9467-dca9-45f7-a81b-8240c021a75f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:48.106148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de9467-dca9-45f7-a81b-8240c021a75f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:48.114751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d42d80-7876-48cb-980f-032c786e6beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:48.117045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d42d80-7876-48cb-980f-032c786e6beb service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:48.141313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1060/2099] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:47 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:48.145761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de9467-dca9-45f7-a81b-8240c021a75f admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:48.161209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de9467-dca9-45f7-a81b-8240c021a75f admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:48.163183 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1040/2100] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:48.166966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f255c-31ee-4df2-8dc7-e8b4d71ec617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:48.167602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f255c-31ee-4df2-8dc7-e8b4d71ec617 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:48.167887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f255c-31ee-4df2-8dc7-e8b4d71ec617 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:48.168845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f255c-31ee-4df2-8dc7-e8b4d71ec617 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:48.170096 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f255c-31ee-4df2-8dc7-e8b4d71ec617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:48.171875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f255c-31ee-4df2-8dc7-e8b4d71ec617 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:48.185085 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1061/2101] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:35:48.187979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d42d80-7876-48cb-980f-032c786e6beb service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:48.198719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d42d80-7876-48cb-980f-032c786e6beb service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:48.209328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6857f31-6b56-4b72-b9af-202dace1bc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:48.210865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6857f31-6b56-4b72-b9af-202dace1bc80 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:48.211319 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6857f31-6b56-4b72-b9af-202dace1bc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:48.212251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6857f31-6b56-4b72-b9af-202dace1bc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:48.213083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6857f31-6b56-4b72-b9af-202dace1bc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:48.215870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6857f31-6b56-4b72-b9af-202dace1bc80 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:48.234389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1041/2102] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:48.236838 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f255c-31ee-4df2-8dc7-e8b4d71ec617 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:48.250548 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f255c-31ee-4df2-8dc7-e8b4d71ec617 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:48.258127 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1edf3-412f-43eb-bef5-60059855e697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:48.259733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1edf3-412f-43eb-bef5-60059855e697 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:48.260218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1edf3-412f-43eb-bef5-60059855e697 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:48.261824 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1edf3-412f-43eb-bef5-60059855e697 admin admin] PATH_INFO: `/v3/projects/e49838fbea3140d4b1356d970a9fcb37/users/0ba6c997faa94a34a8ea4497c3e6dec9/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:48.288654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1edf3-412f-43eb-bef5-60059855e697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49838fbea3140d4b1356d970a9fcb37, user_id=0ba6c997faa94a34a8ea4497c3e6dec9, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:48.291691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1edf3-412f-43eb-bef5-60059855e697 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:48.308839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1062/2103] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:48 2022] PUT /identity/v3/projects/e49838fbea3140d4b1356d970a9fcb37/users/0ba6c997faa94a34a8ea4497c3e6dec9/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:48.320780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054bb4d-eb6e-46e2-8d32-14fd808e42e8 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:48.321108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054bb4d-eb6e-46e2-8d32-14fd808e42e8 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:48.321404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054bb4d-eb6e-46e2-8d32-14fd808e42e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:48.368181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-8054bb4d-eb6e-46e2-8d32-14fd808e42e8 None None] MFA Rules not processed for user `0ba6c997faa94a34a8ea4497c3e6dec9`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:48.369239 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8054bb4d-eb6e-46e2-8d32-14fd808e42e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:48.407339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1edf3-412f-43eb-bef5-60059855e697 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:48.409451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b0f1edf3-412f-43eb-bef5-60059855e697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:48.459503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:48.520293 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1edf3-412f-43eb-bef5-60059855e697 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:48.523062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1042/2104] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:48.524076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054bb4d-eb6e-46e2-8d32-14fd808e42e8 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:48.525543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8054bb4d-eb6e-46e2-8d32-14fd808e42e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:48.526116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:48.528052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:48.528434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:48.528790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] PATH_INFO: `/v3/users/b7f65984e7074150b07e59952fce73e6` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:48.530137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f65984e7074150b07e59952fce73e6)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:48.532656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:48.545060 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054bb4d-eb6e-46e2-8d32-14fd808e42e8 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:48.553360 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:48.554353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:48.554725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:48.555074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] PATH_INFO: `/v3/projects/aaa6e1d88fbd468d9055e50bddebdbad` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:48.556821 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa6e1d88fbd468d9055e50bddebdbad)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:48.559657 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:48.561678 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:48.610839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f65984e7074150b07e59952fce73e6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.610839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f65984e7074150b07e59952fce73e6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.620338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f65984e7074150b07e59952fce73e6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.631818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa6e1d88fbd468d9055e50bddebdbad', 'request_id': 'req-b03b6d0c-1afa-41e8-9932-09e97c12df49'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.637977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa6e1d88fbd468d9055e50bddebdbad', 'request_id': 'req-b03b6d0c-1afa-41e8-9932-09e97c12df49'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.639296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f65984e7074150b07e59952fce73e6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.639950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f65984e7074150b07e59952fce73e6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.649417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa6e1d88fbd468d9055e50bddebdbad', 'request_id': 'req-b03b6d0c-1afa-41e8-9932-09e97c12df49'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.665212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1063/2105] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:48 2022] DELETE /identity/v3/users/b7f65984e7074150b07e59952fce73e6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:48.666086 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] The token cache is being invalidate because project aaa6e1d88fbd468d9055e50bddebdbad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:48.666247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:48.666529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.667697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:48.667824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.670104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1043/2106] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:48 2022] DELETE /identity/v3/projects/aaa6e1d88fbd468d9055e50bddebdbad => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:48.671017 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:48.672431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:48.749549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b6d0c-1afa-41e8-9932-09e97c12df49 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:48.750483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80224a6d-8b5e-4c95-be5a-56df78c2dc93 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:48.754896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:48.755661 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:48.755948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:48.756249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] PATH_INFO: `/v3/projects/2735fc53775345b68cfff1bc6294d20b` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:48.756675 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc124ed-f89e-45d1-9130-24302ee0c315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:48.757442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc124ed-f89e-45d1-9130-24302ee0c315 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:48.757567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2735fc53775345b68cfff1bc6294d20b)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:48.757979 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc124ed-f89e-45d1-9130-24302ee0c315 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:48.758412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc124ed-f89e-45d1-9130-24302ee0c315 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:48.759351 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc124ed-f89e-45d1-9130-24302ee0c315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:48.759513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:48.762075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc124ed-f89e-45d1-9130-24302ee0c315 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:48.797788 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1064/2107] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:48 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:48.799207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68fbd4-aaf4-4722-b89a-cc3a5630d6d6 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:48.799497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68fbd4-aaf4-4722-b89a-cc3a5630d6d6 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:48.800002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68fbd4-aaf4-4722-b89a-cc3a5630d6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:48.814705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2735fc53775345b68cfff1bc6294d20b', 'request_id': 'req-493fd51c-b4e0-410a-9ba0-73cfbd183139'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.818810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:48.824461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2735fc53775345b68cfff1bc6294d20b', 'request_id': 'req-493fd51c-b4e0-410a-9ba0-73cfbd183139'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.826687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-4b68fbd4-aaf4-4722-b89a-cc3a5630d6d6 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:48.828140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4b68fbd4-aaf4-4722-b89a-cc3a5630d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:48.836913 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2735fc53775345b68cfff1bc6294d20b', 'request_id': 'req-493fd51c-b4e0-410a-9ba0-73cfbd183139'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.853541 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] The token cache is being invalidate because project 2735fc53775345b68cfff1bc6294d20b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:48.854618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.856076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:48.858150 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1044/2108] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:48 2022] DELETE /identity/v3/projects/2735fc53775345b68cfff1bc6294d20b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:48.859480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:48.862136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:48.912287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1065/2109] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:48.913268 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68fbd4-aaf4-4722-b89a-cc3a5630d6d6 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:48.914806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4b68fbd4-aaf4-4722-b89a-cc3a5630d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:48.937639 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68fbd4-aaf4-4722-b89a-cc3a5630d6d6 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:48.947943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d9a25-e7c0-4bdb-81c7-e7916a3f8aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:48.948672 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d9a25-e7c0-4bdb-81c7-e7916a3f8aad admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:48.949015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d9a25-e7c0-4bdb-81c7-e7916a3f8aad admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:48.949480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d9a25-e7c0-4bdb-81c7-e7916a3f8aad admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:48.950193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d9a25-e7c0-4bdb-81c7-e7916a3f8aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:48.952362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d9a25-e7c0-4bdb-81c7-e7916a3f8aad admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:48.984999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1066/2110] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:48 2022] POST /identity/v3/users => generated 298 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:48.989078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d9a25-e7c0-4bdb-81c7-e7916a3f8aad admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:48.991006 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-672d9a25-e7c0-4bdb-81c7-e7916a3f8aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:49.006584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fd51c-b4e0-410a-9ba0-73cfbd183139 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:49.006711 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d9a25-e7c0-4bdb-81c7-e7916a3f8aad admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:49.011728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:49.012938 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:49.013072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:49.013299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] PATH_INFO: `/v3/users/e60ee4b856294e89a3d8e2d6f575a733` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:49.014677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e60ee4b856294e89a3d8e2d6f575a733)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:49.017142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:49.018160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:49.018856 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:49.019264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:49.019383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] PATH_INFO: `/v3/users/136f81c2c78d4bd3a618779d69bb79ed` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:49.021940 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:49.022145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=136f81c2c78d4bd3a618779d69bb79ed)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:49.025558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:49.086839 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136f81c2c78d4bd3a618779d69bb79ed'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:49.087711 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136f81c2c78d4bd3a618779d69bb79ed'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:49.098369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136f81c2c78d4bd3a618779d69bb79ed'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:49.099459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136f81c2c78d4bd3a618779d69bb79ed'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:49.100656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e60ee4b856294e89a3d8e2d6f575a733'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:49.101521 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e60ee4b856294e89a3d8e2d6f575a733'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:49.111788 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e60ee4b856294e89a3d8e2d6f575a733'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:49.118600 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136f81c2c78d4bd3a618779d69bb79ed'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:49.124208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e60ee4b856294e89a3d8e2d6f575a733'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:49.124847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e60ee4b856294e89a3d8e2d6f575a733'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:49.144043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1045/2111] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:48 2022] DELETE /identity/v3/users/136f81c2c78d4bd3a618779d69bb79ed => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:49.145301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:49.145772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1067/2112] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:48 2022] DELETE /identity/v3/users/e60ee4b856294e89a3d8e2d6f575a733 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:49.146673 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:49.149625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:49.150807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:49.259734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234ba5d-131f-4f64-9e8d-ae69b9d17853 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:49.268265 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0ee33-d657-4b72-b4a6-5bb8e82531d4 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:49.268848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72df14-9697-4584-a9fb-9106912581df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:49.269159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72df14-9697-4584-a9fb-9106912581df admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:49.269514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72df14-9697-4584-a9fb-9106912581df admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:49.269858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72df14-9697-4584-a9fb-9106912581df admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:49.270669 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72df14-9697-4584-a9fb-9106912581df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:49.272440 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72df14-9697-4584-a9fb-9106912581df admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:49.285894 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1068/2113] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:49.288947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:49.291046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72df14-9697-4584-a9fb-9106912581df admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:49.309832 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72df14-9697-4584-a9fb-9106912581df admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:49.323016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc94e6b-106d-468d-9365-3f45e8fb8879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:49.325397 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc94e6b-106d-468d-9365-3f45e8fb8879 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:49.327820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc94e6b-106d-468d-9365-3f45e8fb8879 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:49.328354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc94e6b-106d-468d-9365-3f45e8fb8879 admin admin] PATH_INFO: `/v3/projects/8e7b09690f804038b72e449d79599ca1/users/550dec9838544788a3c427341c443fd2/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:49.346302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3bf2c-25b5-4486-9562-ad2d54022ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:49.346927 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3bf2c-25b5-4486-9562-ad2d54022ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:49.347334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3bf2c-25b5-4486-9562-ad2d54022ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:49.347945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3bf2c-25b5-4486-9562-ad2d54022ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:49.350695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b6c3bf2c-25b5-4486-9562-ad2d54022ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:49.355018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc94e6b-106d-468d-9365-3f45e8fb8879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7b09690f804038b72e449d79599ca1, user_id=550dec9838544788a3c427341c443fd2, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:49.359446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc94e6b-106d-468d-9365-3f45e8fb8879 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:49.368175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3bf2c-25b5-4486-9562-ad2d54022ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:49.369813 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3bf2c-25b5-4486-9562-ad2d54022ea7 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:49.381029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1069/2114] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:49 2022] PUT /identity/v3/projects/8e7b09690f804038b72e449d79599ca1/users/550dec9838544788a3c427341c443fd2/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:49.382542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1046/2115] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:49.385563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc94e6b-106d-468d-9365-3f45e8fb8879 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:49.452841 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:49.469084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc94e6b-106d-468d-9365-3f45e8fb8879 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:49.475460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616a62d-5202-4edc-855a-e96bd85063dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:49.476149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616a62d-5202-4edc-855a-e96bd85063dd admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:49.476769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616a62d-5202-4edc-855a-e96bd85063dd admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:49.476769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616a62d-5202-4edc-855a-e96bd85063dd admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:49.477596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616a62d-5202-4edc-855a-e96bd85063dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:49.479488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616a62d-5202-4edc-855a-e96bd85063dd admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:49.493393 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1070/2116] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:49.497773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3bf2c-25b5-4486-9562-ad2d54022ea7 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:49.507768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3bf2c-25b5-4486-9562-ad2d54022ea7 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:49.513368 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873972-ebfd-46fa-8612-94b0ad7c1347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:49.514023 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873972-ebfd-46fa-8612-94b0ad7c1347 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:49.514302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873972-ebfd-46fa-8612-94b0ad7c1347 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:49.514610 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873972-ebfd-46fa-8612-94b0ad7c1347 admin admin] PATH_INFO: `/v3/projects/8e7b09690f804038b72e449d79599ca1/users/550dec9838544788a3c427341c443fd2/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:49.516836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b873972-ebfd-46fa-8612-94b0ad7c1347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7b09690f804038b72e449d79599ca1, user_id=550dec9838544788a3c427341c443fd2, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:49.519311 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b873972-ebfd-46fa-8612-94b0ad7c1347 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:49.532487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1047/2117] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:49 2022] PUT /identity/v3/projects/8e7b09690f804038b72e449d79599ca1/users/550dec9838544788a3c427341c443fd2/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:49.543318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f05a9-cd25-4136-8154-6be5a1133da3 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:49.543879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f05a9-cd25-4136-8154-6be5a1133da3 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:49.543879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f05a9-cd25-4136-8154-6be5a1133da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:49.583549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-528f05a9-cd25-4136-8154-6be5a1133da3 None None] MFA Rules not processed for user `550dec9838544788a3c427341c443fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:49.584814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-528f05a9-cd25-4136-8154-6be5a1133da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:49.692928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1071/2118] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:49.705865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873972-ebfd-46fa-8612-94b0ad7c1347 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:49.708459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1b873972-ebfd-46fa-8612-94b0ad7c1347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:49.817303 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873972-ebfd-46fa-8612-94b0ad7c1347 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:49.823662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb615f-317e-45ba-a925-011995712568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:49.825326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb615f-317e-45ba-a925-011995712568 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:49.825758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb615f-317e-45ba-a925-011995712568 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:49.827679 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb615f-317e-45ba-a925-011995712568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:49.841431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb615f-317e-45ba-a925-011995712568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:49.843638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb615f-317e-45ba-a925-011995712568 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:49.847511 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f05a9-cd25-4136-8154-6be5a1133da3 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:49.849511 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-528f05a9-cd25-4136-8154-6be5a1133da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:49.897580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1048/2119] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:49.965434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f05a9-cd25-4136-8154-6be5a1133da3 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:49.972312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:49.973364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:49.973648 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:49.973923 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] PATH_INFO: `/v3/projects/a047b2d7e36c4a64adae44071ee7dda5` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:49.975965 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a047b2d7e36c4a64adae44071ee7dda5)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:49.979122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:50.004938 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb615f-317e-45ba-a925-011995712568 service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:50.006909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e3eb615f-317e-45ba-a925-011995712568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:50.043930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb615f-317e-45ba-a925-011995712568 service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:50.060949 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d03c7-c18f-4693-8d4e-14963461da2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:50.061740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d03c7-c18f-4693-8d4e-14963461da2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:50.062179 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d03c7-c18f-4693-8d4e-14963461da2f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:50.062566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d03c7-c18f-4693-8d4e-14963461da2f admin admin] PATH_INFO: `/v3/projects/27d248cf4b464f9da58e5ba893a39c6e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:50.064030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d03c7-c18f-4693-8d4e-14963461da2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d248cf4b464f9da58e5ba893a39c6e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:50.066359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d03c7-c18f-4693-8d4e-14963461da2f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:50.079859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a047b2d7e36c4a64adae44071ee7dda5', 'request_id': 'req-1565a034-3548-420f-9fd4-6feb09a277e0'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.086873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a047b2d7e36c4a64adae44071ee7dda5', 'request_id': 'req-1565a034-3548-420f-9fd4-6feb09a277e0'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.098664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a047b2d7e36c4a64adae44071ee7dda5', 'request_id': 'req-1565a034-3548-420f-9fd4-6feb09a277e0'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.116703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] The token cache is being invalidate because project a047b2d7e36c4a64adae44071ee7dda5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:50.117049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.117960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.124877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1072/2120] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:49 2022] DELETE /identity/v3/projects/a047b2d7e36c4a64adae44071ee7dda5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:50.124877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:50.125577 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:50.134245 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:50.136465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-012d03c7-c18f-4693-8d4e-14963461da2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d248cf4b464f9da58e5ba893a39c6e', 'request_id': 'req-012d03c7-c18f-4693-8d4e-14963461da2f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.151832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-012d03c7-c18f-4693-8d4e-14963461da2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d248cf4b464f9da58e5ba893a39c6e', 'request_id': 'req-012d03c7-c18f-4693-8d4e-14963461da2f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.179987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-012d03c7-c18f-4693-8d4e-14963461da2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d248cf4b464f9da58e5ba893a39c6e', 'request_id': 'req-012d03c7-c18f-4693-8d4e-14963461da2f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.197363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-012d03c7-c18f-4693-8d4e-14963461da2f admin admin] The token cache is being invalidate because project 27d248cf4b464f9da58e5ba893a39c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:50.197818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-012d03c7-c18f-4693-8d4e-14963461da2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.198644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-012d03c7-c18f-4693-8d4e-14963461da2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.200781 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1049/2121] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:50 2022] DELETE /identity/v3/projects/27d248cf4b464f9da58e5ba893a39c6e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:50.202347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a042-c957-4111-bc68-a8e7809b9bf3 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:50.202783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a042-c957-4111-bc68-a8e7809b9bf3 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:50.203203 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a042-c957-4111-bc68-a8e7809b9bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:50.221122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565a034-3548-420f-9fd4-6feb09a277e0 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:50.233946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-8dc0a042-c957-4111-bc68-a8e7809b9bf3 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:50.237065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8dc0a042-c957-4111-bc68-a8e7809b9bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:50.283123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:50.327638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874c1ba-67f0-4395-9643-94f443f9c495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:50.328540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874c1ba-67f0-4395-9643-94f443f9c495 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:50.329647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874c1ba-67f0-4395-9643-94f443f9c495 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:50.330035 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874c1ba-67f0-4395-9643-94f443f9c495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:50.333473 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c874c1ba-67f0-4395-9643-94f443f9c495 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:50.343775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1050/2122] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:50.347139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9c409-7921-49c7-adf8-f95055f3b7d1 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:50.347531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9c409-7921-49c7-adf8-f95055f3b7d1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:50.347910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9c409-7921-49c7-adf8-f95055f3b7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:50.370498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-dff9c409-7921-49c7-adf8-f95055f3b7d1 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:50.372451 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-dff9c409-7921-49c7-adf8-f95055f3b7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:50.382531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1051/2123] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:50.383851 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9c409-7921-49c7-adf8-f95055f3b7d1 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:50.386030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-dff9c409-7921-49c7-adf8-f95055f3b7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:50.406585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9c409-7921-49c7-adf8-f95055f3b7d1 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:50.415397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df514004-0e0d-48e1-8052-0705f7210e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:50.416929 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df514004-0e0d-48e1-8052-0705f7210e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:50.417372 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df514004-0e0d-48e1-8052-0705f7210e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:50.418803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df514004-0e0d-48e1-8052-0705f7210e83 admin admin] PATH_INFO: `/v3/projects/1881c20c83d64d4ea321e7d8393318a0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:50.419208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874c1ba-67f0-4395-9643-94f443f9c495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:50.420981 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874c1ba-67f0-4395-9643-94f443f9c495 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:50.422044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df514004-0e0d-48e1-8052-0705f7210e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1881c20c83d64d4ea321e7d8393318a0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:50.424868 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df514004-0e0d-48e1-8052-0705f7210e83 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:50.434899 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1073/2124] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:50.450240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e4ef3-7bb6-4655-a267-677a70c541ed None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:50.461927 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e4ef3-7bb6-4655-a267-677a70c541ed None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:50.462355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e4ef3-7bb6-4655-a267-677a70c541ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:50.498014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-261e4ef3-7bb6-4655-a267-677a70c541ed None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:50.499272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-261e4ef3-7bb6-4655-a267-677a70c541ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:50.514923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-df514004-0e0d-48e1-8052-0705f7210e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1881c20c83d64d4ea321e7d8393318a0', 'request_id': 'req-df514004-0e0d-48e1-8052-0705f7210e83'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.523163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-df514004-0e0d-48e1-8052-0705f7210e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1881c20c83d64d4ea321e7d8393318a0', 'request_id': 'req-df514004-0e0d-48e1-8052-0705f7210e83'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.536360 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-df514004-0e0d-48e1-8052-0705f7210e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1881c20c83d64d4ea321e7d8393318a0', 'request_id': 'req-df514004-0e0d-48e1-8052-0705f7210e83'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.556684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-df514004-0e0d-48e1-8052-0705f7210e83 admin admin] The token cache is being invalidate because project 1881c20c83d64d4ea321e7d8393318a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:50.558116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-df514004-0e0d-48e1-8052-0705f7210e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.559867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-df514004-0e0d-48e1-8052-0705f7210e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.564062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1052/2125] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:50 2022] DELETE /identity/v3/projects/1881c20c83d64d4ea321e7d8393318a0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:50.566744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a74113-de9c-4c29-beba-fbfacf6e2ab3 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:50.567204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a74113-de9c-4c29-beba-fbfacf6e2ab3 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:50.567740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a74113-de9c-4c29-beba-fbfacf6e2ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:50.576463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1074/2126] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:50.576463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e4ef3-7bb6-4655-a267-677a70c541ed None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:50.576463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-261e4ef3-7bb6-4655-a267-677a70c541ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:50.593426 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e4ef3-7bb6-4655-a267-677a70c541ed None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:50.601406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:50.602593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:50.604015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:50.604416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] PATH_INFO: `/v3/users/3e2099c6d6f24b3aa592ede87297b588` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:50.607013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e2099c6d6f24b3aa592ede87297b588)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:50.607699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-01a74113-de9c-4c29-beba-fbfacf6e2ab3 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:50.609608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-01a74113-de9c-4c29-beba-fbfacf6e2ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:50.609806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:50.619264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:50.621612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1053/2127] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:50.622699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a74113-de9c-4c29-beba-fbfacf6e2ab3 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:50.638350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a74113-de9c-4c29-beba-fbfacf6e2ab3 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:50.644962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306efc0c-2904-4173-915c-6cb00fe5acce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:50.645553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306efc0c-2904-4173-915c-6cb00fe5acce admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:50.646113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306efc0c-2904-4173-915c-6cb00fe5acce admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:50.646285 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306efc0c-2904-4173-915c-6cb00fe5acce admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:50.647098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306efc0c-2904-4173-915c-6cb00fe5acce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:50.647466 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306efc0c-2904-4173-915c-6cb00fe5acce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:50.649430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306efc0c-2904-4173-915c-6cb00fe5acce admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:50.666497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1054/2128] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:50.667590 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306efc0c-2904-4173-915c-6cb00fe5acce admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:50.685372 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306efc0c-2904-4173-915c-6cb00fe5acce admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:50.690690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c97e6-7ad9-478c-b3b0-101ab8249b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:50.691989 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c97e6-7ad9-478c-b3b0-101ab8249b19 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:50.692375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c97e6-7ad9-478c-b3b0-101ab8249b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:50.692744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c97e6-7ad9-478c-b3b0-101ab8249b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:50.693646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c97e6-7ad9-478c-b3b0-101ab8249b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:50.694045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c97e6-7ad9-478c-b3b0-101ab8249b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:50.695792 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c97e6-7ad9-478c-b3b0-101ab8249b19 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:50.700724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e2099c6d6f24b3aa592ede87297b588'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.701469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e2099c6d6f24b3aa592ede87297b588'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.724809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1055/2129] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:50.724809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c97e6-7ad9-478c-b3b0-101ab8249b19 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:50.728884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e2099c6d6f24b3aa592ede87297b588'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.736758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c97e6-7ad9-478c-b3b0-101ab8249b19 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:50.741569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e2099c6d6f24b3aa592ede87297b588'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.742203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e2099c6d6f24b3aa592ede87297b588'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:50.743721 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a845c3-5973-498a-b326-d295d702c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:50.744503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a845c3-5973-498a-b326-d295d702c053 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:50.745150 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a845c3-5973-498a-b326-d295d702c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:50.745267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a845c3-5973-498a-b326-d295d702c053 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:50.746025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a845c3-5973-498a-b326-d295d702c053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:50.748198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a845c3-5973-498a-b326-d295d702c053 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:50.782686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1075/2130] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:50 2022] DELETE /identity/v3/users/3e2099c6d6f24b3aa592ede87297b588 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:50.782686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:50.784626 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:50.796450 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1056/2131] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:50 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:50.801180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a845c3-5973-498a-b326-d295d702c053 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:50.807384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-09a845c3-5973-498a-b326-d295d702c053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:50.920304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae73e24-dec8-421e-a762-b72fcc658eb5 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:50.954315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:50.964276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a845c3-5973-498a-b326-d295d702c053 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:50.977288 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf0993-3364-4fd7-861b-5345c2fa4968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:50.978559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0993-3364-4fd7-861b-5345c2fa4968 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:50.978986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0993-3364-4fd7-861b-5345c2fa4968 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:50.979848 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0993-3364-4fd7-861b-5345c2fa4968 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:50.981924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf0993-3364-4fd7-861b-5345c2fa4968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:50.985538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf0993-3364-4fd7-861b-5345c2fa4968 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:51.062719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1057/2132] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:50 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:35:51.065463 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf0993-3364-4fd7-861b-5345c2fa4968 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:51.076120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ae9c3-2f42-4841-8f96-87a849c1992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:51.076908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ae9c3-2f42-4841-8f96-87a849c1992b admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:51.077333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ae9c3-2f42-4841-8f96-87a849c1992b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:51.077779 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ae9c3-2f42-4841-8f96-87a849c1992b admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:51.079549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ae9c3-2f42-4841-8f96-87a849c1992b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:51.082029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ae9c3-2f42-4841-8f96-87a849c1992b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:51.087762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf0993-3364-4fd7-861b-5345c2fa4968 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:51.102646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc1be4-b49b-4ce7-bed5-00ac846e786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:51.103356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc1be4-b49b-4ce7-bed5-00ac846e786e admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:51.103871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc1be4-b49b-4ce7-bed5-00ac846e786e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:51.104317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc1be4-b49b-4ce7-bed5-00ac846e786e admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:51.104853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc1be4-b49b-4ce7-bed5-00ac846e786e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:51.106626 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc1be4-b49b-4ce7-bed5-00ac846e786e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:51.130932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1058/2133] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:51.135318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc1be4-b49b-4ce7-bed5-00ac846e786e admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:51.141616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1076/2134] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:50 2022] POST /identity/v3/projects => generated 375 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:51.144590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ae9c3-2f42-4841-8f96-87a849c1992b admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:51.157645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc1be4-b49b-4ce7-bed5-00ac846e786e admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:51.184438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:51.260402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ae9c3-2f42-4841-8f96-87a849c1992b admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:51.260818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6789b0-f9bb-447b-9abb-a61448bf5f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:51.262667 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6789b0-f9bb-447b-9abb-a61448bf5f96 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:51.263254 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6789b0-f9bb-447b-9abb-a61448bf5f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:51.263964 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6789b0-f9bb-447b-9abb-a61448bf5f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:51.264790 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6789b0-f9bb-447b-9abb-a61448bf5f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:51.267277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6789b0-f9bb-447b-9abb-a61448bf5f96 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:51.278751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2e31c-514c-4728-a6a5-78b1bf3577d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:51.279543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2e31c-514c-4728-a6a5-78b1bf3577d3 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:51.280095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2e31c-514c-4728-a6a5-78b1bf3577d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:51.280472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2e31c-514c-4728-a6a5-78b1bf3577d3 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:51.282472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2e31c-514c-4728-a6a5-78b1bf3577d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:51.283294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1059/2135] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:51.285242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2e31c-514c-4728-a6a5-78b1bf3577d3 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:51.288051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6789b0-f9bb-447b-9abb-a61448bf5f96 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:51.302786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6789b0-f9bb-447b-9abb-a61448bf5f96 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:51.308995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9a883-4601-4cc1-aa5b-aa32981d1c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:51.309950 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9a883-4601-4cc1-aa5b-aa32981d1c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:51.310409 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9a883-4601-4cc1-aa5b-aa32981d1c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:51.310912 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9a883-4601-4cc1-aa5b-aa32981d1c49 admin admin] PATH_INFO: `/v3/projects/eb8a952e46294c3497db4c8407f13fcb/users/aac0296ec601487ea9090cfb2a2edac1/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:51.340654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1077/2136] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:51 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:51.341672 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2e31c-514c-4728-a6a5-78b1bf3577d3 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:51.354152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2e31c-514c-4728-a6a5-78b1bf3577d3 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:51.366243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9a883-4601-4cc1-aa5b-aa32981d1c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8a952e46294c3497db4c8407f13fcb, user_id=aac0296ec601487ea9090cfb2a2edac1, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:51.367210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8a676-226c-4680-8e80-81c69c1777bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:51.368488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8a676-226c-4680-8e80-81c69c1777bf admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:51.368997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9a883-4601-4cc1-aa5b-aa32981d1c49 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:51.369441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8a676-226c-4680-8e80-81c69c1777bf admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:51.369903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8a676-226c-4680-8e80-81c69c1777bf admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:51.371547 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8a676-226c-4680-8e80-81c69c1777bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:51.375418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8a676-226c-4680-8e80-81c69c1777bf admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:51.390117 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1060/2137] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:51 2022] PUT /identity/v3/projects/eb8a952e46294c3497db4c8407f13fcb/users/aac0296ec601487ea9090cfb2a2edac1/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:51.393367 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1078/2138] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:51.393367 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8a676-226c-4680-8e80-81c69c1777bf admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:51.394593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f2b8a676-226c-4680-8e80-81c69c1777bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:51.396057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9a883-4601-4cc1-aa5b-aa32981d1c49 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:51.409842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8a676-226c-4680-8e80-81c69c1777bf admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:51.490069 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9a883-4601-4cc1-aa5b-aa32981d1c49 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:51.494769 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685a3f6-1121-40e8-959f-181542ccf8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:51.495375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685a3f6-1121-40e8-959f-181542ccf8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:51.495654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685a3f6-1121-40e8-959f-181542ccf8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:51.495831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:51.496477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685a3f6-1121-40e8-959f-181542ccf8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:51.496972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:51.497076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685a3f6-1121-40e8-959f-181542ccf8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:51.497255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:51.497534 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] PATH_INFO: `/v3/projects/05452fa002bd49d08bd25fd083e77540` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:51.498751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05452fa002bd49d08bd25fd083e77540)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:51.498924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685a3f6-1121-40e8-959f-181542ccf8c8 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:51.500755 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:51.511206 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1061/2139] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:51.515937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62702bd4-5013-478b-8893-28768cc34b09 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:51.516224 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62702bd4-5013-478b-8893-28768cc34b09 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:51.516502 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62702bd4-5013-478b-8893-28768cc34b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:51.554246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-62702bd4-5013-478b-8893-28768cc34b09 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:51.555440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-62702bd4-5013-478b-8893-28768cc34b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:51.569004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05452fa002bd49d08bd25fd083e77540', 'request_id': 'req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:51.584558 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05452fa002bd49d08bd25fd083e77540', 'request_id': 'req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:51.602161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05452fa002bd49d08bd25fd083e77540', 'request_id': 'req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:51.622826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:51.627476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] The token cache is being invalidate because project 05452fa002bd49d08bd25fd083e77540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:51.627771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:51.628609 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:51.631930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1079/2140] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:51 2022] DELETE /identity/v3/projects/05452fa002bd49d08bd25fd083e77540 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:51.633028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:51.635579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:51.653047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1062/2141] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:51.656540 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62702bd4-5013-478b-8893-28768cc34b09 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:51.663526 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-62702bd4-5013-478b-8893-28768cc34b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:51.676810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62702bd4-5013-478b-8893-28768cc34b09 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:51.684055 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:51.684819 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:51.685175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:51.685842 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] PATH_INFO: `/v3/users/28bf697b273d423bba9f82a70cf4e118` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:51.686939 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28bf697b273d423bba9f82a70cf4e118)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:51.688997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:51.697494 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:51.757503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28bf697b273d423bba9f82a70cf4e118'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:51.757503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28bf697b273d423bba9f82a70cf4e118'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:51.771130 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93841bf-ec26-482b-90fd-5ca7a8ad3f78 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:51.771674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28bf697b273d423bba9f82a70cf4e118'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:51.773187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28bf697b273d423bba9f82a70cf4e118'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:51.778364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e3643-7a49-4ccb-ba37-b98a354055e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:51.779724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e3643-7a49-4ccb-ba37-b98a354055e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:51.780243 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e3643-7a49-4ccb-ba37-b98a354055e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:51.781480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e3643-7a49-4ccb-ba37-b98a354055e1 admin admin] PATH_INFO: `/v3/projects/8d371e43d1ed45f9a21394416deefc43/users/0cdfed982af44bc0ac555a6d589852e6/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:51.803956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28bf697b273d423bba9f82a70cf4e118'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:51.813030 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e3643-7a49-4ccb-ba37-b98a354055e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d371e43d1ed45f9a21394416deefc43, user_id=0cdfed982af44bc0ac555a6d589852e6, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:51.815691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e3643-7a49-4ccb-ba37-b98a354055e1 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:51.834995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1063/2142] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:51 2022] DELETE /identity/v3/users/28bf697b273d423bba9f82a70cf4e118 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:51.836777 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:51.839292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:51.856960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1080/2143] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:51 2022] PUT /identity/v3/projects/8d371e43d1ed45f9a21394416deefc43/users/0cdfed982af44bc0ac555a6d589852e6/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:51.867786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32bc1-e1b3-4377-bff8-a8b44717fc86 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:51.868619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32bc1-e1b3-4377-bff8-a8b44717fc86 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:51.869046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32bc1-e1b3-4377-bff8-a8b44717fc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:51.936116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-6ba32bc1-e1b3-4377-bff8-a8b44717fc86 None None] MFA Rules not processed for user `0cdfed982af44bc0ac555a6d589852e6`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:51.939357 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6ba32bc1-e1b3-4377-bff8-a8b44717fc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:51.960065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb5832-eaa1-454e-8592-daf52d38cc93 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:51.971969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189a285-28df-498b-a509-ed644127d9c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:51.974639 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189a285-28df-498b-a509-ed644127d9c4 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:51.975168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189a285-28df-498b-a509-ed644127d9c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:51.976273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189a285-28df-498b-a509-ed644127d9c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:51.988255 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3189a285-28df-498b-a509-ed644127d9c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:52.046739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1081/2144] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:52.056309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba32bc1-e1b3-4377-bff8-a8b44717fc86 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:52.078936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6ba32bc1-e1b3-4377-bff8-a8b44717fc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:52.248075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189a285-28df-498b-a509-ed644127d9c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:52.249105 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189a285-28df-498b-a509-ed644127d9c4 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:52.254201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba32bc1-e1b3-4377-bff8-a8b44717fc86 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:52.264083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3627a9d-c9dd-4ef1-b73c-41d08952e414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:52.273402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3627a9d-c9dd-4ef1-b73c-41d08952e414 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:52.273402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3627a9d-c9dd-4ef1-b73c-41d08952e414 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:52.273402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3627a9d-c9dd-4ef1-b73c-41d08952e414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:52.278032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1064/2145] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:52.284483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3627a9d-c9dd-4ef1-b73c-41d08952e414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:52.287965 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3627a9d-c9dd-4ef1-b73c-41d08952e414 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:52.315436 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1082/2146] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:35:52.533846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189a285-28df-498b-a509-ed644127d9c4 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:52.535531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3189a285-28df-498b-a509-ed644127d9c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:52.547092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:52.578362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189a285-28df-498b-a509-ed644127d9c4 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:52.599488 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:52.600282 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:52.600433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:52.600799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2 admin admin] PATH_INFO: `/v3/projects/afa8c2802e9a417d85aaaa4cc252cd58` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:52.602812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa8c2802e9a417d85aaaa4cc252cd58)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:52.604823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:52.663380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3627a9d-c9dd-4ef1-b73c-41d08952e414 service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:52.665477 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b3627a9d-c9dd-4ef1-b73c-41d08952e414 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:52.680100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa8c2802e9a417d85aaaa4cc252cd58', 'request_id': 'req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:52.688706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa8c2802e9a417d85aaaa4cc252cd58', 'request_id': 'req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:52.692705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3627a9d-c9dd-4ef1-b73c-41d08952e414 service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:52.701047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa8c2802e9a417d85aaaa4cc252cd58', 'request_id': 'req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:52.716808 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2 admin admin] The token cache is being invalidate because project afa8c2802e9a417d85aaaa4cc252cd58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:52.717074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:52.717819 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-48d9fa5a-de7e-4023-81fa-30ba504dbcb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:52.724847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1065/2147] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:52 2022] DELETE /identity/v3/projects/afa8c2802e9a417d85aaaa4cc252cd58 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:52.725684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd791d-9be1-4734-8a6a-8ee5f90abc5a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:52.725968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd791d-9be1-4734-8a6a-8ee5f90abc5a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:52.726236 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd791d-9be1-4734-8a6a-8ee5f90abc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:52.761269 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-1dfd791d-9be1-4734-8a6a-8ee5f90abc5a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:52.763700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1dfd791d-9be1-4734-8a6a-8ee5f90abc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:52.801281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:52.842028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:52.842715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:52.843045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:52.843465 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] PATH_INFO: `/v3/users/18fafa4f50b14af297d8c8adf49c2925` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:52.845639 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18fafa4f50b14af297d8c8adf49c2925)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:52.849733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:52.880604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1066/2148] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:52.890538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd02b5-acb0-45b5-8b1f-518e18517c77 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:52.891124 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd02b5-acb0-45b5-8b1f-518e18517c77 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:52.891501 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd02b5-acb0-45b5-8b1f-518e18517c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:52.920232 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-64bd02b5-acb0-45b5-8b1f-518e18517c77 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:52.921563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-64bd02b5-acb0-45b5-8b1f-518e18517c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:52.931415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1067/2149] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:52.936378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd02b5-acb0-45b5-8b1f-518e18517c77 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:52.946990 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd02b5-acb0-45b5-8b1f-518e18517c77 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:52.954023 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b99b9-72e8-4064-9c55-5b9de452ffac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:52.954941 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b99b9-72e8-4064-9c55-5b9de452ffac admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:52.955433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b99b9-72e8-4064-9c55-5b9de452ffac admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:52.955958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b99b9-72e8-4064-9c55-5b9de452ffac admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:52.957012 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b99b9-72e8-4064-9c55-5b9de452ffac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:52.957391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b99b9-72e8-4064-9c55-5b9de452ffac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:52.960047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b99b9-72e8-4064-9c55-5b9de452ffac admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:52.975076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18fafa4f50b14af297d8c8adf49c2925'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:52.976726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1068/2150] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:52.976936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18fafa4f50b14af297d8c8adf49c2925'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:52.981277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b99b9-72e8-4064-9c55-5b9de452ffac admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:52.997380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18fafa4f50b14af297d8c8adf49c2925'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:52.998912 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b99b9-72e8-4064-9c55-5b9de452ffac admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:53.004588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1129f-9a28-47aa-81af-a3f6116b81b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:53.005823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1129f-9a28-47aa-81af-a3f6116b81b8 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.006296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1129f-9a28-47aa-81af-a3f6116b81b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.006840 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1129f-9a28-47aa-81af-a3f6116b81b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.007254 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18fafa4f50b14af297d8c8adf49c2925'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:53.007957 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1129f-9a28-47aa-81af-a3f6116b81b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:53.008192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18fafa4f50b14af297d8c8adf49c2925'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:53.010629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1129f-9a28-47aa-81af-a3f6116b81b8 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:53.037892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1083/2151] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:52 2022] DELETE /identity/v3/users/18fafa4f50b14af297d8c8adf49c2925 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:53.064057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1069/2152] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:52 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:53.068056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:53.069940 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:53.170727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e597a3-61b4-46c8-b958-925eac37a105 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:53.236611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9874d88-5383-4cd8-85ff-3277ff3e180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:53.238061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9874d88-5383-4cd8-85ff-3277ff3e180d admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.238705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9874d88-5383-4cd8-85ff-3277ff3e180d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.239213 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9874d88-5383-4cd8-85ff-3277ff3e180d admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.240609 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9874d88-5383-4cd8-85ff-3277ff3e180d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:53.242914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9874d88-5383-4cd8-85ff-3277ff3e180d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:53.263644 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:53.274449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1084/2153] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:53 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:35:53.279742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1129f-9a28-47aa-81af-a3f6116b81b8 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:53.300964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9874d88-5383-4cd8-85ff-3277ff3e180d admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:53.303083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f9874d88-5383-4cd8-85ff-3277ff3e180d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:53.303365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1129f-9a28-47aa-81af-a3f6116b81b8 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:53.311805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346c40a-db21-44a5-beda-5e8574f54c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:53.312805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346c40a-db21-44a5-beda-5e8574f54c65 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.313103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346c40a-db21-44a5-beda-5e8574f54c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.313470 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346c40a-db21-44a5-beda-5e8574f54c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.314810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346c40a-db21-44a5-beda-5e8574f54c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:53.316896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346c40a-db21-44a5-beda-5e8574f54c65 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:53.324501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9874d88-5383-4cd8-85ff-3277ff3e180d admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:53.331279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:53.331923 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.332448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.332886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] PATH_INFO: `/v3/projects/3c2d7c2e992c419b8fbd81229447ba47` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.336917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c2d7c2e992c419b8fbd81229447ba47)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:53.336917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:53.338620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1070/2154] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:53.340349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346c40a-db21-44a5-beda-5e8574f54c65 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:53.368756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346c40a-db21-44a5-beda-5e8574f54c65 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:53.368756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206c5eb-e8d7-4ca1-9cd3-137a60a5b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:53.368756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206c5eb-e8d7-4ca1-9cd3-137a60a5b6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.368756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206c5eb-e8d7-4ca1-9cd3-137a60a5b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.369980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206c5eb-e8d7-4ca1-9cd3-137a60a5b6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.369980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206c5eb-e8d7-4ca1-9cd3-137a60a5b6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:53.369980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206c5eb-e8d7-4ca1-9cd3-137a60a5b6a9 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:53.385175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1071/2155] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:53.388214 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b771ec-c201-4863-8aff-e13f4aa9b3d3 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.388570 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b771ec-c201-4863-8aff-e13f4aa9b3d3 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.388909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b771ec-c201-4863-8aff-e13f4aa9b3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.420325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-68b771ec-c201-4863-8aff-e13f4aa9b3d3 None None] MFA Rules not processed for user `aac0296ec601487ea9090cfb2a2edac1`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:53.421650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-68b771ec-c201-4863-8aff-e13f4aa9b3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:53.425343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2d7c2e992c419b8fbd81229447ba47', 'request_id': 'req-17beb653-6455-4137-a6fb-042d918544a2'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:53.432079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2d7c2e992c419b8fbd81229447ba47', 'request_id': 'req-17beb653-6455-4137-a6fb-042d918544a2'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:53.436207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:53.441722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2d7c2e992c419b8fbd81229447ba47', 'request_id': 'req-17beb653-6455-4137-a6fb-042d918544a2'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:53.456839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] The token cache is being invalidate because project 3c2d7c2e992c419b8fbd81229447ba47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:53.457200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:53.457873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:53.459493 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1085/2156] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:53 2022] DELETE /identity/v3/projects/3c2d7c2e992c419b8fbd81229447ba47 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:35:53.460344 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:53.461875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:53.499277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1072/2157] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:53.500526 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff2c49-245f-421e-b269-a4fa8ae6a61b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.500813 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff2c49-245f-421e-b269-a4fa8ae6a61b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.501080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff2c49-245f-421e-b269-a4fa8ae6a61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.522523 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-25ff2c49-245f-421e-b269-a4fa8ae6a61b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:53.523732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-25ff2c49-245f-421e-b269-a4fa8ae6a61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:53.553980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17beb653-6455-4137-a6fb-042d918544a2 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:53.559403 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d751894-e037-4743-a97b-31a1d04adbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:53.560090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d751894-e037-4743-a97b-31a1d04adbd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.560371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d751894-e037-4743-a97b-31a1d04adbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.560652 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d751894-e037-4743-a97b-31a1d04adbd1 admin admin] PATH_INFO: `/v3/projects/4f6099e579ab4d82a7a309f8856c7e63/users/2d7676aec4824294a933e66ef91a999c/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.578131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d751894-e037-4743-a97b-31a1d04adbd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6099e579ab4d82a7a309f8856c7e63, user_id=2d7676aec4824294a933e66ef91a999c, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:53.581186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d751894-e037-4743-a97b-31a1d04adbd1 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:53.592071 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1073/2158] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:53.593032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff2c49-245f-421e-b269-a4fa8ae6a61b None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:53.594579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-25ff2c49-245f-421e-b269-a4fa8ae6a61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:53.596548 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1086/2159] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:53 2022] PUT /identity/v3/projects/4f6099e579ab4d82a7a309f8856c7e63/users/2d7676aec4824294a933e66ef91a999c/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:53.597272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d751894-e037-4743-a97b-31a1d04adbd1 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:53.599068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6d751894-e037-4743-a97b-31a1d04adbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:53.617155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff2c49-245f-421e-b269-a4fa8ae6a61b None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:53.668482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d751894-e037-4743-a97b-31a1d04adbd1 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:53.672893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794879cd-70ff-4a4b-99d9-499701b97286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:53.673567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794879cd-70ff-4a4b-99d9-499701b97286 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.673900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794879cd-70ff-4a4b-99d9-499701b97286 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.674180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794879cd-70ff-4a4b-99d9-499701b97286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.678027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd9c7c-f443-4008-b188-60f8d3c12b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:53.678699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd9c7c-f443-4008-b188-60f8d3c12b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.682818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd9c7c-f443-4008-b188-60f8d3c12b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.683149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd9c7c-f443-4008-b188-60f8d3c12b6b admin admin] PATH_INFO: `/v3/users/0ba6c997faa94a34a8ea4497c3e6dec9` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.684745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd9c7c-f443-4008-b188-60f8d3c12b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba6c997faa94a34a8ea4497c3e6dec9)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:53.686953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd9c7c-f443-4008-b188-60f8d3c12b6b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:53.699636 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:53.740932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e2cd9c7c-f443-4008-b188-60f8d3c12b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba6c997faa94a34a8ea4497c3e6dec9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:53.741710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e2cd9c7c-f443-4008-b188-60f8d3c12b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba6c997faa94a34a8ea4497c3e6dec9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:53.749088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794879cd-70ff-4a4b-99d9-499701b97286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:53.749786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e2cd9c7c-f443-4008-b188-60f8d3c12b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba6c997faa94a34a8ea4497c3e6dec9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:53.750550 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e2cd9c7c-f443-4008-b188-60f8d3c12b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba6c997faa94a34a8ea4497c3e6dec9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:53.750771 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794879cd-70ff-4a4b-99d9-499701b97286 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:53.752577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:53.760619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1087/2160] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:53.762539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8762f6-b695-403b-9adc-f7cc65e81304 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.762854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8762f6-b695-403b-9adc-f7cc65e81304 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.763114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8762f6-b695-403b-9adc-f7cc65e81304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.766918 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-e2cd9c7c-f443-4008-b188-60f8d3c12b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba6c997faa94a34a8ea4497c3e6dec9'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:53.783316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1074/2161] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:53 2022] DELETE /identity/v3/users/0ba6c997faa94a34a8ea4497c3e6dec9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:53.783316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f048f0b-4e54-4823-bb6d-2b5e28f4ea1b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.783316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f048f0b-4e54-4823-bb6d-2b5e28f4ea1b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.783316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f048f0b-4e54-4823-bb6d-2b5e28f4ea1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.784134 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-ea8762f6-b695-403b-9adc-f7cc65e81304 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:53.785400 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ea8762f6-b695-403b-9adc-f7cc65e81304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:53.815324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-4f048f0b-4e54-4823-bb6d-2b5e28f4ea1b None None] MFA Rules not processed for user `2d7676aec4824294a933e66ef91a999c`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:53.816612 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4f048f0b-4e54-4823-bb6d-2b5e28f4ea1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:53.851234 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1088/2162] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:53.852352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c65ec-af99-40e5-ac44-6e1965e2e649 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.853021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c65ec-af99-40e5-ac44-6e1965e2e649 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.853021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c65ec-af99-40e5-ac44-6e1965e2e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.872778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-3f1c65ec-af99-40e5-ac44-6e1965e2e649 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:53.874223 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3f1c65ec-af99-40e5-ac44-6e1965e2e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:53.882756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1089/2163] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:53.887828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c65ec-af99-40e5-ac44-6e1965e2e649 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:53.898574 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c65ec-af99-40e5-ac44-6e1965e2e649 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:53.903991 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea963d2b-ae58-4a5b-8768-77a65d526b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:53.904860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea963d2b-ae58-4a5b-8768-77a65d526b7e admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.905231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea963d2b-ae58-4a5b-8768-77a65d526b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.905602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea963d2b-ae58-4a5b-8768-77a65d526b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.906398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea963d2b-ae58-4a5b-8768-77a65d526b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:53.906837 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea963d2b-ae58-4a5b-8768-77a65d526b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:53.908510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea963d2b-ae58-4a5b-8768-77a65d526b7e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:53.921274 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1090/2164] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:53.922560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea963d2b-ae58-4a5b-8768-77a65d526b7e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:53.924961 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ea963d2b-ae58-4a5b-8768-77a65d526b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:53.928921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1075/2165] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:53.929920 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f048f0b-4e54-4823-bb6d-2b5e28f4ea1b None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:53.942524 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f048f0b-4e54-4823-bb6d-2b5e28f4ea1b None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:53.949915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e2b6f-b828-445c-9671-6e980f79713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:53.950823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e2b6f-b828-445c-9671-6e980f79713c admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:53.951180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e2b6f-b828-445c-9671-6e980f79713c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:53.951523 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e2b6f-b828-445c-9671-6e980f79713c admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:53.952253 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e2b6f-b828-445c-9671-6e980f79713c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:53.954965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e2b6f-b828-445c-9671-6e980f79713c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:54.007331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1076/2166] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:53 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:54.008336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e2b6f-b828-445c-9671-6e980f79713c admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:54.010285 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-9d7e2b6f-b828-445c-9671-6e980f79713c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:54.020470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea963d2b-ae58-4a5b-8768-77a65d526b7e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:54.086255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50a58c-648a-4b0b-a39f-414e74f584af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:54.087110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50a58c-648a-4b0b-a39f-414e74f584af service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:54.087397 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50a58c-648a-4b0b-a39f-414e74f584af service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:54.087715 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50a58c-648a-4b0b-a39f-414e74f584af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:54.099917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e2b6f-b828-445c-9671-6e980f79713c admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:54.103539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d98fa-2062-4b2c-8997-8b963594f360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:54.104142 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d98fa-2062-4b2c-8997-8b963594f360 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:54.104416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d98fa-2062-4b2c-8997-8b963594f360 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:54.104681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d98fa-2062-4b2c-8997-8b963594f360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:54.108390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:54.172728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50a58c-648a-4b0b-a39f-414e74f584af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:54.174321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50a58c-648a-4b0b-a39f-414e74f584af service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:54.185918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1091/2167] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:54.186886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50a58c-648a-4b0b-a39f-414e74f584af service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:54.197528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50a58c-648a-4b0b-a39f-414e74f584af service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:54.212464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09fabf-50a3-4a27-a814-c0a04e47b549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:54.213106 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09fabf-50a3-4a27-a814-c0a04e47b549 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:54.213385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09fabf-50a3-4a27-a814-c0a04e47b549 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:54.213658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09fabf-50a3-4a27-a814-c0a04e47b549 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:54.214313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09fabf-50a3-4a27-a814-c0a04e47b549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:54.216287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09fabf-50a3-4a27-a814-c0a04e47b549 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:54.227822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d98fa-2062-4b2c-8997-8b963594f360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:54.227822 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d98fa-2062-4b2c-8997-8b963594f360 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:54.231374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:54.249830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1077/2168] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:54.260871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1092/2169] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:54 2022] POST /identity/v3/users => generated 288 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:54.265799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d98fa-2062-4b2c-8997-8b963594f360 service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:54.284382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d98fa-2062-4b2c-8997-8b963594f360 service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:54.296373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb87634-072c-4a8e-a261-56500ab876f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:54.297072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb87634-072c-4a8e-a261-56500ab876f4 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:54.297427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb87634-072c-4a8e-a261-56500ab876f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:54.297780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb87634-072c-4a8e-a261-56500ab876f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:54.298923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb87634-072c-4a8e-a261-56500ab876f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:54.301357 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb87634-072c-4a8e-a261-56500ab876f4 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:54.318552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1078/2170] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:54.319731 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09fabf-50a3-4a27-a814-c0a04e47b549 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:54.340427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09fabf-50a3-4a27-a814-c0a04e47b549 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:54.347590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eda8e3-f971-4cc3-9360-3ba1fecf31d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:54.348207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eda8e3-f971-4cc3-9360-3ba1fecf31d5 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:54.348540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eda8e3-f971-4cc3-9360-3ba1fecf31d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:54.348823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eda8e3-f971-4cc3-9360-3ba1fecf31d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:54.349670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eda8e3-f971-4cc3-9360-3ba1fecf31d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:54.352945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eda8e3-f971-4cc3-9360-3ba1fecf31d5 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:54.370710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1093/2171] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:54.373133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb87634-072c-4a8e-a261-56500ab876f4 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:54.385760 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb87634-072c-4a8e-a261-56500ab876f4 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:54.416093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991da5e2-e0f4-4711-8419-2973c5447d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:54.416851 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991da5e2-e0f4-4711-8419-2973c5447d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:54.417241 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991da5e2-e0f4-4711-8419-2973c5447d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:54.417523 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991da5e2-e0f4-4711-8419-2973c5447d12 admin admin] PATH_INFO: `/v3/projects/0a6263d07b2b4b35b4abdb76a22c24be/users/7d6f98709d8443bebe278a78499c8b3a/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:54.452091 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991da5e2-e0f4-4711-8419-2973c5447d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6263d07b2b4b35b4abdb76a22c24be, user_id=7d6f98709d8443bebe278a78499c8b3a, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:54.457678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991da5e2-e0f4-4711-8419-2973c5447d12 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:54.493483 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1079/2172] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:54 2022] PUT /identity/v3/projects/0a6263d07b2b4b35b4abdb76a22c24be/users/7d6f98709d8443bebe278a78499c8b3a/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:54.498708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d4e39-92cf-46f2-9845-9c6e1af99674 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:54.498974 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d4e39-92cf-46f2-9845-9c6e1af99674 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:54.499247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d4e39-92cf-46f2-9845-9c6e1af99674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:54.521161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-4a2d4e39-92cf-46f2-9845-9c6e1af99674 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:54.522039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4a2d4e39-92cf-46f2-9845-9c6e1af99674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:54.610849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1094/2173] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:54.619862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991da5e2-e0f4-4711-8419-2973c5447d12 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:54.712053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d4e39-92cf-46f2-9845-9c6e1af99674 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:54.714309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4a2d4e39-92cf-46f2-9845-9c6e1af99674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:54.747539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d4e39-92cf-46f2-9845-9c6e1af99674 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:54.762274 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaad00-9ac6-4cff-882a-c1fba4c04882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:54.763113 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaad00-9ac6-4cff-882a-c1fba4c04882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:54.763423 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaad00-9ac6-4cff-882a-c1fba4c04882 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:54.763728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaad00-9ac6-4cff-882a-c1fba4c04882 admin admin] PATH_INFO: `/v3/projects/e49838fbea3140d4b1356d970a9fcb37` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:54.766621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaad00-9ac6-4cff-882a-c1fba4c04882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49838fbea3140d4b1356d970a9fcb37)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:54.769326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaad00-9ac6-4cff-882a-c1fba4c04882 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:54.776226 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991da5e2-e0f4-4711-8419-2973c5447d12 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:54.787661 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bed07-66d9-47fa-b558-5d963ab46ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:54.788358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bed07-66d9-47fa-b558-5d963ab46ecf service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:54.788721 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bed07-66d9-47fa-b558-5d963ab46ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:54.789005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bed07-66d9-47fa-b558-5d963ab46ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:54.799189 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bed07-66d9-47fa-b558-5d963ab46ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:54.800912 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bed07-66d9-47fa-b558-5d963ab46ecf service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:54.814104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1080/2174] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:54.827668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2abaad00-9ac6-4cff-882a-c1fba4c04882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49838fbea3140d4b1356d970a9fcb37', 'request_id': 'req-2abaad00-9ac6-4cff-882a-c1fba4c04882'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:54.833950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2abaad00-9ac6-4cff-882a-c1fba4c04882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49838fbea3140d4b1356d970a9fcb37', 'request_id': 'req-2abaad00-9ac6-4cff-882a-c1fba4c04882'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:54.843260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2abaad00-9ac6-4cff-882a-c1fba4c04882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49838fbea3140d4b1356d970a9fcb37', 'request_id': 'req-2abaad00-9ac6-4cff-882a-c1fba4c04882'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:54.852133 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:54.856109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2abaad00-9ac6-4cff-882a-c1fba4c04882 admin admin] The token cache is being invalidate because project e49838fbea3140d4b1356d970a9fcb37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:54.856328 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2abaad00-9ac6-4cff-882a-c1fba4c04882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:54.857303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2abaad00-9ac6-4cff-882a-c1fba4c04882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:54.860035 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1095/2175] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:54 2022] DELETE /identity/v3/projects/e49838fbea3140d4b1356d970a9fcb37 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:54.864208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bed07-66d9-47fa-b558-5d963ab46ecf service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:54.874068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bed07-66d9-47fa-b558-5d963ab46ecf service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:54.957641 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:54.958478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:54.958799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:54.959428 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] PATH_INFO: `/v3/users/550dec9838544788a3c427341c443fd2` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:54.960648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=550dec9838544788a3c427341c443fd2)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:54.963091 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:55.029879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '550dec9838544788a3c427341c443fd2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:55.030927 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '550dec9838544788a3c427341c443fd2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:55.043466 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '550dec9838544788a3c427341c443fd2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:55.044391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '550dec9838544788a3c427341c443fd2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:55.054741 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:55.062471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '550dec9838544788a3c427341c443fd2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:55.079129 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1081/2176] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:54 2022] DELETE /identity/v3/users/550dec9838544788a3c427341c443fd2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:55.304693 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037fd8-fbd8-4f98-985b-b2a3ff94a180 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:55.305111 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037fd8-fbd8-4f98-985b-b2a3ff94a180 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:55.305442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037fd8-fbd8-4f98-985b-b2a3ff94a180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:55.333332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c1037fd8-fbd8-4f98-985b-b2a3ff94a180 None None] MFA Rules not processed for user `aac0296ec601487ea9090cfb2a2edac1`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:55.334619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c1037fd8-fbd8-4f98-985b-b2a3ff94a180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:55.401272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1096/2177] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:55.602291 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:55.608140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:55.745793 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0cdf9-66e1-4d61-8f32-3e8d2310c0c8 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:55.766458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff25032-aab7-4fa6-9384-2abaf2d85334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:55.767149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff25032-aab7-4fa6-9384-2abaf2d85334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:55.767419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff25032-aab7-4fa6-9384-2abaf2d85334 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:55.767688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff25032-aab7-4fa6-9384-2abaf2d85334 admin admin] PATH_INFO: `/v3/projects/8e7b09690f804038b72e449d79599ca1` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:55.772862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff25032-aab7-4fa6-9384-2abaf2d85334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7b09690f804038b72e449d79599ca1)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:55.776883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff25032-aab7-4fa6-9384-2abaf2d85334 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:55.841311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccc0f8-5d25-4adb-b059-5188f3ece5a7 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:55.842610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccc0f8-5d25-4adb-b059-5188f3ece5a7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:55.843074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccc0f8-5d25-4adb-b059-5188f3ece5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:55.878860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-19ccc0f8-5d25-4adb-b059-5188f3ece5a7 None None] MFA Rules not processed for user `2d7676aec4824294a933e66ef91a999c`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:55.880932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1ff25032-aab7-4fa6-9384-2abaf2d85334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7b09690f804038b72e449d79599ca1', 'request_id': 'req-1ff25032-aab7-4fa6-9384-2abaf2d85334'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:55.882645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-19ccc0f8-5d25-4adb-b059-5188f3ece5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:55.888087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1ff25032-aab7-4fa6-9384-2abaf2d85334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7b09690f804038b72e449d79599ca1', 'request_id': 'req-1ff25032-aab7-4fa6-9384-2abaf2d85334'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:55.898837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1ff25032-aab7-4fa6-9384-2abaf2d85334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7b09690f804038b72e449d79599ca1', 'request_id': 'req-1ff25032-aab7-4fa6-9384-2abaf2d85334'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:55.928193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1ff25032-aab7-4fa6-9384-2abaf2d85334 admin admin] The token cache is being invalidate because project 8e7b09690f804038b72e449d79599ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:55.928502 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1ff25032-aab7-4fa6-9384-2abaf2d85334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:55.929646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1ff25032-aab7-4fa6-9384-2abaf2d85334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:55.931631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1082/2178] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:55 2022] DELETE /identity/v3/projects/8e7b09690f804038b72e449d79599ca1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:55.936627 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828a702-859a-48ac-a52d-c87f1f0774e9 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:55.937260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828a702-859a-48ac-a52d-c87f1f0774e9 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:55.937686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828a702-859a-48ac-a52d-c87f1f0774e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:55.962080 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-e828a702-859a-48ac-a52d-c87f1f0774e9 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:55.963805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e828a702-859a-48ac-a52d-c87f1f0774e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:55.986367 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1097/2179] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:56.065935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccc0f8-5d25-4adb-b059-5188f3ece5a7 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:56.076061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-19ccc0f8-5d25-4adb-b059-5188f3ece5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:56.081461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1083/2180] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:56.090012 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad13b24-2e25-48d6-8751-b9211f0df313 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:56.090298 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad13b24-2e25-48d6-8751-b9211f0df313 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:56.090605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad13b24-2e25-48d6-8751-b9211f0df313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:56.098846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccc0f8-5d25-4adb-b059-5188f3ece5a7 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:56.111295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f4869-6dbc-455b-a681-2cbf2ef97b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:56.113368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f4869-6dbc-455b-a681-2cbf2ef97b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:56.113756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f4869-6dbc-455b-a681-2cbf2ef97b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:56.114134 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f4869-6dbc-455b-a681-2cbf2ef97b3f admin admin] PATH_INFO: `/v3/users/0cdfed982af44bc0ac555a6d589852e6` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:56.118560 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f4869-6dbc-455b-a681-2cbf2ef97b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cdfed982af44bc0ac555a6d589852e6)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:56.121394 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f4869-6dbc-455b-a681-2cbf2ef97b3f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:56.123501 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-1ad13b24-2e25-48d6-8751-b9211f0df313 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:56.129149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1ad13b24-2e25-48d6-8751-b9211f0df313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:56.149921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1084/2181] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:35:56.154566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad13b24-2e25-48d6-8751-b9211f0df313 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:56.170562 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad13b24-2e25-48d6-8751-b9211f0df313 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:56.173184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95826a7d-4721-4f9a-ba75-e4663cec724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:56.173820 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826a7d-4721-4f9a-ba75-e4663cec724f admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:56.174111 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826a7d-4721-4f9a-ba75-e4663cec724f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:56.174370 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826a7d-4721-4f9a-ba75-e4663cec724f admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:56.175565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95826a7d-4721-4f9a-ba75-e4663cec724f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:56.175565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95826a7d-4721-4f9a-ba75-e4663cec724f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:56.182489 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95826a7d-4721-4f9a-ba75-e4663cec724f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:56.188229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:56.215682 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1085/2182] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:35:56.218055 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95826a7d-4721-4f9a-ba75-e4663cec724f admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:56.242982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95826a7d-4721-4f9a-ba75-e4663cec724f admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:56.273335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722972f-a8c5-421d-a4be-c4b1c73f78c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:56.275915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722972f-a8c5-421d-a4be-c4b1c73f78c1 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:56.276470 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722972f-a8c5-421d-a4be-c4b1c73f78c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:56.279345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722972f-a8c5-421d-a4be-c4b1c73f78c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:56.282668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722972f-a8c5-421d-a4be-c4b1c73f78c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:56.284079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e24f4869-6dbc-455b-a681-2cbf2ef97b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cdfed982af44bc0ac555a6d589852e6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:56.285922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e24f4869-6dbc-455b-a681-2cbf2ef97b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cdfed982af44bc0ac555a6d589852e6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:56.287792 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722972f-a8c5-421d-a4be-c4b1c73f78c1 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:56.313167 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e24f4869-6dbc-455b-a681-2cbf2ef97b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cdfed982af44bc0ac555a6d589852e6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:56.325833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e24f4869-6dbc-455b-a681-2cbf2ef97b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cdfed982af44bc0ac555a6d589852e6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:56.326540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e24f4869-6dbc-455b-a681-2cbf2ef97b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cdfed982af44bc0ac555a6d589852e6'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:56.336075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1086/2183] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:56 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:56.342992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722972f-a8c5-421d-a4be-c4b1c73f78c1 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:56.348702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c722972f-a8c5-421d-a4be-c4b1c73f78c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:56.356940 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1098/2184] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:35:56 2022] DELETE /identity/v3/users/0cdfed982af44bc0ac555a6d589852e6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:56.361352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4589f-8f6c-491a-93da-2434b1e61a08 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:56.362878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4589f-8f6c-491a-93da-2434b1e61a08 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:56.363259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4589f-8f6c-491a-93da-2434b1e61a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:56.401164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-21e4589f-8f6c-491a-93da-2434b1e61a08 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:56.404427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-21e4589f-8f6c-491a-93da-2434b1e61a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:56.441717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:56.464649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722972f-a8c5-421d-a4be-c4b1c73f78c1 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:56.536510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1099/2185] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:56.546437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4589f-8f6c-491a-93da-2434b1e61a08 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:56.548142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-21e4589f-8f6c-491a-93da-2434b1e61a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:56.549828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb0d0b-b44e-468e-af86-5e5e68e9546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:56.550990 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb0d0b-b44e-468e-af86-5e5e68e9546a admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:56.551787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb0d0b-b44e-468e-af86-5e5e68e9546a admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:56.552245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb0d0b-b44e-468e-af86-5e5e68e9546a admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:56.553348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb0d0b-b44e-468e-af86-5e5e68e9546a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:56.557401 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb0d0b-b44e-468e-af86-5e5e68e9546a admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:56.592892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1087/2186] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:56 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:56.598859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb0d0b-b44e-468e-af86-5e5e68e9546a admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:56.619982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb0d0b-b44e-468e-af86-5e5e68e9546a admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:56.626720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ae3fd-d445-4a19-a124-db7a8e9098de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:56.627482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ae3fd-d445-4a19-a124-db7a8e9098de admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:56.628370 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ae3fd-d445-4a19-a124-db7a8e9098de admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:56.628370 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ae3fd-d445-4a19-a124-db7a8e9098de admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:56.628672 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ae3fd-d445-4a19-a124-db7a8e9098de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:56.630855 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ae3fd-d445-4a19-a124-db7a8e9098de admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:56.641577 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4589f-8f6c-491a-93da-2434b1e61a08 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:56.646417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1088/2187] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:56.649572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ae3fd-d445-4a19-a124-db7a8e9098de admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:56.654859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a7b2-3f6a-4fa0-b61d-7e2409418149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:56.658052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a7b2-3f6a-4fa0-b61d-7e2409418149 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:56.658596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a7b2-3f6a-4fa0-b61d-7e2409418149 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:56.659149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a7b2-3f6a-4fa0-b61d-7e2409418149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:56.665691 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ae3fd-d445-4a19-a124-db7a8e9098de admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:56.672342 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58a11e-e4e0-45c3-884f-68617f5e890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:56.673333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a11e-e4e0-45c3-884f-68617f5e890a admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:56.673468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a11e-e4e0-45c3-884f-68617f5e890a admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:56.673745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a11e-e4e0-45c3-884f-68617f5e890a admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:56.674445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58a11e-e4e0-45c3-884f-68617f5e890a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:56.675330 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171a7b2-3f6a-4fa0-b61d-7e2409418149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:56.676283 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58a11e-e4e0-45c3-884f-68617f5e890a admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:56.679558 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171a7b2-3f6a-4fa0-b61d-7e2409418149 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:56.696313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1100/2188] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:35:56.727069 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1089/2189] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:56.731171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a7b2-3f6a-4fa0-b61d-7e2409418149 service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:56.741114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a7b2-3f6a-4fa0-b61d-7e2409418149 service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:56.749856 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac3ff1-0a12-4bd5-bab5-74470d62fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:56.750556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac3ff1-0a12-4bd5-bab5-74470d62fb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:56.750836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac3ff1-0a12-4bd5-bab5-74470d62fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:56.751102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac3ff1-0a12-4bd5-bab5-74470d62fb8c admin admin] PATH_INFO: `/v3/projects/07c0c24c6cc548a98575b2cde4acf96f/users/71374c0aa5884087bd2617f04f6faa4a/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:56.788710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac3ff1-0a12-4bd5-bab5-74470d62fb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c0c24c6cc548a98575b2cde4acf96f, user_id=71374c0aa5884087bd2617f04f6faa4a, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:56.794429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac3ff1-0a12-4bd5-bab5-74470d62fb8c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:56.822848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1101/2190] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:56 2022] PUT /identity/v3/projects/07c0c24c6cc548a98575b2cde4acf96f/users/71374c0aa5884087bd2617f04f6faa4a/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:56.837900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880dcac-193b-4248-a58c-c222205a86f6 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:56.839220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880dcac-193b-4248-a58c-c222205a86f6 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:56.842704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880dcac-193b-4248-a58c-c222205a86f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:56.906409 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-e880dcac-193b-4248-a58c-c222205a86f6 None None] MFA Rules not processed for user `71374c0aa5884087bd2617f04f6faa4a`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:56.908795 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e880dcac-193b-4248-a58c-c222205a86f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:57.077264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:57.155033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1090/2191] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:57.164103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac3ff1-0a12-4bd5-bab5-74470d62fb8c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:57.167724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-91ac3ff1-0a12-4bd5-bab5-74470d62fb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:57.311446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac3ff1-0a12-4bd5-bab5-74470d62fb8c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:57.317000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10262a-8bf3-4e9b-be66-e23ad91e1731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:57.318751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10262a-8bf3-4e9b-be66-e23ad91e1731 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:57.319206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10262a-8bf3-4e9b-be66-e23ad91e1731 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:57.320470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10262a-8bf3-4e9b-be66-e23ad91e1731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:57.337458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10262a-8bf3-4e9b-be66-e23ad91e1731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:57.339563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10262a-8bf3-4e9b-be66-e23ad91e1731 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:57.370471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1102/2192] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:35:57.687307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880dcac-193b-4248-a58c-c222205a86f6 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:57.689749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e880dcac-193b-4248-a58c-c222205a86f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:57.831230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880dcac-193b-4248-a58c-c222205a86f6 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:57.840673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493f9d0-635f-4a4b-81ce-653c22072689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:57.841374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493f9d0-635f-4a4b-81ce-653c22072689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:57.841653 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493f9d0-635f-4a4b-81ce-653c22072689 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:57.842063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493f9d0-635f-4a4b-81ce-653c22072689 admin admin] PATH_INFO: `/v3/projects/8d371e43d1ed45f9a21394416deefc43` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:57.843298 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493f9d0-635f-4a4b-81ce-653c22072689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d371e43d1ed45f9a21394416deefc43)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:57.845778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493f9d0-635f-4a4b-81ce-653c22072689 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:57.956676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a493f9d0-635f-4a4b-81ce-653c22072689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d371e43d1ed45f9a21394416deefc43', 'request_id': 'req-a493f9d0-635f-4a4b-81ce-653c22072689'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:57.963376 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a493f9d0-635f-4a4b-81ce-653c22072689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d371e43d1ed45f9a21394416deefc43', 'request_id': 'req-a493f9d0-635f-4a4b-81ce-653c22072689'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:57.973538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a493f9d0-635f-4a4b-81ce-653c22072689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d371e43d1ed45f9a21394416deefc43', 'request_id': 'req-a493f9d0-635f-4a4b-81ce-653c22072689'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:57.987191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a493f9d0-635f-4a4b-81ce-653c22072689 admin admin] The token cache is being invalidate because project 8d371e43d1ed45f9a21394416deefc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:35:57.987597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a493f9d0-635f-4a4b-81ce-653c22072689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:57.988684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a493f9d0-635f-4a4b-81ce-653c22072689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:35:57.990648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1091/2193] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:35:57 2022] DELETE /identity/v3/projects/8d371e43d1ed45f9a21394416deefc43 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:57.995477 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ef8c1-3cab-4e9b-bc0c-88f5fb84608e None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:57.996299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ef8c1-3cab-4e9b-bc0c-88f5fb84608e None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:57.996582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ef8c1-3cab-4e9b-bc0c-88f5fb84608e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:58.018273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-705ef8c1-3cab-4e9b-bc0c-88f5fb84608e None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:58.019606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-705ef8c1-3cab-4e9b-bc0c-88f5fb84608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:58.077652 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:58.110681 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1103/2194] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:58.118708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ccf38-18ed-4108-9d65-a0bf89465c56 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:58.119143 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ccf38-18ed-4108-9d65-a0bf89465c56 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:58.119512 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ccf38-18ed-4108-9d65-a0bf89465c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:58.146493 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-f64ccf38-18ed-4108-9d65-a0bf89465c56 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:58.148107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f64ccf38-18ed-4108-9d65-a0bf89465c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:58.167633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1092/2195] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:58.173004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ef8c1-3cab-4e9b-bc0c-88f5fb84608e None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:58.187928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ef8c1-3cab-4e9b-bc0c-88f5fb84608e None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:58.195044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38410364-a88b-4d5b-89a9-eed185088e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:58.195698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38410364-a88b-4d5b-89a9-eed185088e2d admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:58.196005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38410364-a88b-4d5b-89a9-eed185088e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:58.196276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38410364-a88b-4d5b-89a9-eed185088e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:58.196960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38410364-a88b-4d5b-89a9-eed185088e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:35:58.197263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38410364-a88b-4d5b-89a9-eed185088e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:58.200080 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38410364-a88b-4d5b-89a9-eed185088e2d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:58.213972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1104/2196] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:35:58.219051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ccf38-18ed-4108-9d65-a0bf89465c56 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:58.243058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ccf38-18ed-4108-9d65-a0bf89465c56 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:58.265089 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae6593-b4cf-4097-96c1-d945c235c7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:58.265743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae6593-b4cf-4097-96c1-d945c235c7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:58.266020 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae6593-b4cf-4097-96c1-d945c235c7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:58.266283 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae6593-b4cf-4097-96c1-d945c235c7b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:58.266946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae6593-b4cf-4097-96c1-d945c235c7b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:58.268851 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae6593-b4cf-4097-96c1-d945c235c7b6 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:58.331208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1093/2197] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:35:58 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:58.332674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38410364-a88b-4d5b-89a9-eed185088e2d admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:58.348514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38410364-a88b-4d5b-89a9-eed185088e2d admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:58.497684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9141989-5f5d-4b99-9864-fc60e6b70efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:58.498638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9141989-5f5d-4b99-9864-fc60e6b70efb admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:58.499094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9141989-5f5d-4b99-9864-fc60e6b70efb admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:58.499472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9141989-5f5d-4b99-9864-fc60e6b70efb admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:58.500215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9141989-5f5d-4b99-9864-fc60e6b70efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:58.502805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9141989-5f5d-4b99-9864-fc60e6b70efb admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:58.547451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1105/2198] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:35:58 2022] POST /identity/v3/users => generated 282 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:35:58.551676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae6593-b4cf-4097-96c1-d945c235c7b6 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:58.566630 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae6593-b4cf-4097-96c1-d945c235c7b6 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:58.577448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4d7c2-1684-4813-b23d-8c92d42fe71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:58.578079 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4d7c2-1684-4813-b23d-8c92d42fe71f admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:58.578358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4d7c2-1684-4813-b23d-8c92d42fe71f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:58.578718 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4d7c2-1684-4813-b23d-8c92d42fe71f admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:58.579414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4d7c2-1684-4813-b23d-8c92d42fe71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:58.583762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4d7c2-1684-4813-b23d-8c92d42fe71f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:58.594987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1094/2199] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:58.599306 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9141989-5f5d-4b99-9864-fc60e6b70efb admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:58.615072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9141989-5f5d-4b99-9864-fc60e6b70efb admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:58.620523 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc36c0-167d-4531-80cb-155ff7d9e112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:58.621783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc36c0-167d-4531-80cb-155ff7d9e112 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:58.622063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc36c0-167d-4531-80cb-155ff7d9e112 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:58.622333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc36c0-167d-4531-80cb-155ff7d9e112 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:58.623779 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc36c0-167d-4531-80cb-155ff7d9e112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:58.625514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc36c0-167d-4531-80cb-155ff7d9e112 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:58.649228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1106/2200] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:35:58.650548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4d7c2-1684-4813-b23d-8c92d42fe71f admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:58.662087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4d7c2-1684-4813-b23d-8c92d42fe71f admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:58.667040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd05a25-b5d9-44ee-a384-d02439bc3e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:58.668338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd05a25-b5d9-44ee-a384-d02439bc3e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:58.668615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd05a25-b5d9-44ee-a384-d02439bc3e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:58.668888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd05a25-b5d9-44ee-a384-d02439bc3e9d admin admin] PATH_INFO: `/v3/projects/654fad8853fb49af873c00b81dbc710f/users/7b74acd70b424baf8b7b53703c58abce/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:58.696737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd05a25-b5d9-44ee-a384-d02439bc3e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=654fad8853fb49af873c00b81dbc710f, user_id=7b74acd70b424baf8b7b53703c58abce, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:58.700789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd05a25-b5d9-44ee-a384-d02439bc3e9d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:58.721071 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1095/2201] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:35:58 2022] PUT /identity/v3/projects/654fad8853fb49af873c00b81dbc710f/users/7b74acd70b424baf8b7b53703c58abce/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:35:58.731844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88205d-565c-4256-8274-a07d46c39087 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:58.732128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88205d-565c-4256-8274-a07d46c39087 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:58.732346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88205d-565c-4256-8274-a07d46c39087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:58.769100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8f88205d-565c-4256-8274-a07d46c39087 None None] MFA Rules not processed for user `7b74acd70b424baf8b7b53703c58abce`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:35:58.770399 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8f88205d-565c-4256-8274-a07d46c39087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:58.850527 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1107/2202] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:35:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:35:58.863410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd05a25-b5d9-44ee-a384-d02439bc3e9d admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:35:58.865503 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4fd05a25-b5d9-44ee-a384-d02439bc3e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:35:58.881749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:35:58.974308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd05a25-b5d9-44ee-a384-d02439bc3e9d admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:35:58.984202 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dfa2c-aab2-491b-bea9-d77828cc30bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:35:58.984977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dfa2c-aab2-491b-bea9-d77828cc30bb service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:35:58.985257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dfa2c-aab2-491b-bea9-d77828cc30bb service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:35:58.985934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dfa2c-aab2-491b-bea9-d77828cc30bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:35:58.996169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dfa2c-aab2-491b-bea9-d77828cc30bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:35:58.997644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dfa2c-aab2-491b-bea9-d77828cc30bb service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:35:59.007797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1096/2203] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:35:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:36:02.419001 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f3774-4959-4bc9-a820-4a0327a5f009 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:02.419943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f3774-4959-4bc9-a820-4a0327a5f009 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:02.420289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f3774-4959-4bc9-a820-4a0327a5f009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:02.450044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-935f3774-4959-4bc9-a820-4a0327a5f009 None None] MFA Rules not processed for user `7d6f98709d8443bebe278a78499c8b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:02.451309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-935f3774-4959-4bc9-a820-4a0327a5f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:02.491726 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:02.536632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1108/2204] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:02.554082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dfa2c-aab2-491b-bea9-d77828cc30bb service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:02.555839 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b00dfa2c-aab2-491b-bea9-d77828cc30bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:02.678686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dfa2c-aab2-491b-bea9-d77828cc30bb service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:02.685806 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f06560-43fb-4af3-a492-9ec46444f151 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:02.686860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f06560-43fb-4af3-a492-9ec46444f151 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:02.687211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f06560-43fb-4af3-a492-9ec46444f151 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:02.687555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f06560-43fb-4af3-a492-9ec46444f151 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:02.696883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f06560-43fb-4af3-a492-9ec46444f151 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:02.698668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f06560-43fb-4af3-a492-9ec46444f151 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:02.711251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1097/2205] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:36:03.658480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f3774-4959-4bc9-a820-4a0327a5f009 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:03.660043 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-935f3774-4959-4bc9-a820-4a0327a5f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:03.737572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f3774-4959-4bc9-a820-4a0327a5f009 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:03.742360 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:03.743017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:03.743298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:03.743571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] PATH_INFO: `/v3/users/71374c0aa5884087bd2617f04f6faa4a` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:03.744764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71374c0aa5884087bd2617f04f6faa4a)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:03.746808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:03.803851 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71374c0aa5884087bd2617f04f6faa4a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:03.805246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71374c0aa5884087bd2617f04f6faa4a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:03.813606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71374c0aa5884087bd2617f04f6faa4a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:03.825520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71374c0aa5884087bd2617f04f6faa4a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:03.826216 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71374c0aa5884087bd2617f04f6faa4a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:03.851141 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1109/2206] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:36:03 2022] DELETE /identity/v3/users/71374c0aa5884087bd2617f04f6faa4a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:03.852648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7f243-2944-404d-a328-a8a70ffc696d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:03.853067 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7f243-2944-404d-a328-a8a70ffc696d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:03.853231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7f243-2944-404d-a328-a8a70ffc696d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:03.873829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-60b7f243-2944-404d-a328-a8a70ffc696d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:03.875118 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-60b7f243-2944-404d-a328-a8a70ffc696d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:03.946726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1098/2207] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:03.959950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:03.961591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:04.067395 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:04.082451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b6cfa-27bf-49ee-95ba-e9db0a70afb9 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:04.097960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e27ba-e27e-4cdf-b971-ba48f09afb91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:04.098687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e27ba-e27e-4cdf-b971-ba48f09afb91 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:04.099012 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e27ba-e27e-4cdf-b971-ba48f09afb91 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:04.099359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e27ba-e27e-4cdf-b971-ba48f09afb91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:04.125676 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e27ba-e27e-4cdf-b971-ba48f09afb91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:04.128863 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e27ba-e27e-4cdf-b971-ba48f09afb91 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:04.146496 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1110/2208] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:36:04.700841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9174959-daac-4f31-90f1-489aa21220d5 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:04.701459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9174959-daac-4f31-90f1-489aa21220d5 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:04.701834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9174959-daac-4f31-90f1-489aa21220d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:04.740448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-f9174959-daac-4f31-90f1-489aa21220d5 None None] MFA Rules not processed for user `7d6f98709d8443bebe278a78499c8b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:04.741955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f9174959-daac-4f31-90f1-489aa21220d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:04.802249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:04.837757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e27ba-e27e-4cdf-b971-ba48f09afb91 service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:04.840872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3d5e27ba-e27e-4cdf-b971-ba48f09afb91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:04.873866 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e27ba-e27e-4cdf-b971-ba48f09afb91 service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:04.883891 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1099/2209] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:04.884745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3d602-b1bc-4792-a97b-e24d670325ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:04.886639 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3d602-b1bc-4792-a97b-e24d670325ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:04.887105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3d602-b1bc-4792-a97b-e24d670325ad admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:04.890395 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3d602-b1bc-4792-a97b-e24d670325ad admin admin] PATH_INFO: `/v3/projects/07c0c24c6cc548a98575b2cde4acf96f` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:04.904176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3d602-b1bc-4792-a97b-e24d670325ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c0c24c6cc548a98575b2cde4acf96f)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:04.907992 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3d602-b1bc-4792-a97b-e24d670325ad admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:05.043733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-50b3d602-b1bc-4792-a97b-e24d670325ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c0c24c6cc548a98575b2cde4acf96f', 'request_id': 'req-50b3d602-b1bc-4792-a97b-e24d670325ad'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:05.052683 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-50b3d602-b1bc-4792-a97b-e24d670325ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c0c24c6cc548a98575b2cde4acf96f', 'request_id': 'req-50b3d602-b1bc-4792-a97b-e24d670325ad'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:05.079758 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-50b3d602-b1bc-4792-a97b-e24d670325ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c0c24c6cc548a98575b2cde4acf96f', 'request_id': 'req-50b3d602-b1bc-4792-a97b-e24d670325ad'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:05.111740 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-50b3d602-b1bc-4792-a97b-e24d670325ad admin admin] The token cache is being invalidate because project 07c0c24c6cc548a98575b2cde4acf96f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:36:05.112071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-50b3d602-b1bc-4792-a97b-e24d670325ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:05.112736 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-50b3d602-b1bc-4792-a97b-e24d670325ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:05.115058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1111/2210] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:36:04 2022] DELETE /identity/v3/projects/07c0c24c6cc548a98575b2cde4acf96f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:36:05.120120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19e00e-699c-48b0-b9ce-8f22d0dbbdd4 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:05.120444 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19e00e-699c-48b0-b9ce-8f22d0dbbdd4 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:05.120726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19e00e-699c-48b0-b9ce-8f22d0dbbdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:05.159775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-0f19e00e-699c-48b0-b9ce-8f22d0dbbdd4 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:05.161025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0f19e00e-699c-48b0-b9ce-8f22d0dbbdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:05.333217 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9fcb9-822c-4f18-9eec-eee1d6845dde None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:05.333504 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9fcb9-822c-4f18-9eec-eee1d6845dde None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:05.333781 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9fcb9-822c-4f18-9eec-eee1d6845dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:05.343932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1100/2211] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:05.401354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-e7b9fcb9-822c-4f18-9eec-eee1d6845dde None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:05.403839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e7b9fcb9-822c-4f18-9eec-eee1d6845dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:05.444726 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1112/2212] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:36:05.449530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19e00e-699c-48b0-b9ce-8f22d0dbbdd4 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:05.459659 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19e00e-699c-48b0-b9ce-8f22d0dbbdd4 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:05.497249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8af94f-18b0-49b8-bc75-77c74a91d53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:05.500623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8af94f-18b0-49b8-bc75-77c74a91d53f admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:05.505580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8af94f-18b0-49b8-bc75-77c74a91d53f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:05.508825 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8af94f-18b0-49b8-bc75-77c74a91d53f admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:05.509782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8af94f-18b0-49b8-bc75-77c74a91d53f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:36:05.512031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8af94f-18b0-49b8-bc75-77c74a91d53f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:05.513868 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8af94f-18b0-49b8-bc75-77c74a91d53f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:05.538550 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1101/2213] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:36:05.543690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9fcb9-822c-4f18-9eec-eee1d6845dde None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:05.563138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9fcb9-822c-4f18-9eec-eee1d6845dde None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:05.578322 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189fa18-46c4-4c08-9f96-b79569ad4119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:05.579027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189fa18-46c4-4c08-9f96-b79569ad4119 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:05.579307 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189fa18-46c4-4c08-9f96-b79569ad4119 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:05.581326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189fa18-46c4-4c08-9f96-b79569ad4119 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:05.581644 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189fa18-46c4-4c08-9f96-b79569ad4119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:05.589266 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189fa18-46c4-4c08-9f96-b79569ad4119 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:05.652602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1113/2214] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:36:05 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:36:05.656669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8af94f-18b0-49b8-bc75-77c74a91d53f admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:05.671993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8af94f-18b0-49b8-bc75-77c74a91d53f admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:05.797068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9334806-45c8-4d09-b5b0-d1c2bbb786e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:05.798220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9334806-45c8-4d09-b5b0-d1c2bbb786e5 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:05.798752 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9334806-45c8-4d09-b5b0-d1c2bbb786e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:05.799098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9334806-45c8-4d09-b5b0-d1c2bbb786e5 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:05.799678 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9334806-45c8-4d09-b5b0-d1c2bbb786e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:05.806563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9334806-45c8-4d09-b5b0-d1c2bbb786e5 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:05.866631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1102/2215] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:36:05 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:36:05.867699 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189fa18-46c4-4c08-9f96-b79569ad4119 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:05.885100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189fa18-46c4-4c08-9f96-b79569ad4119 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:05.896701 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbd4e5-5ee4-4b6b-8219-d3af27314806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:05.897608 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbd4e5-5ee4-4b6b-8219-d3af27314806 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:05.898100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbd4e5-5ee4-4b6b-8219-d3af27314806 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:05.899614 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbd4e5-5ee4-4b6b-8219-d3af27314806 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:05.900432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbd4e5-5ee4-4b6b-8219-d3af27314806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:05.908538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbd4e5-5ee4-4b6b-8219-d3af27314806 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:05.922904 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1114/2216] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:36:05.927636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9334806-45c8-4d09-b5b0-d1c2bbb786e5 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:05.943447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9334806-45c8-4d09-b5b0-d1c2bbb786e5 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:05.949808 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8ef8c-acef-4ef5-80e1-e45f27657c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:05.950743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8ef8c-acef-4ef5-80e1-e45f27657c79 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:05.951207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8ef8c-acef-4ef5-80e1-e45f27657c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:05.951459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8ef8c-acef-4ef5-80e1-e45f27657c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:05.952262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8ef8c-acef-4ef5-80e1-e45f27657c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:05.954084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8ef8c-acef-4ef5-80e1-e45f27657c79 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:05.968410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1103/2217] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:36:05.972603 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbd4e5-5ee4-4b6b-8219-d3af27314806 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:05.994621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbd4e5-5ee4-4b6b-8219-d3af27314806 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:06.000885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be49789-13f7-48c3-bb3c-788ee8b2d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:06.001556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be49789-13f7-48c3-bb3c-788ee8b2d499 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:06.001842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be49789-13f7-48c3-bb3c-788ee8b2d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:06.002120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be49789-13f7-48c3-bb3c-788ee8b2d499 admin admin] PATH_INFO: `/v3/projects/b039fc086fad4a9fb0e937e43572106c/users/02bdb86b52e14b658113366eaa5498fc/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:06.022104 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be49789-13f7-48c3-bb3c-788ee8b2d499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b039fc086fad4a9fb0e937e43572106c, user_id=02bdb86b52e14b658113366eaa5498fc, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:06.024898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be49789-13f7-48c3-bb3c-788ee8b2d499 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:06.050325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1115/2218] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:36:05 2022] PUT /identity/v3/projects/b039fc086fad4a9fb0e937e43572106c/users/02bdb86b52e14b658113366eaa5498fc/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:06.063461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e445a-48f3-4c24-8003-9f45215fab95 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:06.064261 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e445a-48f3-4c24-8003-9f45215fab95 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:06.064874 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e445a-48f3-4c24-8003-9f45215fab95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:06.112164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-1a7e445a-48f3-4c24-8003-9f45215fab95 None None] MFA Rules not processed for user `02bdb86b52e14b658113366eaa5498fc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:06.114695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1a7e445a-48f3-4c24-8003-9f45215fab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:06.198914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:06.262107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1104/2219] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:06.266865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be49789-13f7-48c3-bb3c-788ee8b2d499 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:06.347884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be49789-13f7-48c3-bb3c-788ee8b2d499 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:06.354231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f17b0f-e75e-46b9-91f0-d68f8420b387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:06.355517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f17b0f-e75e-46b9-91f0-d68f8420b387 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:06.355794 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f17b0f-e75e-46b9-91f0-d68f8420b387 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:06.356059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f17b0f-e75e-46b9-91f0-d68f8420b387 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:06.356692 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f17b0f-e75e-46b9-91f0-d68f8420b387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:06.358848 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f17b0f-e75e-46b9-91f0-d68f8420b387 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:06.377529 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:06.397521 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1116/2220] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:36:06 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:36:06.402321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e445a-48f3-4c24-8003-9f45215fab95 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:06.414181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e445a-48f3-4c24-8003-9f45215fab95 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:06.488272 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4f952-0651-4e1f-b24f-a581d4398399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:06.489004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4f952-0651-4e1f-b24f-a581d4398399 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:06.489289 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4f952-0651-4e1f-b24f-a581d4398399 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:06.489569 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4f952-0651-4e1f-b24f-a581d4398399 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:06.490212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4f952-0651-4e1f-b24f-a581d4398399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:06.492205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4f952-0651-4e1f-b24f-a581d4398399 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:06.523421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1105/2221] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:36:06 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:36:06.528000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f17b0f-e75e-46b9-91f0-d68f8420b387 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:06.540128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f17b0f-e75e-46b9-91f0-d68f8420b387 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:06.547600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02fbee-3ee5-4b72-be64-20113be58c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:06.548499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02fbee-3ee5-4b72-be64-20113be58c6b admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:06.548982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02fbee-3ee5-4b72-be64-20113be58c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:06.549420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02fbee-3ee5-4b72-be64-20113be58c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:06.550251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02fbee-3ee5-4b72-be64-20113be58c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:06.551892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02fbee-3ee5-4b72-be64-20113be58c6b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:06.567914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1117/2222] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:36:06.569643 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4f952-0651-4e1f-b24f-a581d4398399 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:06.582128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4f952-0651-4e1f-b24f-a581d4398399 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:06.590034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef50ec-5432-4c0b-a020-763f789ebfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:06.591189 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef50ec-5432-4c0b-a020-763f789ebfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:06.591702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef50ec-5432-4c0b-a020-763f789ebfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:06.592388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef50ec-5432-4c0b-a020-763f789ebfc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:06.593464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef50ec-5432-4c0b-a020-763f789ebfc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:06.595817 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef50ec-5432-4c0b-a020-763f789ebfc2 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:06.612133 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1106/2223] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:36:06.613131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02fbee-3ee5-4b72-be64-20113be58c6b admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:06.624124 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02fbee-3ee5-4b72-be64-20113be58c6b admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:06.629661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c12b4-83f5-457e-9480-a78283a20822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:06.630386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c12b4-83f5-457e-9480-a78283a20822 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:06.630760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c12b4-83f5-457e-9480-a78283a20822 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:06.631100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c12b4-83f5-457e-9480-a78283a20822 admin admin] PATH_INFO: `/v3/projects/fff794233ada419381ecaa19c6b8553f/users/dcac4040c4cc4d768fe8ad4af1f44712/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:06.653110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c12b4-83f5-457e-9480-a78283a20822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff794233ada419381ecaa19c6b8553f, user_id=dcac4040c4cc4d768fe8ad4af1f44712, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:06.656017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c12b4-83f5-457e-9480-a78283a20822 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:06.680794 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1118/2224] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:36:06 2022] PUT /identity/v3/projects/fff794233ada419381ecaa19c6b8553f/users/dcac4040c4cc4d768fe8ad4af1f44712/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:06.682542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bdff6-4bd8-4d71-a159-273b4fc4ee98 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:06.682817 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bdff6-4bd8-4d71-a159-273b4fc4ee98 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:06.683141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bdff6-4bd8-4d71-a159-273b4fc4ee98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:06.718789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-820bdff6-4bd8-4d71-a159-273b4fc4ee98 None None] MFA Rules not processed for user `dcac4040c4cc4d768fe8ad4af1f44712`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:06.720369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-820bdff6-4bd8-4d71-a159-273b4fc4ee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:06.799276 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1107/2225] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:06.804183 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c12b4-83f5-457e-9480-a78283a20822 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:06.890445 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c12b4-83f5-457e-9480-a78283a20822 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:06.896914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fb519-c4d4-43fa-86d9-4e86daa29184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:06.897533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fb519-c4d4-43fa-86d9-4e86daa29184 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:06.897943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fb519-c4d4-43fa-86d9-4e86daa29184 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:06.898219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fb519-c4d4-43fa-86d9-4e86daa29184 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:06.899110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fb519-c4d4-43fa-86d9-4e86daa29184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:06.903142 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fb519-c4d4-43fa-86d9-4e86daa29184 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:06.935227 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1119/2226] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:36:06 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:36:06.939042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bdff6-4bd8-4d71-a159-273b4fc4ee98 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:06.953083 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bdff6-4bd8-4d71-a159-273b4fc4ee98 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:07.029909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:07.053219 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cd033-4cf9-48b3-99e3-02aa23af38e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:07.053829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cd033-4cf9-48b3-99e3-02aa23af38e2 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:07.054111 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cd033-4cf9-48b3-99e3-02aa23af38e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:07.054381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cd033-4cf9-48b3-99e3-02aa23af38e2 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:07.055072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cd033-4cf9-48b3-99e3-02aa23af38e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:07.057006 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cd033-4cf9-48b3-99e3-02aa23af38e2 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:07.085215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1108/2227] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:36:06 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:36:07.089287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fb519-c4d4-43fa-86d9-4e86daa29184 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:07.103267 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fb519-c4d4-43fa-86d9-4e86daa29184 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:07.108083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98003-1de2-42d8-9539-68904c1a142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:07.108684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98003-1de2-42d8-9539-68904c1a142d admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:07.108962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98003-1de2-42d8-9539-68904c1a142d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:07.109228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98003-1de2-42d8-9539-68904c1a142d admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:07.109879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be98003-1de2-42d8-9539-68904c1a142d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:07.111630 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be98003-1de2-42d8-9539-68904c1a142d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:07.123571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1120/2228] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:36:07.127928 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cd033-4cf9-48b3-99e3-02aa23af38e2 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:07.140378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cd033-4cf9-48b3-99e3-02aa23af38e2 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:07.145644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf5e18-11e1-4fd2-8a9c-ab019e29f110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:07.146440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5e18-11e1-4fd2-8a9c-ab019e29f110 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:07.147004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5e18-11e1-4fd2-8a9c-ab019e29f110 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:07.147341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5e18-11e1-4fd2-8a9c-ab019e29f110 admin admin] PATH_INFO: `/v3/projects/255339370b624ca393420ed31921a8d1/users/2ea45407122e45b3a9bc9ab1d096a97b/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:07.166788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf5e18-11e1-4fd2-8a9c-ab019e29f110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=255339370b624ca393420ed31921a8d1, user_id=2ea45407122e45b3a9bc9ab1d096a97b, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:07.169757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf5e18-11e1-4fd2-8a9c-ab019e29f110 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:07.191788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1109/2229] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:36:07 2022] PUT /identity/v3/projects/255339370b624ca393420ed31921a8d1/users/2ea45407122e45b3a9bc9ab1d096a97b/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:07.192557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98003-1de2-42d8-9539-68904c1a142d admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:07.208258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98003-1de2-42d8-9539-68904c1a142d admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:07.343846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394c68a-b961-431f-8714-9c71bd53e8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:07.351307 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394c68a-b961-431f-8714-9c71bd53e8eb admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:07.351905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394c68a-b961-431f-8714-9c71bd53e8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:07.353364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394c68a-b961-431f-8714-9c71bd53e8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:07.353364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394c68a-b961-431f-8714-9c71bd53e8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:07.357121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394c68a-b961-431f-8714-9c71bd53e8eb admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:07.391396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1121/2230] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:36:07.392896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf5e18-11e1-4fd2-8a9c-ab019e29f110 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:07.408176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf5e18-11e1-4fd2-8a9c-ab019e29f110 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:07.416709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98723f-9bde-4cd8-9eb0-230d3ddbbf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:07.418637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98723f-9bde-4cd8-9eb0-230d3ddbbf8e admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:07.419062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98723f-9bde-4cd8-9eb0-230d3ddbbf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:07.419478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98723f-9bde-4cd8-9eb0-230d3ddbbf8e admin admin] PATH_INFO: `/v3/projects/255339370b624ca393420ed31921a8d1/users/2ea45407122e45b3a9bc9ab1d096a97b/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:07.421626 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98723f-9bde-4cd8-9eb0-230d3ddbbf8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=255339370b624ca393420ed31921a8d1, user_id=2ea45407122e45b3a9bc9ab1d096a97b, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:07.426466 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98723f-9bde-4cd8-9eb0-230d3ddbbf8e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:07.461561 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1110/2231] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:36:07 2022] PUT /identity/v3/projects/255339370b624ca393420ed31921a8d1/users/2ea45407122e45b3a9bc9ab1d096a97b/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:07.472522 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8c61d-766d-4b4d-9800-c7a81238987a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:07.473169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8c61d-766d-4b4d-9800-c7a81238987a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:07.473632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8c61d-766d-4b4d-9800-c7a81238987a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:07.533116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-18a8c61d-766d-4b4d-9800-c7a81238987a None None] MFA Rules not processed for user `2ea45407122e45b3a9bc9ab1d096a97b`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:07.534896 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-18a8c61d-766d-4b4d-9800-c7a81238987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:07.560091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:07.617487 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1122/2232] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:07.629842 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98723f-9bde-4cd8-9eb0-230d3ddbbf8e admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:07.631766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1d98723f-9bde-4cd8-9eb0-230d3ddbbf8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:07.693001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98723f-9bde-4cd8-9eb0-230d3ddbbf8e admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:07.696602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96c28-e86d-4db1-8cf1-34bd078f7c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:07.697284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96c28-e86d-4db1-8cf1-34bd078f7c3d service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:07.697563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96c28-e86d-4db1-8cf1-34bd078f7c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:07.697833 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96c28-e86d-4db1-8cf1-34bd078f7c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:07.756038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d96c28-e86d-4db1-8cf1-34bd078f7c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:07.757500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d96c28-e86d-4db1-8cf1-34bd078f7c3d service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:07.767681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1111/2233] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:36:09.431221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8c61d-766d-4b4d-9800-c7a81238987a None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:09.434248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-18a8c61d-766d-4b4d-9800-c7a81238987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:09.447129 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8c61d-766d-4b4d-9800-c7a81238987a None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:09.451688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773fbda-4d61-4b4c-bd43-6a29ac43e746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:09.452386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773fbda-4d61-4b4c-bd43-6a29ac43e746 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:09.452730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773fbda-4d61-4b4c-bd43-6a29ac43e746 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:09.453078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773fbda-4d61-4b4c-bd43-6a29ac43e746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:09.538307 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773fbda-4d61-4b4c-bd43-6a29ac43e746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:09.540126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773fbda-4d61-4b4c-bd43-6a29ac43e746 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:09.551828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1123/2234] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:36:10.232157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96c28-e86d-4db1-8cf1-34bd078f7c3d service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:10.245870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96c28-e86d-4db1-8cf1-34bd078f7c3d service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:10.249670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816c11c-6e01-4cac-b5b9-86f3698b4954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:10.250281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816c11c-6e01-4cac-b5b9-86f3698b4954 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:10.250606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816c11c-6e01-4cac-b5b9-86f3698b4954 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:10.250987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816c11c-6e01-4cac-b5b9-86f3698b4954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:10.261426 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816c11c-6e01-4cac-b5b9-86f3698b4954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:10.263055 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816c11c-6e01-4cac-b5b9-86f3698b4954 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:10.273524 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1112/2235] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:36:14.324761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773fbda-4d61-4b4c-bd43-6a29ac43e746 service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:14.411603 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773fbda-4d61-4b4c-bd43-6a29ac43e746 service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:14.416591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:14.418022 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:14.418368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:14.418734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] PATH_INFO: `/v3/users/02bdb86b52e14b658113366eaa5498fc` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:14.419963 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02bdb86b52e14b658113366eaa5498fc)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:14.421931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:14.470249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02bdb86b52e14b658113366eaa5498fc'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:14.470930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02bdb86b52e14b658113366eaa5498fc'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:14.478086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02bdb86b52e14b658113366eaa5498fc'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:14.480569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:14.490013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02bdb86b52e14b658113366eaa5498fc'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:14.490820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02bdb86b52e14b658113366eaa5498fc'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:14.508524 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1124/2236] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:36:14 2022] DELETE /identity/v3/users/02bdb86b52e14b658113366eaa5498fc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:14.512986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acdeca-e974-4d7a-8a8b-22e2e625ce94 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:14.513495 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acdeca-e974-4d7a-8a8b-22e2e625ce94 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:14.513586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acdeca-e974-4d7a-8a8b-22e2e625ce94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:14.532978 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-96acdeca-e974-4d7a-8a8b-22e2e625ce94 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:14.534192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-96acdeca-e974-4d7a-8a8b-22e2e625ce94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:14.563425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:14.594199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1113/2237] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:14.603983 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:14.606178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:14.666783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e1980-bb49-4919-9d45-a8c8964807f7 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:14.671230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fa4ab-306e-4219-85d8-a9bd092e776f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:14.672035 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa4ab-306e-4219-85d8-a9bd092e776f service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:14.672321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa4ab-306e-4219-85d8-a9bd092e776f service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:14.672631 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa4ab-306e-4219-85d8-a9bd092e776f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:14.683088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fa4ab-306e-4219-85d8-a9bd092e776f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:14.684562 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fa4ab-306e-4219-85d8-a9bd092e776f service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:14.695955 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1125/2238] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:36:14.986254 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acdeca-e974-4d7a-8a8b-22e2e625ce94 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:14.988872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-96acdeca-e974-4d7a-8a8b-22e2e625ce94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:15.002240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acdeca-e974-4d7a-8a8b-22e2e625ce94 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:15.007653 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:15.008297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:15.008580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:15.008853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] PATH_INFO: `/v3/projects/b039fc086fad4a9fb0e937e43572106c` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:15.009990 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b039fc086fad4a9fb0e937e43572106c)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:15.012001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:15.074229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b039fc086fad4a9fb0e937e43572106c', 'request_id': 'req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.094728 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b039fc086fad4a9fb0e937e43572106c', 'request_id': 'req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.094728 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b039fc086fad4a9fb0e937e43572106c', 'request_id': 'req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.106794 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] The token cache is being invalidate because project b039fc086fad4a9fb0e937e43572106c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:36:15.107082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.107797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.110588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1114/2239] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:36:14 2022] DELETE /identity/v3/projects/b039fc086fad4a9fb0e937e43572106c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:15.113853 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fa4ab-306e-4219-85d8-a9bd092e776f service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:15.125430 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fa4ab-306e-4219-85d8-a9bd092e776f service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:15.204170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:15.204819 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:15.205079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:15.205353 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] PATH_INFO: `/v3/users/dcac4040c4cc4d768fe8ad4af1f44712` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:15.206785 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcac4040c4cc4d768fe8ad4af1f44712)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:15.208825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:15.278375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcac4040c4cc4d768fe8ad4af1f44712'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.279189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcac4040c4cc4d768fe8ad4af1f44712'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.287314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcac4040c4cc4d768fe8ad4af1f44712'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.296507 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcac4040c4cc4d768fe8ad4af1f44712'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.297290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcac4040c4cc4d768fe8ad4af1f44712'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.310140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:15.318679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1126/2240] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:36:15 2022] DELETE /identity/v3/users/dcac4040c4cc4d768fe8ad4af1f44712 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:15.801729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:15.804153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:15.825090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18ed91-9fe1-4ab3-9ed8-2d81e8c0a924 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:15.888061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:15.888652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:15.889099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:15.889373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] PATH_INFO: `/v3/projects/fff794233ada419381ecaa19c6b8553f` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:15.890484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff794233ada419381ecaa19c6b8553f)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:15.892424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:15.944574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff794233ada419381ecaa19c6b8553f', 'request_id': 'req-8a027d28-c6bd-4b9d-b008-3bce79570f0d'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.950346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff794233ada419381ecaa19c6b8553f', 'request_id': 'req-8a027d28-c6bd-4b9d-b008-3bce79570f0d'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.952236 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:15.960347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff794233ada419381ecaa19c6b8553f', 'request_id': 'req-8a027d28-c6bd-4b9d-b008-3bce79570f0d'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.976050 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] The token cache is being invalidate because project fff794233ada419381ecaa19c6b8553f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:36:15.976351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.977030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:15.978545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1115/2241] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:36:15 2022] DELETE /identity/v3/projects/fff794233ada419381ecaa19c6b8553f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:15.983470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:15.985077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:15.998426 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc99de-2819-422c-a231-3c7bf483eb28 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:16.065697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15560a9-c0aa-4700-93fc-692460bb5068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:16.066352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15560a9-c0aa-4700-93fc-692460bb5068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:16.066675 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15560a9-c0aa-4700-93fc-692460bb5068 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:16.066951 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15560a9-c0aa-4700-93fc-692460bb5068 admin admin] PATH_INFO: `/v3/users/2ea45407122e45b3a9bc9ab1d096a97b` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:16.068544 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15560a9-c0aa-4700-93fc-692460bb5068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea45407122e45b3a9bc9ab1d096a97b)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:16.070528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15560a9-c0aa-4700-93fc-692460bb5068 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:16.127118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e15560a9-c0aa-4700-93fc-692460bb5068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea45407122e45b3a9bc9ab1d096a97b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:16.127118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e15560a9-c0aa-4700-93fc-692460bb5068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea45407122e45b3a9bc9ab1d096a97b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:16.132856 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e15560a9-c0aa-4700-93fc-692460bb5068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea45407122e45b3a9bc9ab1d096a97b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:16.141002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e15560a9-c0aa-4700-93fc-692460bb5068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea45407122e45b3a9bc9ab1d096a97b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:16.141647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e15560a9-c0aa-4700-93fc-692460bb5068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea45407122e45b3a9bc9ab1d096a97b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:16.160949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1127/2242] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:36:15 2022] DELETE /identity/v3/users/2ea45407122e45b3a9bc9ab1d096a97b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:16.457577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:16.459112 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:16.487527 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a027d28-c6bd-4b9d-b008-3bce79570f0d admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:16.564386 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54df9ec-d631-4895-9f32-d3638c91162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:16.565032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54df9ec-d631-4895-9f32-d3638c91162b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:16.565310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54df9ec-d631-4895-9f32-d3638c91162b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:16.565579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54df9ec-d631-4895-9f32-d3638c91162b admin admin] PATH_INFO: `/v3/projects/255339370b624ca393420ed31921a8d1` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:16.566749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54df9ec-d631-4895-9f32-d3638c91162b admin admin] RBAC: Authorizing `identity:delete_project(project_id=255339370b624ca393420ed31921a8d1)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:16.568730 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54df9ec-d631-4895-9f32-d3638c91162b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:16.619980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b54df9ec-d631-4895-9f32-d3638c91162b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255339370b624ca393420ed31921a8d1', 'request_id': 'req-b54df9ec-d631-4895-9f32-d3638c91162b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:16.626914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b54df9ec-d631-4895-9f32-d3638c91162b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255339370b624ca393420ed31921a8d1', 'request_id': 'req-b54df9ec-d631-4895-9f32-d3638c91162b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:16.636959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b54df9ec-d631-4895-9f32-d3638c91162b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255339370b624ca393420ed31921a8d1', 'request_id': 'req-b54df9ec-d631-4895-9f32-d3638c91162b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:16.652365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b54df9ec-d631-4895-9f32-d3638c91162b admin admin] The token cache is being invalidate because project 255339370b624ca393420ed31921a8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:36:16.652636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b54df9ec-d631-4895-9f32-d3638c91162b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:16.653329 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-b54df9ec-d631-4895-9f32-d3638c91162b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:16.655438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1116/2243] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:36:16 2022] DELETE /identity/v3/projects/255339370b624ca393420ed31921a8d1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:16.659537 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf497c-6865-4e14-83e3-635572f5cb8f None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:16.659822 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf497c-6865-4e14-83e3-635572f5cb8f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:16.660102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf497c-6865-4e14-83e3-635572f5cb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:16.680176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-1cdf497c-6865-4e14-83e3-635572f5cb8f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:16.681482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1cdf497c-6865-4e14-83e3-635572f5cb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:16.746808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1128/2244] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:16.754579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce79f3d-b309-4ea4-888b-9cc210b59f77 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:16.754871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce79f3d-b309-4ea4-888b-9cc210b59f77 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:16.755145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce79f3d-b309-4ea4-888b-9cc210b59f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:16.774924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-6ce79f3d-b309-4ea4-888b-9cc210b59f77 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:16.776158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6ce79f3d-b309-4ea4-888b-9cc210b59f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:16.787747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1117/2245] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:16.792546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf497c-6865-4e14-83e3-635572f5cb8f None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:16.802501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf497c-6865-4e14-83e3-635572f5cb8f None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:16.807275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15432a-fe0f-487a-89fc-f94a5a1939f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:16.807962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15432a-fe0f-487a-89fc-f94a5a1939f7 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:16.808311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15432a-fe0f-487a-89fc-f94a5a1939f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:16.808654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15432a-fe0f-487a-89fc-f94a5a1939f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:16.809387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15432a-fe0f-487a-89fc-f94a5a1939f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:36:16.809758 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15432a-fe0f-487a-89fc-f94a5a1939f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:16.811444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15432a-fe0f-487a-89fc-f94a5a1939f7 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:16.830877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1129/2246] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:36:16.834915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce79f3d-b309-4ea4-888b-9cc210b59f77 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:16.844782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce79f3d-b309-4ea4-888b-9cc210b59f77 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:16.849504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6f69f-3a61-4126-b880-c36e50feae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:16.850106 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6f69f-3a61-4126-b880-c36e50feae81 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:16.850383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6f69f-3a61-4126-b880-c36e50feae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:16.850689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6f69f-3a61-4126-b880-c36e50feae81 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:16.851319 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6f69f-3a61-4126-b880-c36e50feae81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:16.853221 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6f69f-3a61-4126-b880-c36e50feae81 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:16.887870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1118/2247] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:36:16 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:36:16.889045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15432a-fe0f-487a-89fc-f94a5a1939f7 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:16.894457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:16.904453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15432a-fe0f-487a-89fc-f94a5a1939f7 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:16.977687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d558db7-c000-442e-b436-84fb208c33f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:16.978922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d558db7-c000-442e-b436-84fb208c33f4 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:16.979210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d558db7-c000-442e-b436-84fb208c33f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:16.980153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d558db7-c000-442e-b436-84fb208c33f4 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:16.980967 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d558db7-c000-442e-b436-84fb208c33f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:16.982979 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d558db7-c000-442e-b436-84fb208c33f4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:17.011862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1130/2248] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:36:16 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:36:17.016027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6f69f-3a61-4126-b880-c36e50feae81 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:17.028021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6f69f-3a61-4126-b880-c36e50feae81 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:17.039251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13070d0-7f02-4477-bf9b-9037e751fc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:17.039878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13070d0-7f02-4477-bf9b-9037e751fc08 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:17.040152 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13070d0-7f02-4477-bf9b-9037e751fc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:17.040417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13070d0-7f02-4477-bf9b-9037e751fc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:17.041058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13070d0-7f02-4477-bf9b-9037e751fc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:17.043239 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13070d0-7f02-4477-bf9b-9037e751fc08 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:17.057101 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1119/2249] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:36:17.058874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d558db7-c000-442e-b436-84fb208c33f4 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:17.070179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d558db7-c000-442e-b436-84fb208c33f4 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:17.074964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54e476-84ed-43f3-a6cb-cfa1154c5d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:17.075565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54e476-84ed-43f3-a6cb-cfa1154c5d6e admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:17.075845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54e476-84ed-43f3-a6cb-cfa1154c5d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:17.076117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54e476-84ed-43f3-a6cb-cfa1154c5d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:17.076761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54e476-84ed-43f3-a6cb-cfa1154c5d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:17.086652 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54e476-84ed-43f3-a6cb-cfa1154c5d6e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:17.091185 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1131/2250] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:36:17.094985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13070d0-7f02-4477-bf9b-9037e751fc08 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:17.106077 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13070d0-7f02-4477-bf9b-9037e751fc08 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:17.110704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c165b-d105-44fd-9c37-a86aa831faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:17.111340 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c165b-d105-44fd-9c37-a86aa831faf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:17.111614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c165b-d105-44fd-9c37-a86aa831faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:17.111880 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c165b-d105-44fd-9c37-a86aa831faf2 admin admin] PATH_INFO: `/v3/projects/dc78b622602c451b8baae6faf1201e3f/users/10c567aa180c4da597f2caf62aae8f7d/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:17.127910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c165b-d105-44fd-9c37-a86aa831faf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc78b622602c451b8baae6faf1201e3f, user_id=10c567aa180c4da597f2caf62aae8f7d, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:17.130586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c165b-d105-44fd-9c37-a86aa831faf2 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:17.146430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1120/2251] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:36:17 2022] PUT /identity/v3/projects/dc78b622602c451b8baae6faf1201e3f/users/10c567aa180c4da597f2caf62aae8f7d/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:17.217266 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4faff5-4456-46e8-b62d-51b9181fc15a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:17.217465 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4faff5-4456-46e8-b62d-51b9181fc15a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:17.217713 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4faff5-4456-46e8-b62d-51b9181fc15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:17.248238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-7a4faff5-4456-46e8-b62d-51b9181fc15a None None] MFA Rules not processed for user `10c567aa180c4da597f2caf62aae8f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:17.249463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7a4faff5-4456-46e8-b62d-51b9181fc15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:17.323716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1132/2252] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:17.335374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c165b-d105-44fd-9c37-a86aa831faf2 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:17.337244 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2b7c165b-d105-44fd-9c37-a86aa831faf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:17.354450 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:17.399318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c165b-d105-44fd-9c37-a86aa831faf2 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:17.404046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea516165-a617-4e4a-b73f-3ba136697045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:17.404640 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea516165-a617-4e4a-b73f-3ba136697045 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:17.404913 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea516165-a617-4e4a-b73f-3ba136697045 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:17.405181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea516165-a617-4e4a-b73f-3ba136697045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:17.414017 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea516165-a617-4e4a-b73f-3ba136697045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:17.415495 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea516165-a617-4e4a-b73f-3ba136697045 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:17.424625 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1121/2253] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:36:20.061143 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4faff5-4456-46e8-b62d-51b9181fc15a None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:20.126329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4faff5-4456-46e8-b62d-51b9181fc15a None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:20.135010 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:20.135654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:20.135930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:20.136198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] PATH_INFO: `/v3/users/10c567aa180c4da597f2caf62aae8f7d` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:20.137370 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c567aa180c4da597f2caf62aae8f7d)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:20.139672 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:20.152674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:20.196376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c567aa180c4da597f2caf62aae8f7d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:20.197048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c567aa180c4da597f2caf62aae8f7d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:20.207491 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c567aa180c4da597f2caf62aae8f7d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:20.216225 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c567aa180c4da597f2caf62aae8f7d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:20.216850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c567aa180c4da597f2caf62aae8f7d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:20.252273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1133/2254] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:36:20 2022] DELETE /identity/v3/users/10c567aa180c4da597f2caf62aae8f7d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:20.256726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779c48b-c671-49be-8cfb-72e2bce974fd None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:20.257197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779c48b-c671-49be-8cfb-72e2bce974fd None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:20.257303 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779c48b-c671-49be-8cfb-72e2bce974fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:20.276398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-1779c48b-c671-49be-8cfb-72e2bce974fd None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:20.278292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1779c48b-c671-49be-8cfb-72e2bce974fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:20.338349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1122/2255] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:20.348713 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:20.350115 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:20.408325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9fe7f-dc16-40f4-8b9b-663438923b91 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:20.411982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb2628-2570-47df-b9d5-d4a784d0b7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:20.412585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb2628-2570-47df-b9d5-d4a784d0b7bf service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:20.412865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb2628-2570-47df-b9d5-d4a784d0b7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:20.413140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb2628-2570-47df-b9d5-d4a784d0b7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:20.422303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb2628-2570-47df-b9d5-d4a784d0b7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:20.423775 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb2628-2570-47df-b9d5-d4a784d0b7bf service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:20.433282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1134/2256] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:36:20.866851 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779c48b-c671-49be-8cfb-72e2bce974fd None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:20.869178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1779c48b-c671-49be-8cfb-72e2bce974fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:20.888816 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779c48b-c671-49be-8cfb-72e2bce974fd None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:20.894325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db50147-1b9a-4eda-9749-2be5d76aed23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:20.895011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db50147-1b9a-4eda-9749-2be5d76aed23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:20.895945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db50147-1b9a-4eda-9749-2be5d76aed23 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:20.896243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db50147-1b9a-4eda-9749-2be5d76aed23 admin admin] PATH_INFO: `/v3/projects/dc78b622602c451b8baae6faf1201e3f` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:20.897575 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db50147-1b9a-4eda-9749-2be5d76aed23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc78b622602c451b8baae6faf1201e3f)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:20.905227 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db50147-1b9a-4eda-9749-2be5d76aed23 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:20.961484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9db50147-1b9a-4eda-9749-2be5d76aed23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc78b622602c451b8baae6faf1201e3f', 'request_id': 'req-9db50147-1b9a-4eda-9749-2be5d76aed23'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:20.968505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9db50147-1b9a-4eda-9749-2be5d76aed23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc78b622602c451b8baae6faf1201e3f', 'request_id': 'req-9db50147-1b9a-4eda-9749-2be5d76aed23'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:20.976301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9db50147-1b9a-4eda-9749-2be5d76aed23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc78b622602c451b8baae6faf1201e3f', 'request_id': 'req-9db50147-1b9a-4eda-9749-2be5d76aed23'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:20.987844 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9db50147-1b9a-4eda-9749-2be5d76aed23 admin admin] The token cache is being invalidate because project dc78b622602c451b8baae6faf1201e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:36:20.988130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9db50147-1b9a-4eda-9749-2be5d76aed23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:20.988845 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-9db50147-1b9a-4eda-9749-2be5d76aed23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:20.990419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1123/2257] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:36:20 2022] DELETE /identity/v3/projects/dc78b622602c451b8baae6faf1201e3f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:25.272871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d2036-5dc0-4f3c-a5e9-9b5d0cf8e583 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:25.273405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d2036-5dc0-4f3c-a5e9-9b5d0cf8e583 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:25.273405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d2036-5dc0-4f3c-a5e9-9b5d0cf8e583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:25.296171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-839d2036-5dc0-4f3c-a5e9-9b5d0cf8e583 None None] MFA Rules not processed for user `aac0296ec601487ea9090cfb2a2edac1`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:25.297435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-839d2036-5dc0-4f3c-a5e9-9b5d0cf8e583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:25.397475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1135/2258] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:26.222178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13975269-3ddd-4477-9542-0ff1fc5abab0 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:26.223032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13975269-3ddd-4477-9542-0ff1fc5abab0 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:26.223504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13975269-3ddd-4477-9542-0ff1fc5abab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:26.250491 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-13975269-3ddd-4477-9542-0ff1fc5abab0 None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:26.251996 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-13975269-3ddd-4477-9542-0ff1fc5abab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:26.295319 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:26.323478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1124/2259] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:36:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:26.379632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d2036-5dc0-4f3c-a5e9-9b5d0cf8e583 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:26.381889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-839d2036-5dc0-4f3c-a5e9-9b5d0cf8e583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:26.432111 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:26.469527 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d2036-5dc0-4f3c-a5e9-9b5d0cf8e583 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:26.478726 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930d01f-3228-41f4-8fc3-b11d0a79048e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:26.479385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930d01f-3228-41f4-8fc3-b11d0a79048e service swift] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:26.479665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930d01f-3228-41f4-8fc3-b11d0a79048e service swift] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:26.480063 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930d01f-3228-41f4-8fc3-b11d0a79048e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:26.489763 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930d01f-3228-41f4-8fc3-b11d0a79048e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:26.491385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930d01f-3228-41f4-8fc3-b11d0a79048e service swift] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:26.501486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1136/2260] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:36:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:36:27.358628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e1509-5949-4369-88b6-dec9cfa7b14f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:27.359131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e1509-5949-4369-88b6-dec9cfa7b14f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:27.359280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e1509-5949-4369-88b6-dec9cfa7b14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:27.378458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-4a0e1509-5949-4369-88b6-dec9cfa7b14f None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:27.379693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4a0e1509-5949-4369-88b6-dec9cfa7b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:27.389497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1125/2261] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 16 05:36:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:27.404258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930d01f-3228-41f4-8fc3-b11d0a79048e service swift] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:27.415314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930d01f-3228-41f4-8fc3-b11d0a79048e service swift] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:27.420980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c333f-2bd0-4e37-97b7-926aee92a9cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:27.421589 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c333f-2bd0-4e37-97b7-926aee92a9cd service swift] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:27.421853 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c333f-2bd0-4e37-97b7-926aee92a9cd service swift] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:27.422289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c333f-2bd0-4e37-97b7-926aee92a9cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:27.431091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c333f-2bd0-4e37-97b7-926aee92a9cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:27.432665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c333f-2bd0-4e37-97b7-926aee92a9cd service swift] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:27.441405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1137/2262] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:36:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:36:27.693437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07c379-e83d-4290-afc6-e11049c90909 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:27.693906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07c379-e83d-4290-afc6-e11049c90909 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:27.694412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07c379-e83d-4290-afc6-e11049c90909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:27.716317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-dc07c379-e83d-4290-afc6-e11049c90909 None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:27.717542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-dc07c379-e83d-4290-afc6-e11049c90909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:27.724790 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1126/2263] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:36:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:27.736892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c333f-2bd0-4e37-97b7-926aee92a9cd service swift] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:27.747278 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c333f-2bd0-4e37-97b7-926aee92a9cd service swift] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:27.753091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62136a-9bd6-4833-aecd-4eb514fdff9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:27.753921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62136a-9bd6-4833-aecd-4eb514fdff9b service swift] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:27.754208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62136a-9bd6-4833-aecd-4eb514fdff9b service swift] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:27.754483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62136a-9bd6-4833-aecd-4eb514fdff9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:27.764835 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62136a-9bd6-4833-aecd-4eb514fdff9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:27.766343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62136a-9bd6-4833-aecd-4eb514fdff9b service swift] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:27.775282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1138/2264] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:36:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:36:28.232811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffc1f1-3949-470f-a30c-a729e16fcb1b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:28.233435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffc1f1-3949-470f-a30c-a729e16fcb1b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:28.233727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffc1f1-3949-470f-a30c-a729e16fcb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:28.262382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-6dffc1f1-3949-470f-a30c-a729e16fcb1b None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:28.263595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6dffc1f1-3949-470f-a30c-a729e16fcb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:28.275916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1127/2265] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 16 05:36:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:28.290334 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62136a-9bd6-4833-aecd-4eb514fdff9b service swift] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:28.302442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62136a-9bd6-4833-aecd-4eb514fdff9b service swift] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:28.309519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb9a5b-19e7-471f-adb6-003d3fa84992 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:28.310186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb9a5b-19e7-471f-adb6-003d3fa84992 service swift] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:28.310520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb9a5b-19e7-471f-adb6-003d3fa84992 service swift] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:28.310793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb9a5b-19e7-471f-adb6-003d3fa84992 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:28.322825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb9a5b-19e7-471f-adb6-003d3fa84992 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:28.326461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb9a5b-19e7-471f-adb6-003d3fa84992 service swift] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:28.346102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1139/2266] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:36:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:36:30.752455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffc1f1-3949-470f-a30c-a729e16fcb1b None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:30.754893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6dffc1f1-3949-470f-a30c-a729e16fcb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:30.867200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fad313-7202-4feb-87a0-712bfa46dd38 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:30.868868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fad313-7202-4feb-87a0-712bfa46dd38 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:30.869005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffc1f1-3949-470f-a30c-a729e16fcb1b None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:30.869472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fad313-7202-4feb-87a0-712bfa46dd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:30.875387 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:30.875565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:30.876650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:30.876650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] PATH_INFO: `/v3/users/2d7676aec4824294a933e66ef91a999c` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:30.879421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7676aec4824294a933e66ef91a999c)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:30.881431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:30.910106 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-66fad313-7202-4feb-87a0-712bfa46dd38 None None] MFA Rules not processed for user `7079422a25134eaa83102f970cc2b287`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:30.912203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-66fad313-7202-4feb-87a0-712bfa46dd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:30.973158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7676aec4824294a933e66ef91a999c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:30.973972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7676aec4824294a933e66ef91a999c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:30.987389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7676aec4824294a933e66ef91a999c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:30.988057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7676aec4824294a933e66ef91a999c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:31.005338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7676aec4824294a933e66ef91a999c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:31.008517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1140/2267] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:36:31.020672 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1128/2268] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:36:30 2022] DELETE /identity/v3/users/2d7676aec4824294a933e66ef91a999c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:31.025677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c30860-c816-4630-8ab8-f4226da80c8f None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:31.026053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c30860-c816-4630-8ab8-f4226da80c8f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:31.026331 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c30860-c816-4630-8ab8-f4226da80c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:31.047948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f4c30860-c816-4630-8ab8-f4226da80c8f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:31.049171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f4c30860-c816-4630-8ab8-f4226da80c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:31.113701 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1141/2269] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:31.124616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:31.126171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:31.181655 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:31.199516 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab16da-78c5-4a40-a070-2118c3cc15af admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:31.203690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316820e-4f3a-4355-9301-4db630a9df6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:31.204560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316820e-4f3a-4355-9301-4db630a9df6e service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:31.204988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316820e-4f3a-4355-9301-4db630a9df6e service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:31.205849 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316820e-4f3a-4355-9301-4db630a9df6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:31.219025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316820e-4f3a-4355-9301-4db630a9df6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:31.220410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316820e-4f3a-4355-9301-4db630a9df6e service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:31.234414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1129/2270] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:36:31.563613 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c30860-c816-4630-8ab8-f4226da80c8f None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:31.565444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f4c30860-c816-4630-8ab8-f4226da80c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:31.587932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c30860-c816-4630-8ab8-f4226da80c8f None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:31.595460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fe567-7d5c-486b-9918-d33ceb09729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:31.596352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fe567-7d5c-486b-9918-d33ceb09729d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:31.596836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fe567-7d5c-486b-9918-d33ceb09729d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:31.597260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fe567-7d5c-486b-9918-d33ceb09729d admin admin] PATH_INFO: `/v3/projects/4f6099e579ab4d82a7a309f8856c7e63` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:31.598666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fe567-7d5c-486b-9918-d33ceb09729d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6099e579ab4d82a7a309f8856c7e63)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:31.600757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fe567-7d5c-486b-9918-d33ceb09729d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:31.642634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:31.662453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3e5fe567-7d5c-486b-9918-d33ceb09729d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6099e579ab4d82a7a309f8856c7e63', 'request_id': 'req-3e5fe567-7d5c-486b-9918-d33ceb09729d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:31.670225 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3e5fe567-7d5c-486b-9918-d33ceb09729d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6099e579ab4d82a7a309f8856c7e63', 'request_id': 'req-3e5fe567-7d5c-486b-9918-d33ceb09729d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:31.687216 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3e5fe567-7d5c-486b-9918-d33ceb09729d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6099e579ab4d82a7a309f8856c7e63', 'request_id': 'req-3e5fe567-7d5c-486b-9918-d33ceb09729d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:31.703769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3e5fe567-7d5c-486b-9918-d33ceb09729d admin admin] The token cache is being invalidate because project 4f6099e579ab4d82a7a309f8856c7e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:36:31.704358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3e5fe567-7d5c-486b-9918-d33ceb09729d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:31.705402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3e5fe567-7d5c-486b-9918-d33ceb09729d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:31.707538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1142/2271] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:36:31 2022] DELETE /identity/v3/projects/4f6099e579ab4d82a7a309f8856c7e63 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:31.713617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a116d24-9c21-474d-8cfd-ed0b1856b528 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:31.713908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a116d24-9c21-474d-8cfd-ed0b1856b528 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:31.714807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a116d24-9c21-474d-8cfd-ed0b1856b528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:31.764999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-0a116d24-9c21-474d-8cfd-ed0b1856b528 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:31.767075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0a116d24-9c21-474d-8cfd-ed0b1856b528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:31.851803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1130/2272] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:31.859871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411effe-225c-4004-a801-31cfa4e1d8d9 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:31.859871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411effe-225c-4004-a801-31cfa4e1d8d9 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:31.859871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411effe-225c-4004-a801-31cfa4e1d8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:31.887109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-3411effe-225c-4004-a801-31cfa4e1d8d9 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:31.888397 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3411effe-225c-4004-a801-31cfa4e1d8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:31.897441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1143/2273] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:31.901336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a116d24-9c21-474d-8cfd-ed0b1856b528 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:31.916002 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a116d24-9c21-474d-8cfd-ed0b1856b528 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:31.921976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b313f-de2f-49e8-8298-a3065d997a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:31.923616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b313f-de2f-49e8-8298-a3065d997a48 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:31.924090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b313f-de2f-49e8-8298-a3065d997a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:31.924863 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b313f-de2f-49e8-8298-a3065d997a48 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:31.925706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b313f-de2f-49e8-8298-a3065d997a48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:36:31.926938 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b313f-de2f-49e8-8298-a3065d997a48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:31.928714 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b313f-de2f-49e8-8298-a3065d997a48 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:31.943846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1131/2274] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:36:31.947740 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411effe-225c-4004-a801-31cfa4e1d8d9 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:31.961262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411effe-225c-4004-a801-31cfa4e1d8d9 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:31.974417 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485879f0-3a7e-4dda-a7dd-aeda18fc4f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:31.975090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485879f0-3a7e-4dda-a7dd-aeda18fc4f22 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:31.976550 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485879f0-3a7e-4dda-a7dd-aeda18fc4f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:31.977018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485879f0-3a7e-4dda-a7dd-aeda18fc4f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:31.978973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485879f0-3a7e-4dda-a7dd-aeda18fc4f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:31.986224 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485879f0-3a7e-4dda-a7dd-aeda18fc4f22 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:32.061276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1144/2275] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:36:31 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:36:32.065467 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b313f-de2f-49e8-8298-a3065d997a48 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:32.078661 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b313f-de2f-49e8-8298-a3065d997a48 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:32.190157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f091cbd-6421-4e8a-8b80-24a0272b78b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:32.190977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f091cbd-6421-4e8a-8b80-24a0272b78b8 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:32.191321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f091cbd-6421-4e8a-8b80-24a0272b78b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:32.191617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f091cbd-6421-4e8a-8b80-24a0272b78b8 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:32.192268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f091cbd-6421-4e8a-8b80-24a0272b78b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:32.195474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f091cbd-6421-4e8a-8b80-24a0272b78b8 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:32.229557 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1132/2276] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:36:32 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:36:32.234383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485879f0-3a7e-4dda-a7dd-aeda18fc4f22 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:32.275382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485879f0-3a7e-4dda-a7dd-aeda18fc4f22 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:32.287072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ac6dc-1ebf-4742-89ff-dda7e1c7b553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:32.287707 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac6dc-1ebf-4742-89ff-dda7e1c7b553 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:32.290872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac6dc-1ebf-4742-89ff-dda7e1c7b553 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:32.291152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac6dc-1ebf-4742-89ff-dda7e1c7b553 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:32.292128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ac6dc-1ebf-4742-89ff-dda7e1c7b553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:32.295838 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ac6dc-1ebf-4742-89ff-dda7e1c7b553 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:32.326877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1145/2277] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:36:32.328933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f091cbd-6421-4e8a-8b80-24a0272b78b8 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:32.358783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f091cbd-6421-4e8a-8b80-24a0272b78b8 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:32.365215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77272cb1-547a-4f46-9156-22621ba47d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:32.366026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77272cb1-547a-4f46-9156-22621ba47d2a admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:32.366366 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77272cb1-547a-4f46-9156-22621ba47d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:32.366738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77272cb1-547a-4f46-9156-22621ba47d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:32.367505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77272cb1-547a-4f46-9156-22621ba47d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:32.369196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77272cb1-547a-4f46-9156-22621ba47d2a admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:32.382843 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1133/2278] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:36:32.387295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ac6dc-1ebf-4742-89ff-dda7e1c7b553 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:32.398471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ac6dc-1ebf-4742-89ff-dda7e1c7b553 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:32.404730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c788a4a-8b64-4a9c-80ea-daf76c97a772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:32.405467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788a4a-8b64-4a9c-80ea-daf76c97a772 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:32.405847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788a4a-8b64-4a9c-80ea-daf76c97a772 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:32.406394 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788a4a-8b64-4a9c-80ea-daf76c97a772 admin admin] PATH_INFO: `/v3/projects/17b60203eafa4a7ab2ccba419d4a326a/users/f579443c274b438299f1f1d76467b1b8/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:32.426158 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c788a4a-8b64-4a9c-80ea-daf76c97a772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b60203eafa4a7ab2ccba419d4a326a, user_id=f579443c274b438299f1f1d76467b1b8, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:32.429153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c788a4a-8b64-4a9c-80ea-daf76c97a772 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:32.444605 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1146/2279] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:36:32 2022] PUT /identity/v3/projects/17b60203eafa4a7ab2ccba419d4a326a/users/f579443c274b438299f1f1d76467b1b8/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:36:32.460138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9901c13-f6b8-4822-8313-e82298e5f020 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:32.460412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9901c13-f6b8-4822-8313-e82298e5f020 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:32.460708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9901c13-f6b8-4822-8313-e82298e5f020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:32.497558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-e9901c13-f6b8-4822-8313-e82298e5f020 None None] MFA Rules not processed for user `f579443c274b438299f1f1d76467b1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:32.498853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e9901c13-f6b8-4822-8313-e82298e5f020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:32.545900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:32.572528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1134/2280] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:32.583498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c788a4a-8b64-4a9c-80ea-daf76c97a772 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:32.586120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4c788a4a-8b64-4a9c-80ea-daf76c97a772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:32.646406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c788a4a-8b64-4a9c-80ea-daf76c97a772 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:32.651034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2250db4-e1e7-4952-8ce3-25e9709a811d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:32.651697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2250db4-e1e7-4952-8ce3-25e9709a811d service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:32.651980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2250db4-e1e7-4952-8ce3-25e9709a811d service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:32.652254 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2250db4-e1e7-4952-8ce3-25e9709a811d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:32.660786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2250db4-e1e7-4952-8ce3-25e9709a811d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:32.662201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2250db4-e1e7-4952-8ce3-25e9709a811d service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:32.671320 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1147/2281] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:36:36.915334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9901c13-f6b8-4822-8313-e82298e5f020 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:36.918169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e9901c13-f6b8-4822-8313-e82298e5f020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:36.987245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9901c13-f6b8-4822-8313-e82298e5f020 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:36.991798 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:36.992430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:36.992710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:36.992983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] PATH_INFO: `/v3/users/7b74acd70b424baf8b7b53703c58abce` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:36.994110 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b74acd70b424baf8b7b53703c58abce)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:36.996229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:37.040955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b74acd70b424baf8b7b53703c58abce'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:37.041604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b74acd70b424baf8b7b53703c58abce'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:37.048558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b74acd70b424baf8b7b53703c58abce'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:37.049243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b74acd70b424baf8b7b53703c58abce'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:37.061049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b74acd70b424baf8b7b53703c58abce'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:37.073058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1135/2282] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:36:36 2022] DELETE /identity/v3/users/7b74acd70b424baf8b7b53703c58abce => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:36:37.077671 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40f1f7-afa0-444e-8d5d-41ad6549b8c2 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:37.078156 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40f1f7-afa0-444e-8d5d-41ad6549b8c2 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:37.078251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40f1f7-afa0-444e-8d5d-41ad6549b8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:37.097370 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-3e40f1f7-afa0-444e-8d5d-41ad6549b8c2 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:37.098643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3e40f1f7-afa0-444e-8d5d-41ad6549b8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:37.148812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:37.161435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1148/2283] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:37.171754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:37.173071 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:37.240572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5b9d3-ddf7-4dfb-921a-ef8d7c0d5f98 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:37.244430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07347bac-6e68-4799-ab8a-6dba22609b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:37.245194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07347bac-6e68-4799-ab8a-6dba22609b2a service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:37.246214 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07347bac-6e68-4799-ab8a-6dba22609b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:37.246669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07347bac-6e68-4799-ab8a-6dba22609b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:37.261525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07347bac-6e68-4799-ab8a-6dba22609b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:37.263648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07347bac-6e68-4799-ab8a-6dba22609b2a service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:37.277035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1136/2284] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:36:37.760778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40f1f7-afa0-444e-8d5d-41ad6549b8c2 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:37.763884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3e40f1f7-afa0-444e-8d5d-41ad6549b8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:37.780005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40f1f7-afa0-444e-8d5d-41ad6549b8c2 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:37.785154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:37.786044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:37.786263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:37.786647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7 admin admin] PATH_INFO: `/v3/projects/654fad8853fb49af873c00b81dbc710f` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:37.787757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=654fad8853fb49af873c00b81dbc710f)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:37.789685 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:37.855984 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654fad8853fb49af873c00b81dbc710f', 'request_id': 'req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:37.862921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654fad8853fb49af873c00b81dbc710f', 'request_id': 'req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:37.873230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654fad8853fb49af873c00b81dbc710f', 'request_id': 'req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:37.885532 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7 admin admin] The token cache is being invalidate because project 654fad8853fb49af873c00b81dbc710f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:36:37.886485 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:37.887173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fcecb517-90c5-492c-aa9d-5fb0dc999dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:37.888828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1149/2285] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:36:37 2022] DELETE /identity/v3/projects/654fad8853fb49af873c00b81dbc710f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:37.894968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce931c-985f-4275-a139-3c12ffa2ca29 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:37.894968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce931c-985f-4275-a139-3c12ffa2ca29 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:37.894968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce931c-985f-4275-a139-3c12ffa2ca29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:37.912699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:37.926388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-e1ce931c-985f-4275-a139-3c12ffa2ca29 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:37.929410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e1ce931c-985f-4275-a139-3c12ffa2ca29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:38.008597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1137/2286] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:36:38.017879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9a740-a0f7-48a9-8246-7344c8f805f9 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:38.018166 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9a740-a0f7-48a9-8246-7344c8f805f9 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:38.018439 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9a740-a0f7-48a9-8246-7344c8f805f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:38.044146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-3ac9a740-a0f7-48a9-8246-7344c8f805f9 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:38.044950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3ac9a740-a0f7-48a9-8246-7344c8f805f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:38.053319 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1150/2287] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:38.057346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce931c-985f-4275-a139-3c12ffa2ca29 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:38.068163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce931c-985f-4275-a139-3c12ffa2ca29 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:38.072826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428fb33-58d9-4292-8ddd-d181a11cd687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:38.073600 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428fb33-58d9-4292-8ddd-d181a11cd687 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:38.073780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428fb33-58d9-4292-8ddd-d181a11cd687 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:38.074047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428fb33-58d9-4292-8ddd-d181a11cd687 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:38.081898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428fb33-58d9-4292-8ddd-d181a11cd687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:36:38.081898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428fb33-58d9-4292-8ddd-d181a11cd687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:38.081898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428fb33-58d9-4292-8ddd-d181a11cd687 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:38.090679 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1138/2288] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:36:38.094303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9a740-a0f7-48a9-8246-7344c8f805f9 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:38.103578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9a740-a0f7-48a9-8246-7344c8f805f9 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:38.109301 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272ba1d-adad-48f8-8e4e-6219e0a6ba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:38.109900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272ba1d-adad-48f8-8e4e-6219e0a6ba8a admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:38.110184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272ba1d-adad-48f8-8e4e-6219e0a6ba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:38.110457 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272ba1d-adad-48f8-8e4e-6219e0a6ba8a admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:38.111166 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272ba1d-adad-48f8-8e4e-6219e0a6ba8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:38.113125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272ba1d-adad-48f8-8e4e-6219e0a6ba8a admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:38.145959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1151/2289] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:36:38 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:36:38.147249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428fb33-58d9-4292-8ddd-d181a11cd687 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:38.168880 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428fb33-58d9-4292-8ddd-d181a11cd687 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:38.232116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d3680-6ae0-42ab-94c3-ce1b6670ca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:38.232815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d3680-6ae0-42ab-94c3-ce1b6670ca62 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:38.233184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d3680-6ae0-42ab-94c3-ce1b6670ca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:38.233587 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d3680-6ae0-42ab-94c3-ce1b6670ca62 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:38.234367 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d3680-6ae0-42ab-94c3-ce1b6670ca62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:38.236649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d3680-6ae0-42ab-94c3-ce1b6670ca62 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:38.263589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1139/2290] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:36:38 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:36:38.267828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272ba1d-adad-48f8-8e4e-6219e0a6ba8a admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:38.278568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272ba1d-adad-48f8-8e4e-6219e0a6ba8a admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:38.283202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bd0e2-76c4-4f61-86be-cf9797ea33c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:38.283802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bd0e2-76c4-4f61-86be-cf9797ea33c8 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:38.284079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bd0e2-76c4-4f61-86be-cf9797ea33c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:38.284349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bd0e2-76c4-4f61-86be-cf9797ea33c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:38.284989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bd0e2-76c4-4f61-86be-cf9797ea33c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:38.287890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bd0e2-76c4-4f61-86be-cf9797ea33c8 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:38.302930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1152/2291] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:36:38.304180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d3680-6ae0-42ab-94c3-ce1b6670ca62 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:38.314836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d3680-6ae0-42ab-94c3-ce1b6670ca62 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:38.319776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306e1f3-7478-4083-a2b6-c93799824724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:38.320405 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306e1f3-7478-4083-a2b6-c93799824724 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:38.320684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306e1f3-7478-4083-a2b6-c93799824724 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:38.320951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306e1f3-7478-4083-a2b6-c93799824724 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:38.321635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306e1f3-7478-4083-a2b6-c93799824724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:38.323952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306e1f3-7478-4083-a2b6-c93799824724 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:38.336431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1140/2292] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:36:38.341567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bd0e2-76c4-4f61-86be-cf9797ea33c8 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:38.352087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bd0e2-76c4-4f61-86be-cf9797ea33c8 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:38.356913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d89588-85ec-4ae6-8e8e-20bdbda04a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:38.357703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d89588-85ec-4ae6-8e8e-20bdbda04a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:38.357989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d89588-85ec-4ae6-8e8e-20bdbda04a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:38.358264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d89588-85ec-4ae6-8e8e-20bdbda04a2f admin admin] PATH_INFO: `/v3/projects/3dc190fea1254d38a4eb69b2fed5f519/users/a9929893abef4389a5fb8d621ad2d4f2/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:38.373733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d89588-85ec-4ae6-8e8e-20bdbda04a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc190fea1254d38a4eb69b2fed5f519, user_id=a9929893abef4389a5fb8d621ad2d4f2, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:38.376592 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d89588-85ec-4ae6-8e8e-20bdbda04a2f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:38.392999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1153/2293] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:36:38 2022] PUT /identity/v3/projects/3dc190fea1254d38a4eb69b2fed5f519/users/a9929893abef4389a5fb8d621ad2d4f2/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:36:38.403529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e090e8-cb6e-4c0e-8581-63a0d2a175b1 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:38.403812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e090e8-cb6e-4c0e-8581-63a0d2a175b1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:38.404081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e090e8-cb6e-4c0e-8581-63a0d2a175b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:38.437760 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-67e090e8-cb6e-4c0e-8581-63a0d2a175b1 None None] MFA Rules not processed for user `a9929893abef4389a5fb8d621ad2d4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:38.439248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-67e090e8-cb6e-4c0e-8581-63a0d2a175b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:38.514112 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:38.524679 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1141/2294] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:38.540458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d89588-85ec-4ae6-8e8e-20bdbda04a2f admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:38.540458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-40d89588-85ec-4ae6-8e8e-20bdbda04a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:38.632131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d89588-85ec-4ae6-8e8e-20bdbda04a2f admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:38.636423 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8b121-b1db-4b3d-9938-ac79da26bdb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:38.637238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8b121-b1db-4b3d-9938-ac79da26bdb3 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:38.637590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8b121-b1db-4b3d-9938-ac79da26bdb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:38.637930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8b121-b1db-4b3d-9938-ac79da26bdb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:38.648494 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8b121-b1db-4b3d-9938-ac79da26bdb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:38.650172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8b121-b1db-4b3d-9938-ac79da26bdb3 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:38.692476 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1154/2295] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:36:43.085560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e090e8-cb6e-4c0e-8581-63a0d2a175b1 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:43.092178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-67e090e8-cb6e-4c0e-8581-63a0d2a175b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:43.185231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e090e8-cb6e-4c0e-8581-63a0d2a175b1 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:43.190177 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:43.191146 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:43.191920 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:43.191920 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] PATH_INFO: `/v3/users/f579443c274b438299f1f1d76467b1b8` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:43.195397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f579443c274b438299f1f1d76467b1b8)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:43.195397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:43.267182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f579443c274b438299f1f1d76467b1b8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:43.270329 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f579443c274b438299f1f1d76467b1b8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:43.279826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f579443c274b438299f1f1d76467b1b8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:43.280669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f579443c274b438299f1f1d76467b1b8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:43.296568 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f579443c274b438299f1f1d76467b1b8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:43.321826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1142/2296] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:36:43 2022] DELETE /identity/v3/users/f579443c274b438299f1f1d76467b1b8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:43.326192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031563-7e78-4e5b-b5c2-85f30e5aa57d None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:43.326683 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031563-7e78-4e5b-b5c2-85f30e5aa57d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:43.326988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031563-7e78-4e5b-b5c2-85f30e5aa57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:43.353847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-7a031563-7e78-4e5b-b5c2-85f30e5aa57d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:43.355890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7a031563-7e78-4e5b-b5c2-85f30e5aa57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:43.377813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:43.437007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1155/2297] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:43.447081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:43.448520 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:43.507045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5011caa-91f2-4373-82bd-cadc4a1dd047 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:43.510725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7a76f-4091-4eeb-93de-5fffb752b2be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:43.511331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7a76f-4091-4eeb-93de-5fffb752b2be service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:43.511609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7a76f-4091-4eeb-93de-5fffb752b2be service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:43.511878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7a76f-4091-4eeb-93de-5fffb752b2be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:43.520830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7a76f-4091-4eeb-93de-5fffb752b2be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:43.522266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7a76f-4091-4eeb-93de-5fffb752b2be service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:43.531750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1143/2298] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:36:43.922918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031563-7e78-4e5b-b5c2-85f30e5aa57d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:43.925370 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7a031563-7e78-4e5b-b5c2-85f30e5aa57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:43.937562 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031563-7e78-4e5b-b5c2-85f30e5aa57d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:43.965078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:43.965078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:43.965078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:43.965078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] PATH_INFO: `/v3/projects/17b60203eafa4a7ab2ccba419d4a326a` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:43.965594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b60203eafa4a7ab2ccba419d4a326a)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:43.965594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:44.022572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b60203eafa4a7ab2ccba419d4a326a', 'request_id': 'req-9a602b66-38cd-4a91-be5e-9bef130c6060'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:44.032094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b60203eafa4a7ab2ccba419d4a326a', 'request_id': 'req-9a602b66-38cd-4a91-be5e-9bef130c6060'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:44.042607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b60203eafa4a7ab2ccba419d4a326a', 'request_id': 'req-9a602b66-38cd-4a91-be5e-9bef130c6060'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:44.056519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] The token cache is being invalidate because project 17b60203eafa4a7ab2ccba419d4a326a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:36:44.056878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:44.057645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:44.059436 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1156/2299] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:36:43 2022] DELETE /identity/v3/projects/17b60203eafa4a7ab2ccba419d4a326a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:48.625215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cf926-0eb6-4e15-9359-db19a91fcd9e None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:48.626412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cf926-0eb6-4e15-9359-db19a91fcd9e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:48.627065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cf926-0eb6-4e15-9359-db19a91fcd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:48.654930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-756cf926-0eb6-4e15-9359-db19a91fcd9e None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:48.657834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-756cf926-0eb6-4e15-9359-db19a91fcd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:48.695496 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:48.746805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1144/2300] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:36:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:48.759868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:48.761985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:48.834252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a602b66-38cd-4a91-be5e-9bef130c6060 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:48.840010 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bcca1-5982-4cbd-a73b-c29cd923af12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:48.840622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bcca1-5982-4cbd-a73b-c29cd923af12 service swift] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:48.840903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bcca1-5982-4cbd-a73b-c29cd923af12 service swift] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:48.841170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bcca1-5982-4cbd-a73b-c29cd923af12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:48.850777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bcca1-5982-4cbd-a73b-c29cd923af12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:48.852387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bcca1-5982-4cbd-a73b-c29cd923af12 service swift] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:48.860495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1157/2301] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:36:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:36:49.127010 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cf926-0eb6-4e15-9359-db19a91fcd9e None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:49.128825 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-756cf926-0eb6-4e15-9359-db19a91fcd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:49.222605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cf926-0eb6-4e15-9359-db19a91fcd9e None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:49.236243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:49.237084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:49.237517 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:49.237926 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] PATH_INFO: `/v3/users/a9929893abef4389a5fb8d621ad2d4f2` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:49.240180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9929893abef4389a5fb8d621ad2d4f2)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:49.242453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:49.294579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9929893abef4389a5fb8d621ad2d4f2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:49.295299 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9929893abef4389a5fb8d621ad2d4f2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:49.304221 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9929893abef4389a5fb8d621ad2d4f2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:49.305241 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9929893abef4389a5fb8d621ad2d4f2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:49.323806 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9929893abef4389a5fb8d621ad2d4f2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:49.337594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1145/2302] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:36:49 2022] DELETE /identity/v3/users/a9929893abef4389a5fb8d621ad2d4f2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:49.342518 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76381d01-0eec-434c-a7ba-054fae71c6f0 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:49.343060 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76381d01-0eec-434c-a7ba-054fae71c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:49.343333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76381d01-0eec-434c-a7ba-054fae71c6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:49.367601 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-76381d01-0eec-434c-a7ba-054fae71c6f0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:49.369083 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-76381d01-0eec-434c-a7ba-054fae71c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:49.397325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:49.439434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1158/2303] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:36:49.450139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:49.451521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:49.511219 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:49.521333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1329f-9096-43af-837e-e74734170a6e admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:49.536795 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3212a93-d6ca-4904-b75a-28376701c092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:49.537859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3212a93-d6ca-4904-b75a-28376701c092 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:49.538168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3212a93-d6ca-4904-b75a-28376701c092 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:49.538454 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3212a93-d6ca-4904-b75a-28376701c092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:49.552104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3212a93-d6ca-4904-b75a-28376701c092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:49.553866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3212a93-d6ca-4904-b75a-28376701c092 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:49.565925 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1146/2304] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:36:49.967102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76381d01-0eec-434c-a7ba-054fae71c6f0 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:49.969827 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-76381d01-0eec-434c-a7ba-054fae71c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:50.002204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76381d01-0eec-434c-a7ba-054fae71c6f0 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:50.018614 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c06ebe-5233-4281-8613-f45ce4c3fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:50.019847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06ebe-5233-4281-8613-f45ce4c3fcc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:50.021714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06ebe-5233-4281-8613-f45ce4c3fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:50.022328 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06ebe-5233-4281-8613-f45ce4c3fcc9 admin admin] PATH_INFO: `/v3/projects/3dc190fea1254d38a4eb69b2fed5f519` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:50.026950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c06ebe-5233-4281-8613-f45ce4c3fcc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc190fea1254d38a4eb69b2fed5f519)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:50.029386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c06ebe-5233-4281-8613-f45ce4c3fcc9 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:50.174941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-81c06ebe-5233-4281-8613-f45ce4c3fcc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc190fea1254d38a4eb69b2fed5f519', 'request_id': 'req-81c06ebe-5233-4281-8613-f45ce4c3fcc9'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:50.196375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-81c06ebe-5233-4281-8613-f45ce4c3fcc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc190fea1254d38a4eb69b2fed5f519', 'request_id': 'req-81c06ebe-5233-4281-8613-f45ce4c3fcc9'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:50.210170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-81c06ebe-5233-4281-8613-f45ce4c3fcc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc190fea1254d38a4eb69b2fed5f519', 'request_id': 'req-81c06ebe-5233-4281-8613-f45ce4c3fcc9'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:50.228357 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-81c06ebe-5233-4281-8613-f45ce4c3fcc9 admin admin] The token cache is being invalidate because project 3dc190fea1254d38a4eb69b2fed5f519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:36:50.228943 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-81c06ebe-5233-4281-8613-f45ce4c3fcc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:50.229837 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-81c06ebe-5233-4281-8613-f45ce4c3fcc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:36:50.236841 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1159/2305] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:36:49 2022] DELETE /identity/v3/projects/3dc190fea1254d38a4eb69b2fed5f519 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:50.238139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a91628-af0e-4035-9c0b-977eca7c058d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:50.238667 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a91628-af0e-4035-9c0b-977eca7c058d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:50.238757 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a91628-af0e-4035-9c0b-977eca7c058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:50.269258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-04a91628-af0e-4035-9c0b-977eca7c058d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:50.272290 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-04a91628-af0e-4035-9c0b-977eca7c058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:50.396494 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1147/2306] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:50.405609 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0a60c-1f24-476a-9955-8f28fe3a212b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:50.405904 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0a60c-1f24-476a-9955-8f28fe3a212b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:50.406178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0a60c-1f24-476a-9955-8f28fe3a212b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:50.440554 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8cd0a60c-1f24-476a-9955-8f28fe3a212b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:50.441810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8cd0a60c-1f24-476a-9955-8f28fe3a212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:50.453708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1160/2307] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:50.455093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a91628-af0e-4035-9c0b-977eca7c058d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:50.468260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a91628-af0e-4035-9c0b-977eca7c058d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:50.474174 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cd90e-ea29-428e-bef8-1456efee5416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:50.474995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cd90e-ea29-428e-bef8-1456efee5416 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:50.476363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cd90e-ea29-428e-bef8-1456efee5416 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:50.476788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cd90e-ea29-428e-bef8-1456efee5416 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:50.477587 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cd90e-ea29-428e-bef8-1456efee5416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:36:50.478031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cd90e-ea29-428e-bef8-1456efee5416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:50.480671 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cd90e-ea29-428e-bef8-1456efee5416 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:50.506544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1148/2308] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:36:50.510844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0a60c-1f24-476a-9955-8f28fe3a212b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:50.520557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0a60c-1f24-476a-9955-8f28fe3a212b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:50.526570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06934b1-5344-4686-9d09-74dca6182d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:50.527202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06934b1-5344-4686-9d09-74dca6182d18 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:50.527481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06934b1-5344-4686-9d09-74dca6182d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:50.527752 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06934b1-5344-4686-9d09-74dca6182d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:50.528375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06934b1-5344-4686-9d09-74dca6182d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:50.530327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06934b1-5344-4686-9d09-74dca6182d18 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:50.560720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1161/2309] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:36:50 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:36:50.564895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cd90e-ea29-428e-bef8-1456efee5416 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:50.575586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cd90e-ea29-428e-bef8-1456efee5416 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:50.644149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a147a-e5a3-4930-a126-05da956afdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:50.645065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a147a-e5a3-4930-a126-05da956afdd5 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:50.645504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a147a-e5a3-4930-a126-05da956afdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:50.645914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a147a-e5a3-4930-a126-05da956afdd5 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:50.646986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a147a-e5a3-4930-a126-05da956afdd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:50.648975 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a147a-e5a3-4930-a126-05da956afdd5 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:50.680644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1149/2310] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:36:50 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:36:50.681668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06934b1-5344-4686-9d09-74dca6182d18 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:50.694478 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06934b1-5344-4686-9d09-74dca6182d18 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:50.703028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55d214-5664-4c3f-a74d-f3e57e40b921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:50.703643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55d214-5664-4c3f-a74d-f3e57e40b921 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:50.703942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55d214-5664-4c3f-a74d-f3e57e40b921 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:50.704188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55d214-5664-4c3f-a74d-f3e57e40b921 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:50.704832 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55d214-5664-4c3f-a74d-f3e57e40b921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:50.708338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55d214-5664-4c3f-a74d-f3e57e40b921 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:50.727304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a147a-e5a3-4930-a126-05da956afdd5 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:50.727509 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1162/2311] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:36:50.739263 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a147a-e5a3-4930-a126-05da956afdd5 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:50.744068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40f94b-d797-4a85-9869-c2f5422dcfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:50.744758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40f94b-d797-4a85-9869-c2f5422dcfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:50.745041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40f94b-d797-4a85-9869-c2f5422dcfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:50.745313 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40f94b-d797-4a85-9869-c2f5422dcfb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:50.745966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40f94b-d797-4a85-9869-c2f5422dcfb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:50.747758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40f94b-d797-4a85-9869-c2f5422dcfb3 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:50.764447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55d214-5664-4c3f-a74d-f3e57e40b921 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:50.770636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1150/2312] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:36:50.778634 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55d214-5664-4c3f-a74d-f3e57e40b921 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:50.784393 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3f61a-4b04-40e7-8512-cf95df1c16fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:50.785337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3f61a-4b04-40e7-8512-cf95df1c16fd admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:50.785821 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3f61a-4b04-40e7-8512-cf95df1c16fd admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:50.786096 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3f61a-4b04-40e7-8512-cf95df1c16fd admin admin] PATH_INFO: `/v3/projects/ca15877a4df44b7396c1a1175f2ff437/users/e9a6fa6a7f4a4e4fbfd711dbf9b73916/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:50.806084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3f61a-4b04-40e7-8512-cf95df1c16fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca15877a4df44b7396c1a1175f2ff437, user_id=e9a6fa6a7f4a4e4fbfd711dbf9b73916, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:50.809907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3f61a-4b04-40e7-8512-cf95df1c16fd admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:50.831024 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1163/2313] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:36:50 2022] PUT /identity/v3/projects/ca15877a4df44b7396c1a1175f2ff437/users/e9a6fa6a7f4a4e4fbfd711dbf9b73916/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:36:50.833349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f62653-e20b-4baa-bec9-2c29c981d489 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:50.833706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f62653-e20b-4baa-bec9-2c29c981d489 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:50.833982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f62653-e20b-4baa-bec9-2c29c981d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:50.862163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-d7f62653-e20b-4baa-bec9-2c29c981d489 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:50.863429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d7f62653-e20b-4baa-bec9-2c29c981d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:50.933145 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:50.948875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1151/2314] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:50.961710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3f61a-4b04-40e7-8512-cf95df1c16fd admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:50.963514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-cba3f61a-4b04-40e7-8512-cf95df1c16fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:51.046873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3f61a-4b04-40e7-8512-cf95df1c16fd admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:51.053910 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e8a75-a07d-416d-bb61-e3d51c704ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:51.054559 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8a75-a07d-416d-bb61-e3d51c704ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:51.054845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8a75-a07d-416d-bb61-e3d51c704ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:51.055115 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8a75-a07d-416d-bb61-e3d51c704ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:51.064037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:51.069224 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e8a75-a07d-416d-bb61-e3d51c704ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:51.071173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e8a75-a07d-416d-bb61-e3d51c704ef2 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:51.091405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1164/2315] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:36:55.627442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea956-b1be-4750-9723-e3c8a1620400 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:55.628394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea956-b1be-4750-9723-e3c8a1620400 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:55.628394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea956-b1be-4750-9723-e3c8a1620400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:55.674323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-69aea956-b1be-4750-9723-e3c8a1620400 None None] MFA Rules not processed for user `946827404b58485daed0fc22a6da379a`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:55.680555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-69aea956-b1be-4750-9723-e3c8a1620400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:55.821187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1152/2316] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:56.519219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19227bd1-be4a-46a7-9cca-4cd4d499ce53 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:56.520114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19227bd1-be4a-46a7-9cca-4cd4d499ce53 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:56.520553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19227bd1-be4a-46a7-9cca-4cd4d499ce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:56.545621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-19227bd1-be4a-46a7-9cca-4cd4d499ce53 None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:56.546933 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-19227bd1-be4a-46a7-9cca-4cd4d499ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:56.621232 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1165/2317] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:36:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:56.653921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aea956-b1be-4750-9723-e3c8a1620400 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:56.655783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-69aea956-b1be-4750-9723-e3c8a1620400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:56.784343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aea956-b1be-4750-9723-e3c8a1620400 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:56.794731 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fc482-f106-42b9-8ea1-a1abe1d237bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:56.795508 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fc482-f106-42b9-8ea1-a1abe1d237bf service swift] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:56.795890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fc482-f106-42b9-8ea1-a1abe1d237bf service swift] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:56.796263 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fc482-f106-42b9-8ea1-a1abe1d237bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:56.808959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fc482-f106-42b9-8ea1-a1abe1d237bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:56.811169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fc482-f106-42b9-8ea1-a1abe1d237bf service swift] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:56.822206 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1153/2318] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:36:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:36:58.393657 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09c6bb-b62e-47f3-8aa5-c379defcd1d2 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:58.394262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09c6bb-b62e-47f3-8aa5-c379defcd1d2 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:58.394262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09c6bb-b62e-47f3-8aa5-c379defcd1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:58.438188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-4e09c6bb-b62e-47f3-8aa5-c379defcd1d2 None None] MFA Rules not processed for user `e9a6fa6a7f4a4e4fbfd711dbf9b73916`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:36:58.440561 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4e09c6bb-b62e-47f3-8aa5-c379defcd1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:36:58.633608 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1166/2319] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:36:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:36:58.634991 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fc482-f106-42b9-8ea1-a1abe1d237bf service swift] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:58.650301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fc482-f106-42b9-8ea1-a1abe1d237bf service swift] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:58.665251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9224c21-1350-47d7-a4db-fb50a8442ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:58.665877 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9224c21-1350-47d7-a4db-fb50a8442ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:58.669302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9224c21-1350-47d7-a4db-fb50a8442ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:58.669594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9224c21-1350-47d7-a4db-fb50a8442ef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:58.671660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9224c21-1350-47d7-a4db-fb50a8442ef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:58.686343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9224c21-1350-47d7-a4db-fb50a8442ef9 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:58.769825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09c6bb-b62e-47f3-8aa5-c379defcd1d2 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:58.778608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1154/2320] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:36:58 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:36:58.784177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09c6bb-b62e-47f3-8aa5-c379defcd1d2 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:59.040797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee626b-1875-4f39-8e80-31841179e3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:59.042091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee626b-1875-4f39-8e80-31841179e3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:59.042470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee626b-1875-4f39-8e80-31841179e3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:59.042860 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee626b-1875-4f39-8e80-31841179e3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:59.043870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee626b-1875-4f39-8e80-31841179e3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:59.047143 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee626b-1875-4f39-8e80-31841179e3e8 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:59.131412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9224c21-1350-47d7-a4db-fb50a8442ef9 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:59.136538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1167/2321] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:36:58 2022] POST /identity/v3/users => generated 293 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:36:59.143988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9224c21-1350-47d7-a4db-fb50a8442ef9 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:59.149857 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16bf6c-c5b3-454d-bc65-8e03d8811f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:59.150888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16bf6c-c5b3-454d-bc65-8e03d8811f74 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:59.151400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16bf6c-c5b3-454d-bc65-8e03d8811f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:59.151882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16bf6c-c5b3-454d-bc65-8e03d8811f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:59.153733 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16bf6c-c5b3-454d-bc65-8e03d8811f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:59.155770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16bf6c-c5b3-454d-bc65-8e03d8811f74 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:59.207488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee626b-1875-4f39-8e80-31841179e3e8 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:59.218200 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1155/2322] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:36:59.227605 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee626b-1875-4f39-8e80-31841179e3e8 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:59.242864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a1cd6-71f6-470b-ae82-4055337d36f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:59.244890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a1cd6-71f6-470b-ae82-4055337d36f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:59.245190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a1cd6-71f6-470b-ae82-4055337d36f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:59.245464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a1cd6-71f6-470b-ae82-4055337d36f9 admin admin] PATH_INFO: `/v3/projects/761b1cd067854460a1b63cb94cdfb1a3/users/3d58b51e9e6946eb95c6c943e75d412b/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:59.299033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a1cd6-71f6-470b-ae82-4055337d36f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761b1cd067854460a1b63cb94cdfb1a3, user_id=3d58b51e9e6946eb95c6c943e75d412b, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:59.301881 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a1cd6-71f6-470b-ae82-4055337d36f9 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:59.304553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:59.346006 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16bf6c-c5b3-454d-bc65-8e03d8811f74 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:59.352201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1168/2323] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:36:59 2022] PUT /identity/v3/projects/761b1cd067854460a1b63cb94cdfb1a3/users/3d58b51e9e6946eb95c6c943e75d412b/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:36:59.365192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16bf6c-c5b3-454d-bc65-8e03d8811f74 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:59.483485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:36:59.512003 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb4a8d-0748-41a1-9452-b7e496d5b6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:59.512637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb4a8d-0748-41a1-9452-b7e496d5b6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:59.512920 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb4a8d-0748-41a1-9452-b7e496d5b6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:59.513192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb4a8d-0748-41a1-9452-b7e496d5b6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:59.514862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb4a8d-0748-41a1-9452-b7e496d5b6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:59.516329 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb4a8d-0748-41a1-9452-b7e496d5b6c9 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:59.547291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a1cd6-71f6-470b-ae82-4055337d36f9 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:36:59.549709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1156/2324] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:36:59.564025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a1cd6-71f6-470b-ae82-4055337d36f9 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:36:59.573836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb27569-8403-4c2b-b51d-a997f32e7072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:36:59.574962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb27569-8403-4c2b-b51d-a997f32e7072 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:36:59.575416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb27569-8403-4c2b-b51d-a997f32e7072 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:36:59.575857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb27569-8403-4c2b-b51d-a997f32e7072 admin admin] PATH_INFO: `/v3/projects/761b1cd067854460a1b63cb94cdfb1a3/users/3d58b51e9e6946eb95c6c943e75d412b/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:36:59.587639 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb27569-8403-4c2b-b51d-a997f32e7072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761b1cd067854460a1b63cb94cdfb1a3, user_id=3d58b51e9e6946eb95c6c943e75d412b, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:36:59.591195 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb27569-8403-4c2b-b51d-a997f32e7072 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:36:59.613541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1169/2325] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:36:59 2022] PUT /identity/v3/projects/761b1cd067854460a1b63cb94cdfb1a3/users/3d58b51e9e6946eb95c6c943e75d412b/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:37:09.539041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:37:09.609256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:INSERT=2,keystone:SELECT=7 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:37:10.443107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdc264-418c-451f-95d9-b55d56807277 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:10.443414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdc264-418c-451f-95d9-b55d56807277 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:10.443660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdc264-418c-451f-95d9-b55d56807277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:10.498950 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-74fdc264-418c-451f-95d9-b55d56807277 None None] MFA Rules not processed for user `3d58b51e9e6946eb95c6c943e75d412b`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:37:10.500251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-74fdc264-418c-451f-95d9-b55d56807277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:10.644796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1157/2326] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:37:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:37:10.664305 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb27569-8403-4c2b-b51d-a997f32e7072 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:10.666928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8cb27569-8403-4c2b-b51d-a997f32e7072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:10.881870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb27569-8403-4c2b-b51d-a997f32e7072 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:10.904361 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0d099-b8a0-4cf1-b420-604c2beca169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:10.905192 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0d099-b8a0-4cf1-b420-604c2beca169 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:10.905595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0d099-b8a0-4cf1-b420-604c2beca169 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:10.905990 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0d099-b8a0-4cf1-b420-604c2beca169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:10.997314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0d099-b8a0-4cf1-b420-604c2beca169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:11.000447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0d099-b8a0-4cf1-b420-604c2beca169 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:11.032359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1170/2327] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:37:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:37:13.677247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf6196-0206-4e0e-a622-f461fe9918fd None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:13.678129 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf6196-0206-4e0e-a622-f461fe9918fd None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:13.678636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf6196-0206-4e0e-a622-f461fe9918fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:13.705114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-76cf6196-0206-4e0e-a622-f461fe9918fd None None] MFA Rules not processed for user `e9a6fa6a7f4a4e4fbfd711dbf9b73916`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:37:13.708578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-76cf6196-0206-4e0e-a622-f461fe9918fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:13.726169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1158/2328] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:37:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:37:17.577828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c988054-fda9-4f55-a7d6-f0ca30f58b3e None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:17.578338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c988054-fda9-4f55-a7d6-f0ca30f58b3e None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:17.578436 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c988054-fda9-4f55-a7d6-f0ca30f58b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:17.597994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-3c988054-fda9-4f55-a7d6-f0ca30f58b3e None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:37:17.599249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3c988054-fda9-4f55-a7d6-f0ca30f58b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:17.655784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1171/2329] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 16 05:37:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:37:17.668234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf6196-0206-4e0e-a622-f461fe9918fd None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:17.736768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf6196-0206-4e0e-a622-f461fe9918fd None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:17.741943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e2ae7-9a67-4335-988a-3eaa9d31a9fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:17.742585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e2ae7-9a67-4335-988a-3eaa9d31a9fb service swift] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:17.742863 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e2ae7-9a67-4335-988a-3eaa9d31a9fb service swift] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:17.743132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e2ae7-9a67-4335-988a-3eaa9d31a9fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:17.752241 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e2ae7-9a67-4335-988a-3eaa9d31a9fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:17.753835 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e2ae7-9a67-4335-988a-3eaa9d31a9fb service swift] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:17.762689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1159/2330] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:37:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:37:19.767767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c988054-fda9-4f55-a7d6-f0ca30f58b3e None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:19.769930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3c988054-fda9-4f55-a7d6-f0ca30f58b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:19.825809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:37:19.847404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c988054-fda9-4f55-a7d6-f0ca30f58b3e None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:19.852154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7fcce-3d85-48a6-9d20-8b085675fc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:19.852816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7fcce-3d85-48a6-9d20-8b085675fc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:19.853652 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7fcce-3d85-48a6-9d20-8b085675fc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:19.853929 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7fcce-3d85-48a6-9d20-8b085675fc32 admin admin] PATH_INFO: `/v3/users/aac0296ec601487ea9090cfb2a2edac1` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:19.855224 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7fcce-3d85-48a6-9d20-8b085675fc32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac0296ec601487ea9090cfb2a2edac1)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:19.857185 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7fcce-3d85-48a6-9d20-8b085675fc32 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:19.907482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f7f7fcce-3d85-48a6-9d20-8b085675fc32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac0296ec601487ea9090cfb2a2edac1'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:19.908079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f7f7fcce-3d85-48a6-9d20-8b085675fc32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac0296ec601487ea9090cfb2a2edac1'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:19.917181 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f7f7fcce-3d85-48a6-9d20-8b085675fc32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac0296ec601487ea9090cfb2a2edac1'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:19.924409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f7f7fcce-3d85-48a6-9d20-8b085675fc32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac0296ec601487ea9090cfb2a2edac1'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:19.925017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f7f7fcce-3d85-48a6-9d20-8b085675fc32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac0296ec601487ea9090cfb2a2edac1'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:19.943200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1172/2331] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:37:19 2022] DELETE /identity/v3/users/aac0296ec601487ea9090cfb2a2edac1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:37:20.125361 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e2ae7-9a67-4335-988a-3eaa9d31a9fb service swift] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:20.148568 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e2ae7-9a67-4335-988a-3eaa9d31a9fb service swift] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:20.217226 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:20.217995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:20.218429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:20.218837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32 admin admin] PATH_INFO: `/v3/projects/eb8a952e46294c3497db4c8407f13fcb` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:20.220088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb8a952e46294c3497db4c8407f13fcb)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:20.222094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:20.234093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:37:20.280858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8a952e46294c3497db4c8407f13fcb', 'request_id': 'req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:20.287143 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8a952e46294c3497db4c8407f13fcb', 'request_id': 'req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:20.294342 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8a952e46294c3497db4c8407f13fcb', 'request_id': 'req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:20.305864 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32 admin admin] The token cache is being invalidate because project eb8a952e46294c3497db4c8407f13fcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:37:20.306194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:20.306861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1e0d1c77-4f9f-4b2f-ad9c-fe41ace04f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:20.308367 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1160/2332] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:37:20 2022] DELETE /identity/v3/projects/eb8a952e46294c3497db4c8407f13fcb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:37:20.314412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61e25b-f0cd-45e1-8203-a25341ddd7a1 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:20.314726 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61e25b-f0cd-45e1-8203-a25341ddd7a1 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:20.315028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61e25b-f0cd-45e1-8203-a25341ddd7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:20.336201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-cb61e25b-f0cd-45e1-8203-a25341ddd7a1 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:37:20.338084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-cb61e25b-f0cd-45e1-8203-a25341ddd7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:20.403105 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1173/2333] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:37:20.411354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd496ac7-ccac-4835-ba45-4e8c2bd66933 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:20.411640 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd496ac7-ccac-4835-ba45-4e8c2bd66933 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:20.411918 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd496ac7-ccac-4835-ba45-4e8c2bd66933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:20.435917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-fd496ac7-ccac-4835-ba45-4e8c2bd66933 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:37:20.437077 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-fd496ac7-ccac-4835-ba45-4e8c2bd66933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:20.445244 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1161/2334] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:37:20.450284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61e25b-f0cd-45e1-8203-a25341ddd7a1 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:20.462079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61e25b-f0cd-45e1-8203-a25341ddd7a1 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:20.467189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050b6e5-6521-48b3-9d30-29d78f8a84cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:20.467805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050b6e5-6521-48b3-9d30-29d78f8a84cd admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:20.468085 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050b6e5-6521-48b3-9d30-29d78f8a84cd admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:20.468359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050b6e5-6521-48b3-9d30-29d78f8a84cd admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:20.469010 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050b6e5-6521-48b3-9d30-29d78f8a84cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:37:20.469314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050b6e5-6521-48b3-9d30-29d78f8a84cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:20.470995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050b6e5-6521-48b3-9d30-29d78f8a84cd admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:20.483504 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1174/2335] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:37:20.489669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd496ac7-ccac-4835-ba45-4e8c2bd66933 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:20.499664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd496ac7-ccac-4835-ba45-4e8c2bd66933 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:20.504352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329e064-def1-47d6-9f12-84adb1524337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:20.504953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329e064-def1-47d6-9f12-84adb1524337 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:20.505233 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329e064-def1-47d6-9f12-84adb1524337 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:20.505506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329e064-def1-47d6-9f12-84adb1524337 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:20.506137 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329e064-def1-47d6-9f12-84adb1524337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:20.508110 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329e064-def1-47d6-9f12-84adb1524337 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:20.542551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1162/2336] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:37:20 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:37:20.544745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050b6e5-6521-48b3-9d30-29d78f8a84cd admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:20.555815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050b6e5-6521-48b3-9d30-29d78f8a84cd admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:20.602279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:37:20.615905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5f0e5-95d3-4848-908e-90b5912ea3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:20.616484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5f0e5-95d3-4848-908e-90b5912ea3ba admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:20.616767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5f0e5-95d3-4848-908e-90b5912ea3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:20.617038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5f0e5-95d3-4848-908e-90b5912ea3ba admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:20.617674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5f0e5-95d3-4848-908e-90b5912ea3ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:20.620141 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5f0e5-95d3-4848-908e-90b5912ea3ba admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:20.643503 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1175/2337] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:37:20 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:37:20.647561 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329e064-def1-47d6-9f12-84adb1524337 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:20.657719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329e064-def1-47d6-9f12-84adb1524337 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:20.662618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14744e5f-1063-4cab-ad33-6e6cd75613c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:20.663397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14744e5f-1063-4cab-ad33-6e6cd75613c3 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:20.663676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14744e5f-1063-4cab-ad33-6e6cd75613c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:20.664047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14744e5f-1063-4cab-ad33-6e6cd75613c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:20.664715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14744e5f-1063-4cab-ad33-6e6cd75613c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:20.666685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14744e5f-1063-4cab-ad33-6e6cd75613c3 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:20.677517 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1163/2338] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:37:20.682031 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5f0e5-95d3-4848-908e-90b5912ea3ba admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:20.692641 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5f0e5-95d3-4848-908e-90b5912ea3ba admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:20.698032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adea5d-525c-432c-a630-73a87527fe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:20.698670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adea5d-525c-432c-a630-73a87527fe0d admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:20.698949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adea5d-525c-432c-a630-73a87527fe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:20.699214 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adea5d-525c-432c-a630-73a87527fe0d admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:20.699857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adea5d-525c-432c-a630-73a87527fe0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:20.701585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adea5d-525c-432c-a630-73a87527fe0d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:20.713178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1176/2339] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:37:20.717340 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14744e5f-1063-4cab-ad33-6e6cd75613c3 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:20.727415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14744e5f-1063-4cab-ad33-6e6cd75613c3 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:20.732888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08abc9-819d-439f-81a3-2773b38e150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:20.733571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08abc9-819d-439f-81a3-2773b38e150e admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:20.733882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08abc9-819d-439f-81a3-2773b38e150e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:20.734190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08abc9-819d-439f-81a3-2773b38e150e admin admin] PATH_INFO: `/v3/projects/8dbdee3fb4134885ae80ec68de09e7ed/users/a66e803f9b8e4d789487d4b8f10a6ade/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:20.749688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08abc9-819d-439f-81a3-2773b38e150e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbdee3fb4134885ae80ec68de09e7ed, user_id=a66e803f9b8e4d789487d4b8f10a6ade, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:20.752391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08abc9-819d-439f-81a3-2773b38e150e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:20.767380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1164/2340] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:37:20 2022] PUT /identity/v3/projects/8dbdee3fb4134885ae80ec68de09e7ed/users/a66e803f9b8e4d789487d4b8f10a6ade/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:37:20.777732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f21d8-a9f5-4a6c-aba1-967eaa8ae52c None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:20.778153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f21d8-a9f5-4a6c-aba1-967eaa8ae52c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:20.778153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f21d8-a9f5-4a6c-aba1-967eaa8ae52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:20.810643 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-9a4f21d8-a9f5-4a6c-aba1-967eaa8ae52c None None] MFA Rules not processed for user `a66e803f9b8e4d789487d4b8f10a6ade`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:37:20.811861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9a4f21d8-a9f5-4a6c-aba1-967eaa8ae52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:20.897068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1177/2341] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:37:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:37:20.909620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08abc9-819d-439f-81a3-2773b38e150e admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:20.911477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-fd08abc9-819d-439f-81a3-2773b38e150e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:20.995477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08abc9-819d-439f-81a3-2773b38e150e admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:20.999436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff377-fb67-4bf0-ba4a-a899305c5b51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20d8e253a72c44f7a5a986f981660df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:21.000042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff377-fb67-4bf0-ba4a-a899305c5b51 service glance] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:21.000324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff377-fb67-4bf0-ba4a-a899305c5b51 service glance] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:21.000586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff377-fb67-4bf0-ba4a-a899305c5b51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:21.010424 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ff377-fb67-4bf0-ba4a-a899305c5b51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:21.011961 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ff377-fb67-4bf0-ba4a-a899305c5b51 service glance] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:21.022081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1165/2342] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:37:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:37:23.680532 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55138d-4a5a-4b5b-adae-40c18379b02f None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:23.681124 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55138d-4a5a-4b5b-adae-40c18379b02f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:23.681124 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55138d-4a5a-4b5b-adae-40c18379b02f None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:23.682614 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1178/2343] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 05:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:37:23.690599 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30857649-4800-4a88-a771-a037f274891f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:23.691121 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30857649-4800-4a88-a771-a037f274891f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:23.691412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30857649-4800-4a88-a771-a037f274891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:23.713929 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-30857649-4800-4a88-a771-a037f274891f None None] MFA Rules not processed for user `515e548efd984b87bca742e26eec162a`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:37:23.715207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-30857649-4800-4a88-a771-a037f274891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:23.728961 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:37:23.805938 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1166/2344] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 05:37:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:37:30.893460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:37:31.053546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55138d-4a5a-4b5b-adae-40c18379b02f None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:31.055214 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1d55138d-4a5a-4b5b-adae-40c18379b02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:31.071044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55138d-4a5a-4b5b-adae-40c18379b02f None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:31.075310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946f12e-3403-45da-9682-cbdc9fa8dc06 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20d8e253a72c44f7a5a986f981660df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:31.075910 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f12e-3403-45da-9682-cbdc9fa8dc06 service glance] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:31.076189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f12e-3403-45da-9682-cbdc9fa8dc06 service glance] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:31.076458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f12e-3403-45da-9682-cbdc9fa8dc06 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:31.087863 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946f12e-3403-45da-9682-cbdc9fa8dc06 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:31.090981 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946f12e-3403-45da-9682-cbdc9fa8dc06 service glance] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:31.110894 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1179/2345] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:37:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:37:31.187252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46cf0-cc4b-4d6a-9a01-15355721b768 None None] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:31.187855 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46cf0-cc4b-4d6a-9a01-15355721b768 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:31.187855 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46cf0-cc4b-4d6a-9a01-15355721b768 None None] PATH_INFO: `/` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:31.189306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1167/2346] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 05:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:37:31.194938 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bfb81-15fa-4680-8066-806c225de7a7 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:31.195245 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bfb81-15fa-4680-8066-806c225de7a7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:31.195526 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bfb81-15fa-4680-8066-806c225de7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:31.217958 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-e70bfb81-15fa-4680-8066-806c225de7a7 None None] MFA Rules not processed for user `d51f44d06b0f4303a753709bd1bcf3e5`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:37:31.219555 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e70bfb81-15fa-4680-8066-806c225de7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:31.278406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1180/2347] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 05:37:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:37:31.290001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46cf0-cc4b-4d6a-9a01-15355721b768 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:31.291713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-22b46cf0-cc4b-4d6a-9a01-15355721b768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:31.305222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46cf0-cc4b-4d6a-9a01-15355721b768 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:31.309390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa2aee-04ba-48ca-b35d-2a5a6af3745f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:31.309976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa2aee-04ba-48ca-b35d-2a5a6af3745f service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:31.310249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa2aee-04ba-48ca-b35d-2a5a6af3745f service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:31.310541 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa2aee-04ba-48ca-b35d-2a5a6af3745f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:31.317373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa2aee-04ba-48ca-b35d-2a5a6af3745f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:31.318838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa2aee-04ba-48ca-b35d-2a5a6af3745f service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:31.326330 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1168/2348] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:37:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:37:31.410133 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ededdea-c19e-4a45-9e53-53dc2b622ecb None None] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:31.410451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ededdea-c19e-4a45-9e53-53dc2b622ecb None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:31.410765 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ededdea-c19e-4a45-9e53-53dc2b622ecb None None] PATH_INFO: `/` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:31.412206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1181/2349] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 05:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 05:37:31.416885 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1c61-07e1-41fe-8bfd-4824c63599c6 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:31.417170 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1c61-07e1-41fe-8bfd-4824c63599c6 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:31.417442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1c61-07e1-41fe-8bfd-4824c63599c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:31.436760 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-cc8f1c61-07e1-41fe-8bfd-4824c63599c6 None None] MFA Rules not processed for user `515e548efd984b87bca742e26eec162a`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:37:31.437963 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-cc8f1c61-07e1-41fe-8bfd-4824c63599c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:31.447281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1169/2350] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 05:37:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:37:31.458359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ededdea-c19e-4a45-9e53-53dc2b622ecb None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:31.460088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8ededdea-c19e-4a45-9e53-53dc2b622ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:31.473698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ededdea-c19e-4a45-9e53-53dc2b622ecb None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:31.477314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e498b-0864-46a8-9352-7afcdac95d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:31.477898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e498b-0864-46a8-9352-7afcdac95d53 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:31.478177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e498b-0864-46a8-9352-7afcdac95d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:31.478447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e498b-0864-46a8-9352-7afcdac95d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:31.488833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e498b-0864-46a8-9352-7afcdac95d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:31.490321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e498b-0864-46a8-9352-7afcdac95d53 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:31.502272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1182/2351] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:37:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:37:34.716518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefee001-c74c-4ffe-9f15-2d7899dde47f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:34.717003 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefee001-c74c-4ffe-9f15-2d7899dde47f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:34.717085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefee001-c74c-4ffe-9f15-2d7899dde47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:34.737013 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-cefee001-c74c-4ffe-9f15-2d7899dde47f None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:37:34.738222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-cefee001-c74c-4ffe-9f15-2d7899dde47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:34.792883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1170/2352] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:37:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:37:34.814311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e498b-0864-46a8-9352-7afcdac95d53 service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:34.815720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-cd9e498b-0864-46a8-9352-7afcdac95d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:34.883908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e498b-0864-46a8-9352-7afcdac95d53 service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:34.889492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0a4fc-e3ee-4975-91fb-d8fc39f9f8a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:34.890088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0a4fc-e3ee-4975-91fb-d8fc39f9f8a9 service swift] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:34.890370 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0a4fc-e3ee-4975-91fb-d8fc39f9f8a9 service swift] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:34.890677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0a4fc-e3ee-4975-91fb-d8fc39f9f8a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:34.898667 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0a4fc-e3ee-4975-91fb-d8fc39f9f8a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:34.900246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0a4fc-e3ee-4975-91fb-d8fc39f9f8a9 service swift] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:34.908226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1183/2353] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:37:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:37:44.786593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=57 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:37:44.904956 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=67 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:37:49.581628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefee001-c74c-4ffe-9f15-2d7899dde47f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:49.583695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-cefee001-c74c-4ffe-9f15-2d7899dde47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:49.705045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefee001-c74c-4ffe-9f15-2d7899dde47f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:49.715348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fac38-f2f9-4e53-b835-13564ac8e34d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef60b27f5f545aa8ea063009ec66eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:49.716231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fac38-f2f9-4e53-b835-13564ac8e34d service placement] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:49.716676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fac38-f2f9-4e53-b835-13564ac8e34d service placement] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:49.717098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fac38-f2f9-4e53-b835-13564ac8e34d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:49.719251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8e6fac38-f2f9-4e53-b835-13564ac8e34d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:49.735512 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fac38-f2f9-4e53-b835-13564ac8e34d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:49.737389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fac38-f2f9-4e53-b835-13564ac8e34d service placement] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:49.751030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1171/2354] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:37:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:37:51.848190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0a4fc-e3ee-4975-91fb-d8fc39f9f8a9 service swift] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:52.010786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0a4fc-e3ee-4975-91fb-d8fc39f9f8a9 service swift] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:52.016751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:52.017623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:52.018056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:52.018492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] PATH_INFO: `/v3/users/a66e803f9b8e4d789487d4b8f10a6ade` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:52.020443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66e803f9b8e4d789487d4b8f10a6ade)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:52.023597 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:52.085705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66e803f9b8e4d789487d4b8f10a6ade'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:52.086364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66e803f9b8e4d789487d4b8f10a6ade'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:52.097319 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66e803f9b8e4d789487d4b8f10a6ade'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:52.107435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66e803f9b8e4d789487d4b8f10a6ade'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:52.108265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66e803f9b8e4d789487d4b8f10a6ade'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:52.130753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1184/2355] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:37:51 2022] DELETE /identity/v3/users/a66e803f9b8e4d789487d4b8f10a6ade => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:37:52.135082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bf329-b597-48b3-ac62-43b3a9947491 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:52.135652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bf329-b597-48b3-ac62-43b3a9947491 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:52.135977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bf329-b597-48b3-ac62-43b3a9947491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:52.162046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-4e8bf329-b597-48b3-ac62-43b3a9947491 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:37:52.163560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4e8bf329-b597-48b3-ac62-43b3a9947491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:52.236839 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1172/2356] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:37:52.247695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:52.250042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:52.388202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785dad6-cb92-4b31-8b8c-9d516549142f admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:52.397137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b934ae7-d324-49a5-833a-fe210802551a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:52.397858 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b934ae7-d324-49a5-833a-fe210802551a service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:52.399941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b934ae7-d324-49a5-833a-fe210802551a service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:52.400239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b934ae7-d324-49a5-833a-fe210802551a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:52.412206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b934ae7-d324-49a5-833a-fe210802551a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:52.413987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b934ae7-d324-49a5-833a-fe210802551a service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:52.426234 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1185/2357] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:37:52.757217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bf329-b597-48b3-ac62-43b3a9947491 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:52.758703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4e8bf329-b597-48b3-ac62-43b3a9947491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:52.772088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bf329-b597-48b3-ac62-43b3a9947491 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:52.777931 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:52.779075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:52.779513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:52.779971 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] PATH_INFO: `/v3/projects/8dbdee3fb4134885ae80ec68de09e7ed` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:52.781131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dbdee3fb4134885ae80ec68de09e7ed)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:52.783585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:52.840698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dbdee3fb4134885ae80ec68de09e7ed', 'request_id': 'req-1c29db3d-847f-4272-8239-42664faf0778'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:52.847743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dbdee3fb4134885ae80ec68de09e7ed', 'request_id': 'req-1c29db3d-847f-4272-8239-42664faf0778'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:52.858893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dbdee3fb4134885ae80ec68de09e7ed', 'request_id': 'req-1c29db3d-847f-4272-8239-42664faf0778'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:52.885829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] The token cache is being invalidate because project 8dbdee3fb4134885ae80ec68de09e7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:37:52.886396 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:52.892891 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:37:52.895861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1173/2358] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:37:52 2022] DELETE /identity/v3/projects/8dbdee3fb4134885ae80ec68de09e7ed => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:37:54.542110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031b8b7-5cf5-4152-9e22-041d790e62d8 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:54.542587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031b8b7-5cf5-4152-9e22-041d790e62d8 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:54.542691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031b8b7-5cf5-4152-9e22-041d790e62d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:54.563101 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-1031b8b7-5cf5-4152-9e22-041d790e62d8 None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:37:54.564428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1031b8b7-5cf5-4152-9e22-041d790e62d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:54.584670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:37:54.626729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1186/2359] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 16 05:37:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:37:54.640513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:37:54.642051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:37:54.669474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:37:54.733187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29db3d-847f-4272-8239-42664faf0778 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:37:54.738394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6bb24-d6e0-44ad-a503-fdbc386fe1bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:37:54.739342 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6bb24-d6e0-44ad-a503-fdbc386fe1bb service swift] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:37:54.739461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6bb24-d6e0-44ad-a503-fdbc386fe1bb service swift] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:37:54.739713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6bb24-d6e0-44ad-a503-fdbc386fe1bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:37:54.752246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6bb24-d6e0-44ad-a503-fdbc386fe1bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:37:54.753866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6bb24-d6e0-44ad-a503-fdbc386fe1bb service swift] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:37:54.765298 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1174/2360] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:37:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:38:01.896348 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031b8b7-5cf5-4152-9e22-041d790e62d8 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:38:01.898949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1031b8b7-5cf5-4152-9e22-041d790e62d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:38:01.962814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031b8b7-5cf5-4152-9e22-041d790e62d8 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:38:01.967343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40a305-c3ba-478f-867b-98ce3e646737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:38:01.967970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40a305-c3ba-478f-867b-98ce3e646737 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:38:01.968251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40a305-c3ba-478f-867b-98ce3e646737 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:38:01.968523 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40a305-c3ba-478f-867b-98ce3e646737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:38:01.970385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9b40a305-c3ba-478f-867b-98ce3e646737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:38:02.039660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40a305-c3ba-478f-867b-98ce3e646737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:38:02.042357 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40a305-c3ba-478f-867b-98ce3e646737 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:38:02.052133 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1187/2361] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:38:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:38:04.760549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=26 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:38:05.238559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb095cb-a292-4356-ac4f-611a18424c7e None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:38:05.239137 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb095cb-a292-4356-ac4f-611a18424c7e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:38:05.239416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb095cb-a292-4356-ac4f-611a18424c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:38:05.260883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-fdb095cb-a292-4356-ac4f-611a18424c7e None None] MFA Rules not processed for user `7079422a25134eaa83102f970cc2b287`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:38:05.262609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-fdb095cb-a292-4356-ac4f-611a18424c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:38:05.315263 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1175/2362] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:38:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:38:12.047865 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=65 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:38:15.308308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=25 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:38:37.599661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7c3b4-39d1-40ca-882e-67975be63a11 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:38:37.600166 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7c3b4-39d1-40ca-882e-67975be63a11 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:38:37.600283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7c3b4-39d1-40ca-882e-67975be63a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:38:37.620658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-46a7c3b4-39d1-40ca-882e-67975be63a11 None None] MFA Rules not processed for user `946827404b58485daed0fc22a6da379a`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:38:37.621867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-46a7c3b4-39d1-40ca-882e-67975be63a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:38:37.679224 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1188/2363] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:38:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:38:46.382759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a59065-7449-4e8a-acb5-cfc18cb3f872 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:38:46.383267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a59065-7449-4e8a-acb5-cfc18cb3f872 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:38:46.383375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a59065-7449-4e8a-acb5-cfc18cb3f872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:38:46.402634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-a6a59065-7449-4e8a-acb5-cfc18cb3f872 None None] MFA Rules not processed for user `fa478cd622a949d58a2f0eb4bb437368`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:38:46.403865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a6a59065-7449-4e8a-acb5-cfc18cb3f872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:38:46.477069 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1176/2364] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:38:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:38:47.672385 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=25 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:38:56.469504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=25 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:39:08.955732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce089c24-04b1-425e-82ce-6ab65d59b481 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:08.956235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce089c24-04b1-425e-82ce-6ab65d59b481 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:08.956344 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce089c24-04b1-425e-82ce-6ab65d59b481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:08.974721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-ce089c24-04b1-425e-82ce-6ab65d59b481 None None] MFA Rules not processed for user `7079422a25134eaa83102f970cc2b287`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:39:08.975913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ce089c24-04b1-425e-82ce-6ab65d59b481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:08.983182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1189/2365] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:39:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:39:18.969492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:39:38.550686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699da1f-0fdf-4cb8-9aa6-b4c70135625b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:38.551206 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699da1f-0fdf-4cb8-9aa6-b4c70135625b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:38.551206 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699da1f-0fdf-4cb8-9aa6-b4c70135625b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:38.570040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-6699da1f-0fdf-4cb8-9aa6-b4c70135625b None None] MFA Rules not processed for user `7d6f98709d8443bebe278a78499c8b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:39:38.571258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6699da1f-0fdf-4cb8-9aa6-b4c70135625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:38.627686 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1177/2366] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:39:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:39:38.663821 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce089c24-04b1-425e-82ce-6ab65d59b481 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:38.665314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ce089c24-04b1-425e-82ce-6ab65d59b481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:38.722454 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce089c24-04b1-425e-82ce-6ab65d59b481 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:38.726079 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d8a85-83b7-4517-a8eb-96a9ac79fe85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20d8e253a72c44f7a5a986f981660df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:38.726716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d8a85-83b7-4517-a8eb-96a9ac79fe85 service glance] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:38.726995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d8a85-83b7-4517-a8eb-96a9ac79fe85 service glance] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:38.727270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d8a85-83b7-4517-a8eb-96a9ac79fe85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:38.728999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d07d8a85-83b7-4517-a8eb-96a9ac79fe85 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:38.809402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d8a85-83b7-4517-a8eb-96a9ac79fe85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:38.810859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d8a85-83b7-4517-a8eb-96a9ac79fe85 service glance] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:38.821611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1190/2367] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:39:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:39:39.406698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699da1f-0fdf-4cb8-9aa6-b4c70135625b None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:39.408246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6699da1f-0fdf-4cb8-9aa6-b4c70135625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:39.420217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699da1f-0fdf-4cb8-9aa6-b4c70135625b None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:39.423892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f8c8e-9cfd-4311-b193-d726073c7116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:39.424564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f8c8e-9cfd-4311-b193-d726073c7116 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:39.424910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f8c8e-9cfd-4311-b193-d726073c7116 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:39.425249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f8c8e-9cfd-4311-b193-d726073c7116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:39.427011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-501f8c8e-9cfd-4311-b193-d726073c7116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:39.440046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f8c8e-9cfd-4311-b193-d726073c7116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:39.441474 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f8c8e-9cfd-4311-b193-d726073c7116 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:39.453126 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1178/2368] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:39:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:39:42.136375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d8a85-83b7-4517-a8eb-96a9ac79fe85 service glance] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:42.145906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d8a85-83b7-4517-a8eb-96a9ac79fe85 service glance] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:42.149682 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39256bfb-c086-499a-855a-774e53af99dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:42.150389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39256bfb-c086-499a-855a-774e53af99dc service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:42.150821 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39256bfb-c086-499a-855a-774e53af99dc service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:42.151774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39256bfb-c086-499a-855a-774e53af99dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:42.153831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-39256bfb-c086-499a-855a-774e53af99dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:42.238243 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39256bfb-c086-499a-855a-774e53af99dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:42.239925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39256bfb-c086-499a-855a-774e53af99dc service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:42.250405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1191/2369] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:39:45.907672 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f8c8e-9cfd-4311-b193-d726073c7116 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:45.909290 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-501f8c8e-9cfd-4311-b193-d726073c7116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:45.925001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f8c8e-9cfd-4311-b193-d726073c7116 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:45.929524 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63ca89-cd13-458f-a850-bd2b20aef70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:45.930165 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63ca89-cd13-458f-a850-bd2b20aef70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:45.930430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63ca89-cd13-458f-a850-bd2b20aef70d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:45.930734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63ca89-cd13-458f-a850-bd2b20aef70d admin admin] PATH_INFO: `/v3/users/946827404b58485daed0fc22a6da379a` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:45.931870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63ca89-cd13-458f-a850-bd2b20aef70d admin admin] RBAC: Authorizing `identity:delete_user(user_id=946827404b58485daed0fc22a6da379a)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:45.934358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63ca89-cd13-458f-a850-bd2b20aef70d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:45.982609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fc63ca89-cd13-458f-a850-bd2b20aef70d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946827404b58485daed0fc22a6da379a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:45.983334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fc63ca89-cd13-458f-a850-bd2b20aef70d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946827404b58485daed0fc22a6da379a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:45.990882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fc63ca89-cd13-458f-a850-bd2b20aef70d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946827404b58485daed0fc22a6da379a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:45.991675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fc63ca89-cd13-458f-a850-bd2b20aef70d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946827404b58485daed0fc22a6da379a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:46.004193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fc63ca89-cd13-458f-a850-bd2b20aef70d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946827404b58485daed0fc22a6da379a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:46.016635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1179/2370] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:39:45 2022] DELETE /identity/v3/users/946827404b58485daed0fc22a6da379a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:39:46.189042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39256bfb-c086-499a-855a-774e53af99dc service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:46.207744 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39256bfb-c086-499a-855a-774e53af99dc service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:46.260554 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:39:46.289406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1343da5-fcf5-4243-a331-a1ecb42a35d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:46.290442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1343da5-fcf5-4243-a331-a1ecb42a35d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:46.290931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1343da5-fcf5-4243-a331-a1ecb42a35d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:46.291497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1343da5-fcf5-4243-a331-a1ecb42a35d3 admin admin] PATH_INFO: `/v3/projects/16dd41e007f046179da570ff48e6a5d7` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:46.293410 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1343da5-fcf5-4243-a331-a1ecb42a35d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16dd41e007f046179da570ff48e6a5d7)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:46.295441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1343da5-fcf5-4243-a331-a1ecb42a35d3 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:46.352953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c1343da5-fcf5-4243-a331-a1ecb42a35d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16dd41e007f046179da570ff48e6a5d7', 'request_id': 'req-c1343da5-fcf5-4243-a331-a1ecb42a35d3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:46.361568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c1343da5-fcf5-4243-a331-a1ecb42a35d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16dd41e007f046179da570ff48e6a5d7', 'request_id': 'req-c1343da5-fcf5-4243-a331-a1ecb42a35d3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:46.369126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c1343da5-fcf5-4243-a331-a1ecb42a35d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16dd41e007f046179da570ff48e6a5d7', 'request_id': 'req-c1343da5-fcf5-4243-a331-a1ecb42a35d3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:46.383242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c1343da5-fcf5-4243-a331-a1ecb42a35d3 admin admin] The token cache is being invalidate because project 16dd41e007f046179da570ff48e6a5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:39:46.383632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c1343da5-fcf5-4243-a331-a1ecb42a35d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:46.384312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c1343da5-fcf5-4243-a331-a1ecb42a35d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:46.385817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1192/2371] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:39:46 2022] DELETE /identity/v3/projects/16dd41e007f046179da570ff48e6a5d7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:39:46.390895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec93098-929c-4d54-832a-b2c8cdc56727 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:46.391498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec93098-929c-4d54-832a-b2c8cdc56727 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:46.391928 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec93098-929c-4d54-832a-b2c8cdc56727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:46.415456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-8ec93098-929c-4d54-832a-b2c8cdc56727 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:39:46.417469 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8ec93098-929c-4d54-832a-b2c8cdc56727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:46.492403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1180/2372] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:39:46.500157 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d92a-2541-4c04-801b-0946e946a932 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:46.500452 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d92a-2541-4c04-801b-0946e946a932 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:46.500745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d92a-2541-4c04-801b-0946e946a932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:46.522243 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-d081d92a-2541-4c04-801b-0946e946a932 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:39:46.523757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d081d92a-2541-4c04-801b-0946e946a932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:46.535837 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1193/2373] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:39:46.536995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec93098-929c-4d54-832a-b2c8cdc56727 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:46.547005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:39:46.553104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec93098-929c-4d54-832a-b2c8cdc56727 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:46.563404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c2c47-4421-4f31-a789-b0fad1d2e9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:46.564108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c2c47-4421-4f31-a789-b0fad1d2e9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:46.564397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c2c47-4421-4f31-a789-b0fad1d2e9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:46.564674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c2c47-4421-4f31-a789-b0fad1d2e9f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:46.565323 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c2c47-4421-4f31-a789-b0fad1d2e9f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:39:46.565627 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c2c47-4421-4f31-a789-b0fad1d2e9f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:46.567342 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c2c47-4421-4f31-a789-b0fad1d2e9f7 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:46.579953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1181/2374] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:39:46.584408 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081d92a-2541-4c04-801b-0946e946a932 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:46.594417 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081d92a-2541-4c04-801b-0946e946a932 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:46.599949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e90c33-43c8-465d-abd9-6624aee9a190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:46.600577 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e90c33-43c8-465d-abd9-6624aee9a190 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:46.600929 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e90c33-43c8-465d-abd9-6624aee9a190 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:46.601277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e90c33-43c8-465d-abd9-6624aee9a190 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:46.602038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e90c33-43c8-465d-abd9-6624aee9a190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:46.603995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e90c33-43c8-465d-abd9-6624aee9a190 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:46.635867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1194/2375] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:39:46 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:39:46.639962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c2c47-4421-4f31-a789-b0fad1d2e9f7 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:46.651853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c2c47-4421-4f31-a789-b0fad1d2e9f7 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:46.718253 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1846f5-63e0-4de1-8a14-df4dc432070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:46.718980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1846f5-63e0-4de1-8a14-df4dc432070e admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:46.719332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1846f5-63e0-4de1-8a14-df4dc432070e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:46.719673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1846f5-63e0-4de1-8a14-df4dc432070e admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:46.720384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1846f5-63e0-4de1-8a14-df4dc432070e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:46.722394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1846f5-63e0-4de1-8a14-df4dc432070e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:46.747765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1182/2376] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:39:46 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:39:46.752132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e90c33-43c8-465d-abd9-6624aee9a190 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:46.762450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e90c33-43c8-465d-abd9-6624aee9a190 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:46.767190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874731b-35db-4c61-9db5-16a88f362cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:46.767786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874731b-35db-4c61-9db5-16a88f362cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:46.768064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874731b-35db-4c61-9db5-16a88f362cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:46.768333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874731b-35db-4c61-9db5-16a88f362cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:46.768968 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874731b-35db-4c61-9db5-16a88f362cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:46.770570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874731b-35db-4c61-9db5-16a88f362cf5 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:46.783999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1195/2377] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:39:46.785186 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1846f5-63e0-4de1-8a14-df4dc432070e admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:46.796032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1846f5-63e0-4de1-8a14-df4dc432070e admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:46.800956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb8ae7-b36f-4fba-9d7a-4b21fc5d5557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:46.801556 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb8ae7-b36f-4fba-9d7a-4b21fc5d5557 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:46.801836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb8ae7-b36f-4fba-9d7a-4b21fc5d5557 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:46.802105 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb8ae7-b36f-4fba-9d7a-4b21fc5d5557 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:46.802775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb8ae7-b36f-4fba-9d7a-4b21fc5d5557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:46.804377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb8ae7-b36f-4fba-9d7a-4b21fc5d5557 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:46.815644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1183/2378] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:39:46.820004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874731b-35db-4c61-9db5-16a88f362cf5 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:46.831929 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874731b-35db-4c61-9db5-16a88f362cf5 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:46.836558 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c6af-251d-47a4-8c20-ee6be86c23ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:46.837208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c6af-251d-47a4-8c20-ee6be86c23ca admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:46.837489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c6af-251d-47a4-8c20-ee6be86c23ca admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:46.837759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c6af-251d-47a4-8c20-ee6be86c23ca admin admin] PATH_INFO: `/v3/projects/d5fe34c5b5244f019229ee049dbcdc10/users/6e08fc893875409f8bd15b009951608f/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:46.852808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8c6af-251d-47a4-8c20-ee6be86c23ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fe34c5b5244f019229ee049dbcdc10, user_id=6e08fc893875409f8bd15b009951608f, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:46.855517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8c6af-251d-47a4-8c20-ee6be86c23ca admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:46.869021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1196/2379] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:39:46 2022] PUT /identity/v3/projects/d5fe34c5b5244f019229ee049dbcdc10/users/6e08fc893875409f8bd15b009951608f/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:39:46.879204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91f3e6-dcc0-4f9f-82f7-4c6ec7fa2ad9 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:46.879492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91f3e6-dcc0-4f9f-82f7-4c6ec7fa2ad9 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:46.879767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91f3e6-dcc0-4f9f-82f7-4c6ec7fa2ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:46.907858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-cc91f3e6-dcc0-4f9f-82f7-4c6ec7fa2ad9 None None] MFA Rules not processed for user `6e08fc893875409f8bd15b009951608f`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:39:46.909070 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-cc91f3e6-dcc0-4f9f-82f7-4c6ec7fa2ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:46.971846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1184/2380] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:39:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:39:46.982581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c6af-251d-47a4-8c20-ee6be86c23ca admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:46.984249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-add8c6af-251d-47a4-8c20-ee6be86c23ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:47.039816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c6af-251d-47a4-8c20-ee6be86c23ca admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:47.043450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41086b-0bec-4e24-bca3-490eb95c30cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:47.044044 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41086b-0bec-4e24-bca3-490eb95c30cc service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:47.044322 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41086b-0bec-4e24-bca3-490eb95c30cc service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:47.044590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41086b-0bec-4e24-bca3-490eb95c30cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:47.052764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41086b-0bec-4e24-bca3-490eb95c30cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:47.054198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41086b-0bec-4e24-bca3-490eb95c30cc service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:47.063049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1197/2381] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:39:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:39:55.508988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91f3e6-dcc0-4f9f-82f7-4c6ec7fa2ad9 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:55.570052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91f3e6-dcc0-4f9f-82f7-4c6ec7fa2ad9 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:55.575241 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:55.575859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:55.576136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:55.576404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] PATH_INFO: `/v3/users/6e08fc893875409f8bd15b009951608f` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:55.577507 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e08fc893875409f8bd15b009951608f)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:55.579773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:55.581204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:39:55.625932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e08fc893875409f8bd15b009951608f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:55.626608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e08fc893875409f8bd15b009951608f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:55.633515 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e08fc893875409f8bd15b009951608f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:55.634122 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e08fc893875409f8bd15b009951608f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:55.649985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e08fc893875409f8bd15b009951608f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:55.663531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1185/2382] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:39:55 2022] DELETE /identity/v3/users/6e08fc893875409f8bd15b009951608f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:39:55.668074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272126b-9a09-4bc4-b5db-6dcdfc50f0d2 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:55.668530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272126b-9a09-4bc4-b5db-6dcdfc50f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:55.668645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272126b-9a09-4bc4-b5db-6dcdfc50f0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:55.676448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:39:55.689816 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-1272126b-9a09-4bc4-b5db-6dcdfc50f0d2 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:39:55.691075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1272126b-9a09-4bc4-b5db-6dcdfc50f0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:55.748208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1198/2383] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:39:55.757871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:55.759278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:55.824197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0409d7-f599-412a-8ae3-9c6c2405786b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:55.828367 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498d0a7-5c18-4bee-be85-8abb1eb7af19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:55.829017 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498d0a7-5c18-4bee-be85-8abb1eb7af19 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:55.829300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498d0a7-5c18-4bee-be85-8abb1eb7af19 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:55.829831 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498d0a7-5c18-4bee-be85-8abb1eb7af19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:55.843292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498d0a7-5c18-4bee-be85-8abb1eb7af19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:55.845720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498d0a7-5c18-4bee-be85-8abb1eb7af19 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:55.858942 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1186/2384] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:39:56.123740 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272126b-9a09-4bc4-b5db-6dcdfc50f0d2 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:56.125190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1272126b-9a09-4bc4-b5db-6dcdfc50f0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:56.137056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272126b-9a09-4bc4-b5db-6dcdfc50f0d2 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:56.141929 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:56.142586 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:56.142867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:56.143138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3 admin admin] PATH_INFO: `/v3/projects/d5fe34c5b5244f019229ee049dbcdc10` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:56.144255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5fe34c5b5244f019229ee049dbcdc10)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:56.146155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:56.195895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5fe34c5b5244f019229ee049dbcdc10', 'request_id': 'req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:56.201524 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5fe34c5b5244f019229ee049dbcdc10', 'request_id': 'req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:56.210175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5fe34c5b5244f019229ee049dbcdc10', 'request_id': 'req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:56.221952 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3 admin admin] The token cache is being invalidate because project d5fe34c5b5244f019229ee049dbcdc10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:39:56.222323 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:56.223005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-b67b2dad-b055-4ae3-a76d-b7ca361f8ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:56.224490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1199/2385] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:39:56 2022] DELETE /identity/v3/projects/d5fe34c5b5244f019229ee049dbcdc10 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:39:56.230237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f8b61-1a6a-45a9-a2ef-9889583919a0 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:56.230545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f8b61-1a6a-45a9-a2ef-9889583919a0 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:56.230830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f8b61-1a6a-45a9-a2ef-9889583919a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:56.250343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-544f8b61-1a6a-45a9-a2ef-9889583919a0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:39:56.251543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-544f8b61-1a6a-45a9-a2ef-9889583919a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:56.311218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1187/2386] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:39:56.318982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda15af1-210b-4f3a-b224-7c567640f7f7 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:56.319274 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda15af1-210b-4f3a-b224-7c567640f7f7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:56.319545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda15af1-210b-4f3a-b224-7c567640f7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:56.339544 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-dda15af1-210b-4f3a-b224-7c567640f7f7 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:39:56.340731 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-dda15af1-210b-4f3a-b224-7c567640f7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:56.348402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1200/2387] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:39:56.352741 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f8b61-1a6a-45a9-a2ef-9889583919a0 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:56.362916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f8b61-1a6a-45a9-a2ef-9889583919a0 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:56.367529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e881d-f34a-40c3-9f01-10823da5eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:56.368120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e881d-f34a-40c3-9f01-10823da5eeae admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:56.368394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e881d-f34a-40c3-9f01-10823da5eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:56.368660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e881d-f34a-40c3-9f01-10823da5eeae admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:56.369287 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e881d-f34a-40c3-9f01-10823da5eeae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:39:56.369582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e881d-f34a-40c3-9f01-10823da5eeae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:56.371216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e881d-f34a-40c3-9f01-10823da5eeae admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:56.382394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1188/2388] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:39:56.386570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda15af1-210b-4f3a-b224-7c567640f7f7 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:56.395568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda15af1-210b-4f3a-b224-7c567640f7f7 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:56.400196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af22933-e1b4-4d03-bd6f-ceed2f48909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:56.401286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af22933-e1b4-4d03-bd6f-ceed2f48909d admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:56.401563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af22933-e1b4-4d03-bd6f-ceed2f48909d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:56.401833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af22933-e1b4-4d03-bd6f-ceed2f48909d admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:56.402456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af22933-e1b4-4d03-bd6f-ceed2f48909d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:56.404378 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af22933-e1b4-4d03-bd6f-ceed2f48909d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:56.431110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1201/2389] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:39:56 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:39:56.435232 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e881d-f34a-40c3-9f01-10823da5eeae admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:56.444893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e881d-f34a-40c3-9f01-10823da5eeae admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:56.449344 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:39:56.501559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc363cb-260d-48ec-b4d5-c271b9db8ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:56.502081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc363cb-260d-48ec-b4d5-c271b9db8ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:56.502359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc363cb-260d-48ec-b4d5-c271b9db8ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:56.502665 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc363cb-260d-48ec-b4d5-c271b9db8ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:56.503307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc363cb-260d-48ec-b4d5-c271b9db8ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:56.505234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc363cb-260d-48ec-b4d5-c271b9db8ee1 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:56.525475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1189/2390] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:39:56 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:39:56.531953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af22933-e1b4-4d03-bd6f-ceed2f48909d admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:56.542663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af22933-e1b4-4d03-bd6f-ceed2f48909d admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:56.547554 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67209ab2-9476-490c-b0aa-08282bbad47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:56.548155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67209ab2-9476-490c-b0aa-08282bbad47f admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:56.548432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67209ab2-9476-490c-b0aa-08282bbad47f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:56.548756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67209ab2-9476-490c-b0aa-08282bbad47f admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:56.549401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67209ab2-9476-490c-b0aa-08282bbad47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:56.551190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67209ab2-9476-490c-b0aa-08282bbad47f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:56.561336 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1202/2391] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:39:56.566934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc363cb-260d-48ec-b4d5-c271b9db8ee1 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:56.577298 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc363cb-260d-48ec-b4d5-c271b9db8ee1 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:56.582142 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c418e4-b47c-4dc7-b562-dc4d9051f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:56.582771 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c418e4-b47c-4dc7-b562-dc4d9051f71a admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:56.583050 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c418e4-b47c-4dc7-b562-dc4d9051f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:56.583318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c418e4-b47c-4dc7-b562-dc4d9051f71a admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:56.583946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c418e4-b47c-4dc7-b562-dc4d9051f71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:56.585571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c418e4-b47c-4dc7-b562-dc4d9051f71a admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:56.596510 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1190/2392] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:39:56.600538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67209ab2-9476-490c-b0aa-08282bbad47f admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:56.610364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67209ab2-9476-490c-b0aa-08282bbad47f admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:56.615001 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb998505-9307-469d-9231-22c18377e56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:56.615635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb998505-9307-469d-9231-22c18377e56c admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:56.615917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb998505-9307-469d-9231-22c18377e56c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:56.616193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb998505-9307-469d-9231-22c18377e56c admin admin] PATH_INFO: `/v3/projects/07e8013d621840eeb12fc247919f558d/users/e6c0dd3d52d34eca87afa98af1c59c84/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:56.630333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb998505-9307-469d-9231-22c18377e56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e8013d621840eeb12fc247919f558d, user_id=e6c0dd3d52d34eca87afa98af1c59c84, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:56.633010 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb998505-9307-469d-9231-22c18377e56c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:56.646493 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1203/2393] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:39:56 2022] PUT /identity/v3/projects/07e8013d621840eeb12fc247919f558d/users/e6c0dd3d52d34eca87afa98af1c59c84/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:39:56.657423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442209b3-8639-4e78-8e23-5d2957d0a526 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:56.657712 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442209b3-8639-4e78-8e23-5d2957d0a526 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:56.657985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442209b3-8639-4e78-8e23-5d2957d0a526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:56.685351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-442209b3-8639-4e78-8e23-5d2957d0a526 None None] MFA Rules not processed for user `e6c0dd3d52d34eca87afa98af1c59c84`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:39:56.686609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-442209b3-8639-4e78-8e23-5d2957d0a526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:56.748798 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1191/2394] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:39:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:39:56.753424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb998505-9307-469d-9231-22c18377e56c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:56.780903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:39:56.816742 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb998505-9307-469d-9231-22c18377e56c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:56.821481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a954e-78fe-4c56-b915-2a327a098f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:56.822076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a954e-78fe-4c56-b915-2a327a098f82 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:56.822355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a954e-78fe-4c56-b915-2a327a098f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:56.823152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a954e-78fe-4c56-b915-2a327a098f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:56.823784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a954e-78fe-4c56-b915-2a327a098f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:56.825681 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a954e-78fe-4c56-b915-2a327a098f82 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:56.852890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1204/2395] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:39:56 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:39:56.856967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442209b3-8639-4e78-8e23-5d2957d0a526 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:56.867765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442209b3-8639-4e78-8e23-5d2957d0a526 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:56.921955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31ceaf-9254-49e6-bab0-d012fc2bca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:56.922569 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31ceaf-9254-49e6-bab0-d012fc2bca0f admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:56.922846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31ceaf-9254-49e6-bab0-d012fc2bca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:56.923114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31ceaf-9254-49e6-bab0-d012fc2bca0f admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:56.923738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31ceaf-9254-49e6-bab0-d012fc2bca0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:56.925646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31ceaf-9254-49e6-bab0-d012fc2bca0f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:56.945966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1192/2396] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:39:56 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:39:56.955796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a954e-78fe-4c56-b915-2a327a098f82 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:56.967169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a954e-78fe-4c56-b915-2a327a098f82 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:56.971885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652fa02-5165-48be-abb5-e8f8ab1ee42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:56.972485 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652fa02-5165-48be-abb5-e8f8ab1ee42d admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:56.972761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652fa02-5165-48be-abb5-e8f8ab1ee42d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:56.973029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652fa02-5165-48be-abb5-e8f8ab1ee42d admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:56.973664 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652fa02-5165-48be-abb5-e8f8ab1ee42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:56.975263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652fa02-5165-48be-abb5-e8f8ab1ee42d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:56.986584 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1205/2397] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:39:56.990728 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31ceaf-9254-49e6-bab0-d012fc2bca0f admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:57.002144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31ceaf-9254-49e6-bab0-d012fc2bca0f admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:57.006981 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759bc37-1d4f-4c15-a5b7-7c46e12268e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:57.007746 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759bc37-1d4f-4c15-a5b7-7c46e12268e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:57.008142 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759bc37-1d4f-4c15-a5b7-7c46e12268e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:57.008525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759bc37-1d4f-4c15-a5b7-7c46e12268e6 admin admin] PATH_INFO: `/v3/projects/d902b63f2da349dc91746c1a406d0707/users/53dd09f9d2734ca1b96a4d61b208fea4/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:57.011571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:39:57.026528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759bc37-1d4f-4c15-a5b7-7c46e12268e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d902b63f2da349dc91746c1a406d0707, user_id=53dd09f9d2734ca1b96a4d61b208fea4, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:57.029231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759bc37-1d4f-4c15-a5b7-7c46e12268e6 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:57.042687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1193/2398] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:39:56 2022] PUT /identity/v3/projects/d902b63f2da349dc91746c1a406d0707/users/53dd09f9d2734ca1b96a4d61b208fea4/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:39:57.046801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652fa02-5165-48be-abb5-e8f8ab1ee42d admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:57.058994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652fa02-5165-48be-abb5-e8f8ab1ee42d admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:57.117782 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661a384-5e6d-45aa-9772-2eec00fef3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:57.118462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a384-5e6d-45aa-9772-2eec00fef3fb admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:57.118750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a384-5e6d-45aa-9772-2eec00fef3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:57.119052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a384-5e6d-45aa-9772-2eec00fef3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:57.120328 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661a384-5e6d-45aa-9772-2eec00fef3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:57.121979 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661a384-5e6d-45aa-9772-2eec00fef3fb admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:57.132892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1206/2399] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:39:57.137532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759bc37-1d4f-4c15-a5b7-7c46e12268e6 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:57.147900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759bc37-1d4f-4c15-a5b7-7c46e12268e6 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:57.152723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc31463-d8bc-4442-8ccf-c90759e4d8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:57.153371 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc31463-d8bc-4442-8ccf-c90759e4d8b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:57.153651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc31463-d8bc-4442-8ccf-c90759e4d8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:57.153924 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc31463-d8bc-4442-8ccf-c90759e4d8b8 admin admin] PATH_INFO: `/v3/projects/d902b63f2da349dc91746c1a406d0707/users/53dd09f9d2734ca1b96a4d61b208fea4/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:57.155859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc31463-d8bc-4442-8ccf-c90759e4d8b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d902b63f2da349dc91746c1a406d0707, user_id=53dd09f9d2734ca1b96a4d61b208fea4, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:57.158528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc31463-d8bc-4442-8ccf-c90759e4d8b8 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:57.168616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1194/2400] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:39:57 2022] PUT /identity/v3/projects/d902b63f2da349dc91746c1a406d0707/users/53dd09f9d2734ca1b96a4d61b208fea4/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:39:57.179947 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d28a02-2ab3-4d31-bb37-a1edccbb5e3b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:57.180234 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d28a02-2ab3-4d31-bb37-a1edccbb5e3b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:57.180515 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d28a02-2ab3-4d31-bb37-a1edccbb5e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:57.209380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-e5d28a02-2ab3-4d31-bb37-a1edccbb5e3b None None] MFA Rules not processed for user `53dd09f9d2734ca1b96a4d61b208fea4`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:39:57.210610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e5d28a02-2ab3-4d31-bb37-a1edccbb5e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:57.278712 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1207/2401] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:39:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:39:57.289720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc31463-d8bc-4442-8ccf-c90759e4d8b8 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:57.291594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-bcc31463-d8bc-4442-8ccf-c90759e4d8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:57.348478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc31463-d8bc-4442-8ccf-c90759e4d8b8 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:57.352104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64781c2-f86a-4875-bb8f-5dc3b21f808f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:57.352696 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64781c2-f86a-4875-bb8f-5dc3b21f808f service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:57.352970 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64781c2-f86a-4875-bb8f-5dc3b21f808f service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:57.353235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64781c2-f86a-4875-bb8f-5dc3b21f808f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:57.362692 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64781c2-f86a-4875-bb8f-5dc3b21f808f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:57.364119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64781c2-f86a-4875-bb8f-5dc3b21f808f service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:57.373854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1195/2402] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:39:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:39:57.515690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d28a02-2ab3-4d31-bb37-a1edccbb5e3b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:57.517389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e5d28a02-2ab3-4d31-bb37-a1edccbb5e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:57.541704 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:39:57.600746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d28a02-2ab3-4d31-bb37-a1edccbb5e3b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:57.607139 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6f01a-11ab-41c8-b221-493d16afc91f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:57.607751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6f01a-11ab-41c8-b221-493d16afc91f service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:57.608078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6f01a-11ab-41c8-b221-493d16afc91f service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:57.608412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6f01a-11ab-41c8-b221-493d16afc91f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:57.610415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e3e6f01a-11ab-41c8-b221-493d16afc91f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:57.675746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6f01a-11ab-41c8-b221-493d16afc91f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:57.677362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6f01a-11ab-41c8-b221-493d16afc91f service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:57.688008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1208/2403] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:39:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:39:58.780726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64781c2-f86a-4875-bb8f-5dc3b21f808f service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:58.841040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64781c2-f86a-4875-bb8f-5dc3b21f808f service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:58.845692 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:58.846315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:58.846650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:58.846923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] PATH_INFO: `/v3/users/e6c0dd3d52d34eca87afa98af1c59c84` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:58.848063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c0dd3d52d34eca87afa98af1c59c84)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:58.850041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:58.897558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c0dd3d52d34eca87afa98af1c59c84'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:58.898218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c0dd3d52d34eca87afa98af1c59c84'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:58.905485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c0dd3d52d34eca87afa98af1c59c84'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:58.906100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c0dd3d52d34eca87afa98af1c59c84'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:58.918199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c0dd3d52d34eca87afa98af1c59c84'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:58.920125 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:39:58.933037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1196/2404] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:39:58 2022] DELETE /identity/v3/users/e6c0dd3d52d34eca87afa98af1c59c84 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:39:58.937472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae784b6-03ab-4a24-ac09-f9416c70f720 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:58.937939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae784b6-03ab-4a24-ac09-f9416c70f720 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:58.938056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae784b6-03ab-4a24-ac09-f9416c70f720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:58.957252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-5ae784b6-03ab-4a24-ac09-f9416c70f720 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:39:58.958456 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5ae784b6-03ab-4a24-ac09-f9416c70f720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:59.017567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1209/2405] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:39:59.027339 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:59.028751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:59.085907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4de961-cf27-4eaa-8892-3f6213966f34 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:59.089611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667b2f-4f50-40d1-a092-02d0bca94cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:59.090268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667b2f-4f50-40d1-a092-02d0bca94cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:59.090579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667b2f-4f50-40d1-a092-02d0bca94cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:59.090880 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667b2f-4f50-40d1-a092-02d0bca94cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:59.101772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35667b2f-4f50-40d1-a092-02d0bca94cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:59.103240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35667b2f-4f50-40d1-a092-02d0bca94cf6 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:59.113648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1197/2406] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:39:59.344640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae784b6-03ab-4a24-ac09-f9416c70f720 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:59.346541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5ae784b6-03ab-4a24-ac09-f9416c70f720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:59.403853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667b2f-4f50-40d1-a092-02d0bca94cf6 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:59.405357 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-35667b2f-4f50-40d1-a092-02d0bca94cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:59.419437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667b2f-4f50-40d1-a092-02d0bca94cf6 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:59.425512 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:59.426364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:59.426676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:59.426955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] PATH_INFO: `/v3/projects/07e8013d621840eeb12fc247919f558d` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:59.428107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07e8013d621840eeb12fc247919f558d)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:59.430062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:59.456612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:39:59.485731 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae784b6-03ab-4a24-ac09-f9416c70f720 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:59.492577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07e8013d621840eeb12fc247919f558d', 'request_id': 'req-fe771303-f686-4b05-a0f4-56ec4477eb25'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:59.502078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07e8013d621840eeb12fc247919f558d', 'request_id': 'req-fe771303-f686-4b05-a0f4-56ec4477eb25'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:59.512015 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07e8013d621840eeb12fc247919f558d', 'request_id': 'req-fe771303-f686-4b05-a0f4-56ec4477eb25'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:59.526910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] The token cache is being invalidate because project 07e8013d621840eeb12fc247919f558d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:39:59.527202 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:59.528304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:59.530437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1198/2407] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:39:59 2022] DELETE /identity/v3/projects/07e8013d621840eeb12fc247919f558d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:39:59.534811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:59.536296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:59.556877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e58d0-9fd6-4bef-8bc8-1dc891b78e21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:59.557487 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e58d0-9fd6-4bef-8bc8-1dc891b78e21 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:59.557764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e58d0-9fd6-4bef-8bc8-1dc891b78e21 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:59.558040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e58d0-9fd6-4bef-8bc8-1dc891b78e21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:59.559783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ee9e58d0-9fd6-4bef-8bc8-1dc891b78e21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:39:59.605247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe771303-f686-4b05-a0f4-56ec4477eb25 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:39:59.610157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d6508-f600-4a94-87f0-33c7993c8935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:39:59.610814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d6508-f600-4a94-87f0-33c7993c8935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:39:59.611090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d6508-f600-4a94-87f0-33c7993c8935 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:39:59.611354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d6508-f600-4a94-87f0-33c7993c8935 admin admin] PATH_INFO: `/v3/users/53dd09f9d2734ca1b96a4d61b208fea4` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:39:59.612716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d6508-f600-4a94-87f0-33c7993c8935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53dd09f9d2734ca1b96a4d61b208fea4)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:59.614405 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d6508-f600-4a94-87f0-33c7993c8935 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:59.623169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e58d0-9fd6-4bef-8bc8-1dc891b78e21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:39:59.624756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e58d0-9fd6-4bef-8bc8-1dc891b78e21 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:39:59.634689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1210/2408] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:39:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:39:59.638141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:39:59.668607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-cb8d6508-f600-4a94-87f0-33c7993c8935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53dd09f9d2734ca1b96a4d61b208fea4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:59.669261 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-cb8d6508-f600-4a94-87f0-33c7993c8935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53dd09f9d2734ca1b96a4d61b208fea4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:59.676954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-cb8d6508-f600-4a94-87f0-33c7993c8935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53dd09f9d2734ca1b96a4d61b208fea4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:59.677593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-cb8d6508-f600-4a94-87f0-33c7993c8935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53dd09f9d2734ca1b96a4d61b208fea4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:59.690252 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-cb8d6508-f600-4a94-87f0-33c7993c8935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53dd09f9d2734ca1b96a4d61b208fea4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:39:59.705502 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1199/2409] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:39:59 2022] DELETE /identity/v3/users/53dd09f9d2734ca1b96a4d61b208fea4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:39:59.970179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e58d0-9fd6-4bef-8bc8-1dc891b78e21 service nova] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:39:59.980625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e58d0-9fd6-4bef-8bc8-1dc891b78e21 service nova] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:00.037895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f71d26-ebef-4ebb-8f7b-335f5652a960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:00.038535 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f71d26-ebef-4ebb-8f7b-335f5652a960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:00.038828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f71d26-ebef-4ebb-8f7b-335f5652a960 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:00.039100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f71d26-ebef-4ebb-8f7b-335f5652a960 admin admin] PATH_INFO: `/v3/projects/d902b63f2da349dc91746c1a406d0707` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:00.040201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f71d26-ebef-4ebb-8f7b-335f5652a960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d902b63f2da349dc91746c1a406d0707)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:00.042184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f71d26-ebef-4ebb-8f7b-335f5652a960 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:00.079048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:00.089806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-71f71d26-ebef-4ebb-8f7b-335f5652a960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd902b63f2da349dc91746c1a406d0707', 'request_id': 'req-71f71d26-ebef-4ebb-8f7b-335f5652a960'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:00.095219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-71f71d26-ebef-4ebb-8f7b-335f5652a960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd902b63f2da349dc91746c1a406d0707', 'request_id': 'req-71f71d26-ebef-4ebb-8f7b-335f5652a960'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:00.102028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-71f71d26-ebef-4ebb-8f7b-335f5652a960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd902b63f2da349dc91746c1a406d0707', 'request_id': 'req-71f71d26-ebef-4ebb-8f7b-335f5652a960'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:00.112594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-71f71d26-ebef-4ebb-8f7b-335f5652a960 admin admin] The token cache is being invalidate because project d902b63f2da349dc91746c1a406d0707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:40:00.112944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-71f71d26-ebef-4ebb-8f7b-335f5652a960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:00.113568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-71f71d26-ebef-4ebb-8f7b-335f5652a960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:00.115050 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1211/2410] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:39:59 2022] DELETE /identity/v3/projects/d902b63f2da349dc91746c1a406d0707 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:00.120368 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89321-c50e-4575-b078-267e8d8f9e7e None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:00.120824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89321-c50e-4575-b078-267e8d8f9e7e None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:00.120962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89321-c50e-4575-b078-267e8d8f9e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:00.140740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-a4d89321-c50e-4575-b078-267e8d8f9e7e None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:00.141949 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a4d89321-c50e-4575-b078-267e8d8f9e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:00.200058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1200/2411] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:00.208132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e4c6f-7fac-4b8b-80c3-2d65ecba1666 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:00.208418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e4c6f-7fac-4b8b-80c3-2d65ecba1666 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:00.208689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e4c6f-7fac-4b8b-80c3-2d65ecba1666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:00.228442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-630e4c6f-7fac-4b8b-80c3-2d65ecba1666 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:00.229654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-630e4c6f-7fac-4b8b-80c3-2d65ecba1666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:00.237847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1212/2412] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:00.241955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d89321-c50e-4575-b078-267e8d8f9e7e None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:00.252489 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d89321-c50e-4575-b078-267e8d8f9e7e None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:00.257188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20232f89-2e06-4fb1-858a-965897dc2b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:00.257793 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20232f89-2e06-4fb1-858a-965897dc2b19 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:00.258073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20232f89-2e06-4fb1-858a-965897dc2b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:00.258345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20232f89-2e06-4fb1-858a-965897dc2b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:00.259057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20232f89-2e06-4fb1-858a-965897dc2b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:40:00.259359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20232f89-2e06-4fb1-858a-965897dc2b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:00.261623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20232f89-2e06-4fb1-858a-965897dc2b19 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:00.273147 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1201/2413] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:40:00.277579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e4c6f-7fac-4b8b-80c3-2d65ecba1666 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:00.287036 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e4c6f-7fac-4b8b-80c3-2d65ecba1666 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:00.291908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6be2bb-f712-48f2-9969-987730db1eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:00.292510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be2bb-f712-48f2-9969-987730db1eed admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:00.292801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be2bb-f712-48f2-9969-987730db1eed admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:00.293062 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be2bb-f712-48f2-9969-987730db1eed admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:00.293734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6be2bb-f712-48f2-9969-987730db1eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:00.295691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6be2bb-f712-48f2-9969-987730db1eed admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:00.323295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1213/2414] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:40:00 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:00.327332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20232f89-2e06-4fb1-858a-965897dc2b19 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:00.337471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20232f89-2e06-4fb1-858a-965897dc2b19 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:00.392587 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06013492-0de8-4e44-82c1-c0c3d94bec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:00.393302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06013492-0de8-4e44-82c1-c0c3d94bec97 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:00.393588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06013492-0de8-4e44-82c1-c0c3d94bec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:00.393918 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06013492-0de8-4e44-82c1-c0c3d94bec97 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:00.394636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06013492-0de8-4e44-82c1-c0c3d94bec97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:00.396622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06013492-0de8-4e44-82c1-c0c3d94bec97 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:00.418859 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1202/2415] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:40:00 2022] POST /identity/v3/users => generated 280 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:40:00.422961 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6be2bb-f712-48f2-9969-987730db1eed admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:00.433805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6be2bb-f712-48f2-9969-987730db1eed admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:00.438488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a965d-4906-4681-a5e2-852cd7258b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:00.439114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a965d-4906-4681-a5e2-852cd7258b9a admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:00.439393 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a965d-4906-4681-a5e2-852cd7258b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:00.439666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a965d-4906-4681-a5e2-852cd7258b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:00.440309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a965d-4906-4681-a5e2-852cd7258b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:00.441920 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a965d-4906-4681-a5e2-852cd7258b9a admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:00.451890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1214/2416] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:00.456138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06013492-0de8-4e44-82c1-c0c3d94bec97 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:00.466065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06013492-0de8-4e44-82c1-c0c3d94bec97 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:00.470720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213703d-9ea5-4a3d-aef8-0a887c82774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:00.471315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213703d-9ea5-4a3d-aef8-0a887c82774b admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:00.471597 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213703d-9ea5-4a3d-aef8-0a887c82774b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:00.471871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213703d-9ea5-4a3d-aef8-0a887c82774b admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:00.472530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213703d-9ea5-4a3d-aef8-0a887c82774b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:00.474115 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213703d-9ea5-4a3d-aef8-0a887c82774b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:00.485831 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1203/2417] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:00.489919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a965d-4906-4681-a5e2-852cd7258b9a admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:00.500536 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a965d-4906-4681-a5e2-852cd7258b9a admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:00.505381 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ecf91-b322-4c93-965a-52d9c9c9473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:00.506039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ecf91-b322-4c93-965a-52d9c9c9473c admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:00.506323 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ecf91-b322-4c93-965a-52d9c9c9473c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:00.506628 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ecf91-b322-4c93-965a-52d9c9c9473c admin admin] PATH_INFO: `/v3/projects/588ec23daa0540349e1073d86ba5e289/users/c42c33f9b0ed452f9644016a6e833818/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:00.521576 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ecf91-b322-4c93-965a-52d9c9c9473c admin admin] RBAC: Authorizing `identity:create_grant(project_id=588ec23daa0540349e1073d86ba5e289, user_id=c42c33f9b0ed452f9644016a6e833818, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:00.530087 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ecf91-b322-4c93-965a-52d9c9c9473c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:00.544190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1215/2418] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:00 2022] PUT /identity/v3/projects/588ec23daa0540349e1073d86ba5e289/users/c42c33f9b0ed452f9644016a6e833818/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:00.554478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed4788-c848-4799-b1e2-92eeb2a1797f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:00.554789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed4788-c848-4799-b1e2-92eeb2a1797f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:00.555063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed4788-c848-4799-b1e2-92eeb2a1797f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:00.562883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:00.590071 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-e1ed4788-c848-4799-b1e2-92eeb2a1797f None None] MFA Rules not processed for user `c42c33f9b0ed452f9644016a6e833818`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:00.591364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e1ed4788-c848-4799-b1e2-92eeb2a1797f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:00.674238 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1204/2419] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:00.710359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ecf91-b322-4c93-965a-52d9c9c9473c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:00.712113 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-488ecf91-b322-4c93-965a-52d9c9c9473c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:00.773520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ecf91-b322-4c93-965a-52d9c9c9473c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:00.777862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbfaec-10e5-4e6e-af40-1c3c08fbef23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:00.778472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbfaec-10e5-4e6e-af40-1c3c08fbef23 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:00.778789 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbfaec-10e5-4e6e-af40-1c3c08fbef23 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:00.779062 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbfaec-10e5-4e6e-af40-1c3c08fbef23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:00.787655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbfaec-10e5-4e6e-af40-1c3c08fbef23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:00.789075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbfaec-10e5-4e6e-af40-1c3c08fbef23 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:00.798452 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1216/2420] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:00.813685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed4788-c848-4799-b1e2-92eeb2a1797f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:00.889000 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed4788-c848-4799-b1e2-92eeb2a1797f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:00.894241 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:00.895291 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:00.895576 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:00.896121 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] PATH_INFO: `/v3/users/c42c33f9b0ed452f9644016a6e833818` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:00.897455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42c33f9b0ed452f9644016a6e833818)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:00.899580 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:00.953043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42c33f9b0ed452f9644016a6e833818'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:00.953648 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42c33f9b0ed452f9644016a6e833818'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:00.966625 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42c33f9b0ed452f9644016a6e833818'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:00.967477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42c33f9b0ed452f9644016a6e833818'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:00.981653 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42c33f9b0ed452f9644016a6e833818'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:00.995322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1205/2421] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:40:00 2022] DELETE /identity/v3/users/c42c33f9b0ed452f9644016a6e833818 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:01.000120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26261b4-5057-4045-a333-101fa76aa388 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:01.000644 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26261b4-5057-4045-a333-101fa76aa388 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:01.001479 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26261b4-5057-4045-a333-101fa76aa388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:01.027542 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-d26261b4-5057-4045-a333-101fa76aa388 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:01.028919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d26261b4-5057-4045-a333-101fa76aa388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:01.089724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1217/2422] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:01.100532 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:01.102004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:01.116031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:01.162093 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbfd3f-b65a-4377-b4b6-fe8d5574b1d1 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:01.165825 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1983921-8dc6-4ecf-83d5-1063a1e16317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:01.166416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983921-8dc6-4ecf-83d5-1063a1e16317 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:01.166722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983921-8dc6-4ecf-83d5-1063a1e16317 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:01.166992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983921-8dc6-4ecf-83d5-1063a1e16317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:01.175708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1983921-8dc6-4ecf-83d5-1063a1e16317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:01.177138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1983921-8dc6-4ecf-83d5-1063a1e16317 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:01.186392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1206/2423] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:01.449825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26261b4-5057-4045-a333-101fa76aa388 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:01.451310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d26261b4-5057-4045-a333-101fa76aa388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:01.458695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:01.464922 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26261b4-5057-4045-a333-101fa76aa388 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:01.471426 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153410f-a14d-4a72-a478-2ec521d4f78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:01.472086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153410f-a14d-4a72-a478-2ec521d4f78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:01.472414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153410f-a14d-4a72-a478-2ec521d4f78c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:01.472915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153410f-a14d-4a72-a478-2ec521d4f78c admin admin] PATH_INFO: `/v3/projects/588ec23daa0540349e1073d86ba5e289` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:01.474474 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153410f-a14d-4a72-a478-2ec521d4f78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=588ec23daa0540349e1073d86ba5e289)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:01.477090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153410f-a14d-4a72-a478-2ec521d4f78c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:01.523942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2153410f-a14d-4a72-a478-2ec521d4f78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588ec23daa0540349e1073d86ba5e289', 'request_id': 'req-2153410f-a14d-4a72-a478-2ec521d4f78c'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:01.529387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2153410f-a14d-4a72-a478-2ec521d4f78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588ec23daa0540349e1073d86ba5e289', 'request_id': 'req-2153410f-a14d-4a72-a478-2ec521d4f78c'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:01.537050 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2153410f-a14d-4a72-a478-2ec521d4f78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588ec23daa0540349e1073d86ba5e289', 'request_id': 'req-2153410f-a14d-4a72-a478-2ec521d4f78c'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:01.548750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2153410f-a14d-4a72-a478-2ec521d4f78c admin admin] The token cache is being invalidate because project 588ec23daa0540349e1073d86ba5e289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:40:01.549246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2153410f-a14d-4a72-a478-2ec521d4f78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:01.549916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-2153410f-a14d-4a72-a478-2ec521d4f78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:01.551534 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1218/2424] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:40:01 2022] DELETE /identity/v3/projects/588ec23daa0540349e1073d86ba5e289 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:01.556465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fb7ed-2875-415c-8d09-ff0d51d78dd8 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:01.557265 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fb7ed-2875-415c-8d09-ff0d51d78dd8 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:01.557544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fb7ed-2875-415c-8d09-ff0d51d78dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:01.579160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-796fb7ed-2875-415c-8d09-ff0d51d78dd8 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:01.580646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-796fb7ed-2875-415c-8d09-ff0d51d78dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:01.644789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1207/2425] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:01.656471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13b1d-20e7-4ed6-b5db-eafa298dd73d None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:01.656882 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13b1d-20e7-4ed6-b5db-eafa298dd73d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:01.657157 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13b1d-20e7-4ed6-b5db-eafa298dd73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:01.679699 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-83f13b1d-20e7-4ed6-b5db-eafa298dd73d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:01.680923 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-83f13b1d-20e7-4ed6-b5db-eafa298dd73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:01.689187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1219/2426] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:01.693856 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fb7ed-2875-415c-8d09-ff0d51d78dd8 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:01.704278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fb7ed-2875-415c-8d09-ff0d51d78dd8 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:01.710773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b82871-fe50-459b-bb45-ae5593cdced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:01.711391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b82871-fe50-459b-bb45-ae5593cdced1 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:01.711718 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b82871-fe50-459b-bb45-ae5593cdced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:01.711990 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b82871-fe50-459b-bb45-ae5593cdced1 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:01.712637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b82871-fe50-459b-bb45-ae5593cdced1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:40:01.712943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b82871-fe50-459b-bb45-ae5593cdced1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:01.714615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b82871-fe50-459b-bb45-ae5593cdced1 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:01.727212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1208/2427] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:40:01.731527 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f13b1d-20e7-4ed6-b5db-eafa298dd73d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:01.743561 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f13b1d-20e7-4ed6-b5db-eafa298dd73d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:01.749859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07356d5-0928-4260-afd8-4721474c69ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:01.750462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07356d5-0928-4260-afd8-4721474c69ed admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:01.750766 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07356d5-0928-4260-afd8-4721474c69ed admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:01.751033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07356d5-0928-4260-afd8-4721474c69ed admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:01.751672 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07356d5-0928-4260-afd8-4721474c69ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:01.753555 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07356d5-0928-4260-afd8-4721474c69ed admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:01.783130 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1220/2428] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:40:01 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:01.787297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b82871-fe50-459b-bb45-ae5593cdced1 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:01.797556 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b82871-fe50-459b-bb45-ae5593cdced1 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:01.859038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4752c6b-a379-4059-8f04-d55ae7a4a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:01.859728 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4752c6b-a379-4059-8f04-d55ae7a4a871 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:01.860012 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4752c6b-a379-4059-8f04-d55ae7a4a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:01.860286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4752c6b-a379-4059-8f04-d55ae7a4a871 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:01.860932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4752c6b-a379-4059-8f04-d55ae7a4a871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:01.863058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4752c6b-a379-4059-8f04-d55ae7a4a871 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:01.891826 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1209/2429] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:40:01 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:01.895873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07356d5-0928-4260-afd8-4721474c69ed admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:01.906876 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07356d5-0928-4260-afd8-4721474c69ed admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:01.912040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02070a-b8f9-4f3d-8707-745041075314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:01.912725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02070a-b8f9-4f3d-8707-745041075314 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:01.913097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02070a-b8f9-4f3d-8707-745041075314 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:01.913445 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02070a-b8f9-4f3d-8707-745041075314 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:01.914162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02070a-b8f9-4f3d-8707-745041075314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:01.916521 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02070a-b8f9-4f3d-8707-745041075314 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:01.927223 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1221/2430] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:01.931185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4752c6b-a379-4059-8f04-d55ae7a4a871 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:01.942896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4752c6b-a379-4059-8f04-d55ae7a4a871 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:01.949263 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88b78d-2529-4d41-81ff-9d81acb9731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:01.949886 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88b78d-2529-4d41-81ff-9d81acb9731d admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:01.950164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88b78d-2529-4d41-81ff-9d81acb9731d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:01.950543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88b78d-2529-4d41-81ff-9d81acb9731d admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:01.951171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88b78d-2529-4d41-81ff-9d81acb9731d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:01.952919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88b78d-2529-4d41-81ff-9d81acb9731d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:01.969068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1210/2431] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:01.970806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02070a-b8f9-4f3d-8707-745041075314 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:01.983535 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02070a-b8f9-4f3d-8707-745041075314 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:01.989519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cb353-fa99-41cc-a973-53c938e8dae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:01.990399 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cb353-fa99-41cc-a973-53c938e8dae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:01.990843 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cb353-fa99-41cc-a973-53c938e8dae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:01.991206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cb353-fa99-41cc-a973-53c938e8dae4 admin admin] PATH_INFO: `/v3/projects/e01adf45ef824354a7ff3c3268872421/users/edc5c93e7aad472d82bfda769730e775/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:02.011282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4cb353-fa99-41cc-a973-53c938e8dae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01adf45ef824354a7ff3c3268872421, user_id=edc5c93e7aad472d82bfda769730e775, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:02.014058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4cb353-fa99-41cc-a973-53c938e8dae4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:02.037764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1222/2432] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:01 2022] PUT /identity/v3/projects/e01adf45ef824354a7ff3c3268872421/users/edc5c93e7aad472d82bfda769730e775/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:02.039883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502af9a7-e912-4f37-b0cc-45db8f11e7e6 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:02.040330 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502af9a7-e912-4f37-b0cc-45db8f11e7e6 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:02.040609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502af9a7-e912-4f37-b0cc-45db8f11e7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:02.083819 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-502af9a7-e912-4f37-b0cc-45db8f11e7e6 None None] MFA Rules not processed for user `edc5c93e7aad472d82bfda769730e775`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:02.085389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-502af9a7-e912-4f37-b0cc-45db8f11e7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:02.097978 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:02.160189 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1211/2433] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:02.172395 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cb353-fa99-41cc-a973-53c938e8dae4 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:02.174161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8f4cb353-fa99-41cc-a973-53c938e8dae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:02.249477 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cb353-fa99-41cc-a973-53c938e8dae4 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:02.253186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be01e0-5e96-423b-9254-3cb9e981bf4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20d8e253a72c44f7a5a986f981660df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:02.253796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be01e0-5e96-423b-9254-3cb9e981bf4f service glance] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:02.254077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be01e0-5e96-423b-9254-3cb9e981bf4f service glance] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:02.254351 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be01e0-5e96-423b-9254-3cb9e981bf4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:02.262871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be01e0-5e96-423b-9254-3cb9e981bf4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:02.264460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be01e0-5e96-423b-9254-3cb9e981bf4f service glance] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:02.273159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1223/2434] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:05.439954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000dbc7-a298-47d3-a3b4-af18cac04f59 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:05.440440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000dbc7-a298-47d3-a3b4-af18cac04f59 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:05.440526 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000dbc7-a298-47d3-a3b4-af18cac04f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:05.460763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-a000dbc7-a298-47d3-a3b4-af18cac04f59 None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:05.462834 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a000dbc7-a298-47d3-a3b4-af18cac04f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:05.524073 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1212/2435] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:40:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:05.574317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be01e0-5e96-423b-9254-3cb9e981bf4f service glance] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:05.576412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-08be01e0-5e96-423b-9254-3cb9e981bf4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:05.605583 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:05.657318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be01e0-5e96-423b-9254-3cb9e981bf4f service glance] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:05.661187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a76bf0-b892-4950-a1db-e7bec9fd8097 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:05.661864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a76bf0-b892-4950-a1db-e7bec9fd8097 service swift] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:05.662242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a76bf0-b892-4950-a1db-e7bec9fd8097 service swift] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:05.662540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a76bf0-b892-4950-a1db-e7bec9fd8097 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:05.673853 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a76bf0-b892-4950-a1db-e7bec9fd8097 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:05.676215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a76bf0-b892-4950-a1db-e7bec9fd8097 service swift] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:05.686562 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1224/2436] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:40:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:40:13.073995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000dbc7-a298-47d3-a3b4-af18cac04f59 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:13.075646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a000dbc7-a298-47d3-a3b4-af18cac04f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:13.168995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000dbc7-a298-47d3-a3b4-af18cac04f59 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:13.172775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82de8d3-3598-4786-b9c8-c026f6068ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:13.173554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82de8d3-3598-4786-b9c8-c026f6068ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:13.173832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82de8d3-3598-4786-b9c8-c026f6068ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:13.174103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82de8d3-3598-4786-b9c8-c026f6068ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:13.175927 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e82de8d3-3598-4786-b9c8-c026f6068ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:13.250109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82de8d3-3598-4786-b9c8-c026f6068ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:13.251602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82de8d3-3598-4786-b9c8-c026f6068ec5 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:13.262220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1213/2437] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:15.682864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=21 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:16.189309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a76bf0-b892-4950-a1db-e7bec9fd8097 service swift] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:16.200908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a76bf0-b892-4950-a1db-e7bec9fd8097 service swift] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:16.204978 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f24cb-f256-4881-a599-ff3df02be5bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:16.205589 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f24cb-f256-4881-a599-ff3df02be5bb service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:16.205868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f24cb-f256-4881-a599-ff3df02be5bb service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:16.206238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f24cb-f256-4881-a599-ff3df02be5bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:16.209137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1b0f24cb-f256-4881-a599-ff3df02be5bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:16.222746 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f24cb-f256-4881-a599-ff3df02be5bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:16.224225 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f24cb-f256-4881-a599-ff3df02be5bb service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:16.241712 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1225/2438] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:17.296916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82de8d3-3598-4786-b9c8-c026f6068ec5 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:17.299195 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e82de8d3-3598-4786-b9c8-c026f6068ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:17.307104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:17.363479 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f24cb-f256-4881-a599-ff3df02be5bb service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:17.365955 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1b0f24cb-f256-4881-a599-ff3df02be5bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:17.379623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82de8d3-3598-4786-b9c8-c026f6068ec5 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:17.381796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f24cb-f256-4881-a599-ff3df02be5bb service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:17.384670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8e90f-13c7-4625-a84c-07366412addc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef60b27f5f545aa8ea063009ec66eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:17.385343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8e90f-13c7-4625-a84c-07366412addc service placement] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:17.385588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8e90f-13c7-4625-a84c-07366412addc service placement] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:17.385861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8e90f-13c7-4625-a84c-07366412addc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:17.386663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f43429-f50c-4250-811b-8072f0053866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:17.387349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f43429-f50c-4250-811b-8072f0053866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:17.387679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f43429-f50c-4250-811b-8072f0053866 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:17.387781 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2ef8e90f-13c7-4625-a84c-07366412addc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:17.387974 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f43429-f50c-4250-811b-8072f0053866 admin admin] PATH_INFO: `/v3/users/7079422a25134eaa83102f970cc2b287` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:17.389077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f43429-f50c-4250-811b-8072f0053866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7079422a25134eaa83102f970cc2b287)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:17.390987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f43429-f50c-4250-811b-8072f0053866 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:17.401867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8e90f-13c7-4625-a84c-07366412addc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:17.405620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8e90f-13c7-4625-a84c-07366412addc service placement] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:17.417957 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1214/2439] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:17.448602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-64f43429-f50c-4250-811b-8072f0053866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7079422a25134eaa83102f970cc2b287'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:17.449260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-64f43429-f50c-4250-811b-8072f0053866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7079422a25134eaa83102f970cc2b287'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:17.456670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-64f43429-f50c-4250-811b-8072f0053866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7079422a25134eaa83102f970cc2b287'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:17.464521 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-64f43429-f50c-4250-811b-8072f0053866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7079422a25134eaa83102f970cc2b287'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:17.465170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-64f43429-f50c-4250-811b-8072f0053866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7079422a25134eaa83102f970cc2b287'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:17.483183 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1226/2440] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:40:17 2022] DELETE /identity/v3/users/7079422a25134eaa83102f970cc2b287 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:17.647426 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8e90f-13c7-4625-a84c-07366412addc service placement] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:17.662788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8e90f-13c7-4625-a84c-07366412addc service placement] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:17.720937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394ea82-d563-4589-b3fc-2d9e0962b89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:17.721567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394ea82-d563-4589-b3fc-2d9e0962b89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:17.721848 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394ea82-d563-4589-b3fc-2d9e0962b89f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:17.722124 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394ea82-d563-4589-b3fc-2d9e0962b89f admin admin] PATH_INFO: `/v3/projects/67f39dbf6876461cbcaef600569015fe` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:17.723322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394ea82-d563-4589-b3fc-2d9e0962b89f admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f39dbf6876461cbcaef600569015fe)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:17.725273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394ea82-d563-4589-b3fc-2d9e0962b89f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:17.773851 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3394ea82-d563-4589-b3fc-2d9e0962b89f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f39dbf6876461cbcaef600569015fe', 'request_id': 'req-3394ea82-d563-4589-b3fc-2d9e0962b89f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:17.779866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3394ea82-d563-4589-b3fc-2d9e0962b89f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f39dbf6876461cbcaef600569015fe', 'request_id': 'req-3394ea82-d563-4589-b3fc-2d9e0962b89f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:17.787867 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3394ea82-d563-4589-b3fc-2d9e0962b89f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f39dbf6876461cbcaef600569015fe', 'request_id': 'req-3394ea82-d563-4589-b3fc-2d9e0962b89f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:17.798634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3394ea82-d563-4589-b3fc-2d9e0962b89f admin admin] The token cache is being invalidate because project 67f39dbf6876461cbcaef600569015fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:40:17.798922 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3394ea82-d563-4589-b3fc-2d9e0962b89f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:17.799555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-3394ea82-d563-4589-b3fc-2d9e0962b89f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:17.801025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1215/2441] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:40:17 2022] DELETE /identity/v3/projects/67f39dbf6876461cbcaef600569015fe => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:17.805920 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90e046-b069-493a-92ea-6adbd35fc8d0 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:17.806202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90e046-b069-493a-92ea-6adbd35fc8d0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:17.806528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90e046-b069-493a-92ea-6adbd35fc8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:17.826594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-6e90e046-b069-493a-92ea-6adbd35fc8d0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:17.827716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6e90e046-b069-493a-92ea-6adbd35fc8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:17.884374 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1227/2442] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:17.892793 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832f13b-1481-4764-945d-733750fc07f9 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:17.893074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832f13b-1481-4764-945d-733750fc07f9 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:17.893343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832f13b-1481-4764-945d-733750fc07f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:17.913054 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-8832f13b-1481-4764-945d-733750fc07f9 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:17.914279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8832f13b-1481-4764-945d-733750fc07f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:17.922135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1216/2443] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:17.927049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90e046-b069-493a-92ea-6adbd35fc8d0 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:17.937033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90e046-b069-493a-92ea-6adbd35fc8d0 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:17.941596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae3404-1aca-4604-9c34-81394cf38ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:17.942188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae3404-1aca-4604-9c34-81394cf38ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:17.942464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae3404-1aca-4604-9c34-81394cf38ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:17.942766 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae3404-1aca-4604-9c34-81394cf38ef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:17.943397 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae3404-1aca-4604-9c34-81394cf38ef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:40:17.943695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae3404-1aca-4604-9c34-81394cf38ef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:17.945273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae3404-1aca-4604-9c34-81394cf38ef0 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:17.957318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1228/2444] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:40:17.961502 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832f13b-1481-4764-945d-733750fc07f9 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:17.970696 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832f13b-1481-4764-945d-733750fc07f9 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:17.980688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8719fce-4945-4587-9bba-101c0ec5579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:17.981285 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8719fce-4945-4587-9bba-101c0ec5579d admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:17.981563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8719fce-4945-4587-9bba-101c0ec5579d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:17.981827 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8719fce-4945-4587-9bba-101c0ec5579d admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:17.982467 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8719fce-4945-4587-9bba-101c0ec5579d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:17.984389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8719fce-4945-4587-9bba-101c0ec5579d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:18.001163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:18.020768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1217/2445] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:40:17 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:18.024599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae3404-1aca-4604-9c34-81394cf38ef0 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:18.034737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae3404-1aca-4604-9c34-81394cf38ef0 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:18.080693 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:18.100917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff126924-9178-42bd-88df-70ce34b17894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:18.101828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126924-9178-42bd-88df-70ce34b17894 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:18.102218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126924-9178-42bd-88df-70ce34b17894 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:18.102381 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126924-9178-42bd-88df-70ce34b17894 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:18.103059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff126924-9178-42bd-88df-70ce34b17894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:18.105720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff126924-9178-42bd-88df-70ce34b17894 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:18.131566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1229/2446] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:40:18 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:18.136383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8719fce-4945-4587-9bba-101c0ec5579d admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:18.147802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8719fce-4945-4587-9bba-101c0ec5579d admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:18.153346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cc02a-802d-4e10-a6c2-b2c00f5d1777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:18.153885 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cc02a-802d-4e10-a6c2-b2c00f5d1777 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:18.154455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cc02a-802d-4e10-a6c2-b2c00f5d1777 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:18.154768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cc02a-802d-4e10-a6c2-b2c00f5d1777 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:18.155973 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cc02a-802d-4e10-a6c2-b2c00f5d1777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:18.157748 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cc02a-802d-4e10-a6c2-b2c00f5d1777 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:18.168934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1218/2447] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:40:18.172966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff126924-9178-42bd-88df-70ce34b17894 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:18.184027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff126924-9178-42bd-88df-70ce34b17894 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:18.189041 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0aeba-6a31-49cc-95a0-80883a03e361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:18.189642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0aeba-6a31-49cc-95a0-80883a03e361 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:18.189924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0aeba-6a31-49cc-95a0-80883a03e361 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:18.190193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0aeba-6a31-49cc-95a0-80883a03e361 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:18.190872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0aeba-6a31-49cc-95a0-80883a03e361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:18.192449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0aeba-6a31-49cc-95a0-80883a03e361 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:18.210949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1230/2448] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:18.211688 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cc02a-802d-4e10-a6c2-b2c00f5d1777 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:18.228934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cc02a-802d-4e10-a6c2-b2c00f5d1777 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:18.234202 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b625b8-2c1c-45bb-96ec-cf2084ebdca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:18.234416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b625b8-2c1c-45bb-96ec-cf2084ebdca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:18.234707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b625b8-2c1c-45bb-96ec-cf2084ebdca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:18.234985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b625b8-2c1c-45bb-96ec-cf2084ebdca4 admin admin] PATH_INFO: `/v3/projects/08886ec9ef1648fa89f2a5eb3500676e/users/a91b14533d5d4f6fb0305918e7d92b35/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:18.259567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b625b8-2c1c-45bb-96ec-cf2084ebdca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08886ec9ef1648fa89f2a5eb3500676e, user_id=a91b14533d5d4f6fb0305918e7d92b35, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:18.262906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b625b8-2c1c-45bb-96ec-cf2084ebdca4 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:18.278889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1219/2449] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:18 2022] PUT /identity/v3/projects/08886ec9ef1648fa89f2a5eb3500676e/users/a91b14533d5d4f6fb0305918e7d92b35/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:40:18.289578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ab451-6aaf-4a36-892b-784af7edfc5a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:18.289928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ab451-6aaf-4a36-892b-784af7edfc5a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:18.290291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ab451-6aaf-4a36-892b-784af7edfc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:18.347772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-da7ab451-6aaf-4a36-892b-784af7edfc5a None None] MFA Rules not processed for user `a91b14533d5d4f6fb0305918e7d92b35`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:18.349590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-da7ab451-6aaf-4a36-892b-784af7edfc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:18.441633 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1231/2450] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:18.446437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b625b8-2c1c-45bb-96ec-cf2084ebdca4 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:18.509127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b625b8-2c1c-45bb-96ec-cf2084ebdca4 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:18.514478 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a1d6c-d068-43a1-af87-0d3a487a9f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:18.515113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a1d6c-d068-43a1-af87-0d3a487a9f38 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:18.515448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a1d6c-d068-43a1-af87-0d3a487a9f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:18.515849 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a1d6c-d068-43a1-af87-0d3a487a9f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:18.516480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a1d6c-d068-43a1-af87-0d3a487a9f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:18.518389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a1d6c-d068-43a1-af87-0d3a487a9f38 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:18.547355 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1220/2451] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:40:18 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:18.548413 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ab451-6aaf-4a36-892b-784af7edfc5a None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:18.559823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ab451-6aaf-4a36-892b-784af7edfc5a None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:18.614409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07c305-1619-4e3f-ada3-37ef1f13c811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:18.614968 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07c305-1619-4e3f-ada3-37ef1f13c811 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:18.615245 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07c305-1619-4e3f-ada3-37ef1f13c811 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:18.615514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07c305-1619-4e3f-ada3-37ef1f13c811 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:18.616146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07c305-1619-4e3f-ada3-37ef1f13c811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:18.618040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07c305-1619-4e3f-ada3-37ef1f13c811 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:18.639810 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1232/2452] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:40:18 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:40:18.644010 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a1d6c-d068-43a1-af87-0d3a487a9f38 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:18.658630 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a1d6c-d068-43a1-af87-0d3a487a9f38 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:18.663345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8375bd-a8ab-4524-b26c-e8e0987b96e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:18.664076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8375bd-a8ab-4524-b26c-e8e0987b96e4 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:18.664211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8375bd-a8ab-4524-b26c-e8e0987b96e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:18.664505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8375bd-a8ab-4524-b26c-e8e0987b96e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:18.665137 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8375bd-a8ab-4524-b26c-e8e0987b96e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:18.667292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8375bd-a8ab-4524-b26c-e8e0987b96e4 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:18.677893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1221/2453] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:18.683193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07c305-1619-4e3f-ada3-37ef1f13c811 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:18.693039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07c305-1619-4e3f-ada3-37ef1f13c811 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:18.697607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030b6dc-0fca-44e7-ae92-4d34d3b15913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:18.698244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030b6dc-0fca-44e7-ae92-4d34d3b15913 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:18.698550 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030b6dc-0fca-44e7-ae92-4d34d3b15913 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:18.698827 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030b6dc-0fca-44e7-ae92-4d34d3b15913 admin admin] PATH_INFO: `/v3/projects/4a072179ff364e5794e857b0799f291d/users/f2e4f4b5e0574819a490af024fc0ce99/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:18.714584 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030b6dc-0fca-44e7-ae92-4d34d3b15913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a072179ff364e5794e857b0799f291d, user_id=f2e4f4b5e0574819a490af024fc0ce99, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:18.717220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030b6dc-0fca-44e7-ae92-4d34d3b15913 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:18.730312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1233/2454] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:18 2022] PUT /identity/v3/projects/4a072179ff364e5794e857b0799f291d/users/f2e4f4b5e0574819a490af024fc0ce99/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:40:18.734257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8375bd-a8ab-4524-b26c-e8e0987b96e4 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:18.744125 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8375bd-a8ab-4524-b26c-e8e0987b96e4 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:18.798772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a308b8b-3316-4388-8c56-f38425027be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:18.799367 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a308b8b-3316-4388-8c56-f38425027be8 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:18.799642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a308b8b-3316-4388-8c56-f38425027be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:18.799910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a308b8b-3316-4388-8c56-f38425027be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:18.800534 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a308b8b-3316-4388-8c56-f38425027be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:18.802122 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a308b8b-3316-4388-8c56-f38425027be8 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:18.811554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1222/2455] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:18.815973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030b6dc-0fca-44e7-ae92-4d34d3b15913 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:18.827485 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030b6dc-0fca-44e7-ae92-4d34d3b15913 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:18.832324 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76053c-9202-4d26-a35b-0d7d8c248cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:18.832982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76053c-9202-4d26-a35b-0d7d8c248cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:18.833263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76053c-9202-4d26-a35b-0d7d8c248cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:18.833534 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76053c-9202-4d26-a35b-0d7d8c248cd5 admin admin] PATH_INFO: `/v3/projects/4a072179ff364e5794e857b0799f291d/users/f2e4f4b5e0574819a490af024fc0ce99/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:18.836017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76053c-9202-4d26-a35b-0d7d8c248cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a072179ff364e5794e857b0799f291d, user_id=f2e4f4b5e0574819a490af024fc0ce99, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:18.839901 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76053c-9202-4d26-a35b-0d7d8c248cd5 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:18.850088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1234/2456] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:18 2022] PUT /identity/v3/projects/4a072179ff364e5794e857b0799f291d/users/f2e4f4b5e0574819a490af024fc0ce99/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:18.862030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e20f9e-7db4-41f9-9a5f-17fe537b0ccc None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:18.862317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e20f9e-7db4-41f9-9a5f-17fe537b0ccc None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:18.862623 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e20f9e-7db4-41f9-9a5f-17fe537b0ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:18.891405 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-50e20f9e-7db4-41f9-9a5f-17fe537b0ccc None None] MFA Rules not processed for user `f2e4f4b5e0574819a490af024fc0ce99`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:18.892649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-50e20f9e-7db4-41f9-9a5f-17fe537b0ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:18.916049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:18.974630 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1223/2457] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:18.989708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76053c-9202-4d26-a35b-0d7d8c248cd5 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:18.991818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ff76053c-9202-4d26-a35b-0d7d8c248cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:19.002605 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:19.063459 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76053c-9202-4d26-a35b-0d7d8c248cd5 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:19.068435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d82b79-70f8-415e-9a75-f9e3196d9cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:19.069230 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d82b79-70f8-415e-9a75-f9e3196d9cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:19.069563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d82b79-70f8-415e-9a75-f9e3196d9cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:19.069954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d82b79-70f8-415e-9a75-f9e3196d9cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:19.080855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d82b79-70f8-415e-9a75-f9e3196d9cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:19.082473 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d82b79-70f8-415e-9a75-f9e3196d9cb5 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:19.094295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1235/2458] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:19.174087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e20f9e-7db4-41f9-9a5f-17fe537b0ccc None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:19.184151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e20f9e-7db4-41f9-9a5f-17fe537b0ccc None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:19.187860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60d32e-f951-41c5-9749-e086f90648d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:19.188517 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60d32e-f951-41c5-9749-e086f90648d8 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:19.188799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60d32e-f951-41c5-9749-e086f90648d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:19.189071 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60d32e-f951-41c5-9749-e086f90648d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:19.251664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60d32e-f951-41c5-9749-e086f90648d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:19.253103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60d32e-f951-41c5-9749-e086f90648d8 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:19.262567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1224/2459] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:20.865290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d82b79-70f8-415e-9a75-f9e3196d9cb5 service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:20.867010 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-70d82b79-70f8-415e-9a75-f9e3196d9cb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:20.956566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d82b79-70f8-415e-9a75-f9e3196d9cb5 service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:20.961884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2ea14-cf3c-4467-b8e6-67e599ef9ae8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef60b27f5f545aa8ea063009ec66eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:20.962611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2ea14-cf3c-4467-b8e6-67e599ef9ae8 service placement] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:20.962896 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2ea14-cf3c-4467-b8e6-67e599ef9ae8 service placement] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:20.963173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2ea14-cf3c-4467-b8e6-67e599ef9ae8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:20.964894 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e0b2ea14-cf3c-4467-b8e6-67e599ef9ae8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:20.976608 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2ea14-cf3c-4467-b8e6-67e599ef9ae8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:20.978284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2ea14-cf3c-4467-b8e6-67e599ef9ae8 service placement] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:20.988595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1236/2460] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:23.015158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3de64-573b-4ce8-a9d7-636b2ba9b167 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:23.015626 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3de64-573b-4ce8-a9d7-636b2ba9b167 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:23.015720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3de64-573b-4ce8-a9d7-636b2ba9b167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:23.036066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-98f3de64-573b-4ce8-a9d7-636b2ba9b167 None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:23.037254 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-98f3de64-573b-4ce8-a9d7-636b2ba9b167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:23.091363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1225/2461] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:40:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:23.103788 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2ea14-cf3c-4467-b8e6-67e599ef9ae8 service placement] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:23.105210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e0b2ea14-cf3c-4467-b8e6-67e599ef9ae8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:23.173960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2ea14-cf3c-4467-b8e6-67e599ef9ae8 service placement] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:23.179004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb5474-5fd3-4a45-909d-f88be91364e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:23.179674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb5474-5fd3-4a45-909d-f88be91364e4 service swift] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:23.179893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb5474-5fd3-4a45-909d-f88be91364e4 service swift] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:23.180167 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb5474-5fd3-4a45-909d-f88be91364e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:23.189097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb5474-5fd3-4a45-909d-f88be91364e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:23.190707 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb5474-5fd3-4a45-909d-f88be91364e4 service swift] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:23.201170 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1237/2462] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:40:25.661611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3de64-573b-4ce8-a9d7-636b2ba9b167 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:25.665585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-98f3de64-573b-4ce8-a9d7-636b2ba9b167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:25.775968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3de64-573b-4ce8-a9d7-636b2ba9b167 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:25.781739 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:25.782437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:25.782765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:25.783038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] PATH_INFO: `/v3/users/edc5c93e7aad472d82bfda769730e775` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:25.784624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc5c93e7aad472d82bfda769730e775)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:25.787026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:25.788945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=100 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:25.867526 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc5c93e7aad472d82bfda769730e775'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:25.868401 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc5c93e7aad472d82bfda769730e775'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:25.879527 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc5c93e7aad472d82bfda769730e775'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:25.880304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc5c93e7aad472d82bfda769730e775'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:25.899082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc5c93e7aad472d82bfda769730e775'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:25.912702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1226/2463] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:40:25 2022] DELETE /identity/v3/users/edc5c93e7aad472d82bfda769730e775 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:25.920578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a45297-824d-4f8f-8b5a-3cbf4d069975 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:25.921089 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a45297-824d-4f8f-8b5a-3cbf4d069975 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:25.921196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a45297-824d-4f8f-8b5a-3cbf4d069975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:25.942932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-28a45297-824d-4f8f-8b5a-3cbf4d069975 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:25.944216 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-28a45297-824d-4f8f-8b5a-3cbf4d069975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:25.979889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:26.025008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1238/2464] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:26.035518 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:26.037003 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:26.101469 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab36db-1656-4c15-b863-9d859355f2d5 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:26.108399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8dcaa-43f9-438d-b2cd-d7ae8c5b7f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:26.109153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8dcaa-43f9-438d-b2cd-d7ae8c5b7f55 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:26.109440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8dcaa-43f9-438d-b2cd-d7ae8c5b7f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:26.109717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8dcaa-43f9-438d-b2cd-d7ae8c5b7f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:26.120905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8dcaa-43f9-438d-b2cd-d7ae8c5b7f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:26.122546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8dcaa-43f9-438d-b2cd-d7ae8c5b7f55 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:26.134139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1227/2465] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:26.424447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a45297-824d-4f8f-8b5a-3cbf4d069975 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:26.425926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-28a45297-824d-4f8f-8b5a-3cbf4d069975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:26.439129 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a45297-824d-4f8f-8b5a-3cbf4d069975 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:26.448675 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa56173-b167-4843-bb00-72037cf1229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:26.449436 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa56173-b167-4843-bb00-72037cf1229b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:26.449793 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa56173-b167-4843-bb00-72037cf1229b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:26.450068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa56173-b167-4843-bb00-72037cf1229b admin admin] PATH_INFO: `/v3/projects/e01adf45ef824354a7ff3c3268872421` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:26.451635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa56173-b167-4843-bb00-72037cf1229b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e01adf45ef824354a7ff3c3268872421)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:26.454827 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa56173-b167-4843-bb00-72037cf1229b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:26.521323 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1fa56173-b167-4843-bb00-72037cf1229b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e01adf45ef824354a7ff3c3268872421', 'request_id': 'req-1fa56173-b167-4843-bb00-72037cf1229b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:26.528970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1fa56173-b167-4843-bb00-72037cf1229b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e01adf45ef824354a7ff3c3268872421', 'request_id': 'req-1fa56173-b167-4843-bb00-72037cf1229b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:26.537369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1fa56173-b167-4843-bb00-72037cf1229b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e01adf45ef824354a7ff3c3268872421', 'request_id': 'req-1fa56173-b167-4843-bb00-72037cf1229b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:26.565831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1fa56173-b167-4843-bb00-72037cf1229b admin admin] The token cache is being invalidate because project e01adf45ef824354a7ff3c3268872421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:40:26.565831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1fa56173-b167-4843-bb00-72037cf1229b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:26.566660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1fa56173-b167-4843-bb00-72037cf1229b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:26.574557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1239/2466] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:40:26 2022] DELETE /identity/v3/projects/e01adf45ef824354a7ff3c3268872421 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:26.574758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac48c7c-08ec-4429-ad9e-ad6bd9b00b50 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:26.574758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac48c7c-08ec-4429-ad9e-ad6bd9b00b50 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:26.574758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac48c7c-08ec-4429-ad9e-ad6bd9b00b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:26.600815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-6ac48c7c-08ec-4429-ad9e-ad6bd9b00b50 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:26.602564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6ac48c7c-08ec-4429-ad9e-ad6bd9b00b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:26.674629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1228/2467] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:26.684372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96142c8-dc87-4931-b3fc-552177432620 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:26.684658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96142c8-dc87-4931-b3fc-552177432620 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:26.684930 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96142c8-dc87-4931-b3fc-552177432620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:26.718913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f96142c8-dc87-4931-b3fc-552177432620 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:26.720733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f96142c8-dc87-4931-b3fc-552177432620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:26.731970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1240/2468] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:26.735710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac48c7c-08ec-4429-ad9e-ad6bd9b00b50 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:26.749107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac48c7c-08ec-4429-ad9e-ad6bd9b00b50 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:26.754490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e6d1a-c5fb-4591-8b67-71af3f770d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:26.755210 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e6d1a-c5fb-4591-8b67-71af3f770d12 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:26.755554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e6d1a-c5fb-4591-8b67-71af3f770d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:26.755889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e6d1a-c5fb-4591-8b67-71af3f770d12 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:26.756618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e6d1a-c5fb-4591-8b67-71af3f770d12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:40:26.757113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e6d1a-c5fb-4591-8b67-71af3f770d12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:26.758838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e6d1a-c5fb-4591-8b67-71af3f770d12 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:26.780347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1229/2469] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:40:26.782021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96142c8-dc87-4931-b3fc-552177432620 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:26.792850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96142c8-dc87-4931-b3fc-552177432620 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:26.797813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44687f2c-5c21-4843-8825-deb6b54208ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:26.798446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44687f2c-5c21-4843-8825-deb6b54208ea admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:26.798764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44687f2c-5c21-4843-8825-deb6b54208ea admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:26.799172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44687f2c-5c21-4843-8825-deb6b54208ea admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:26.799845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44687f2c-5c21-4843-8825-deb6b54208ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:26.804111 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44687f2c-5c21-4843-8825-deb6b54208ea admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:26.835725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1241/2470] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:40:26 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:26.839797 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e6d1a-c5fb-4591-8b67-71af3f770d12 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:26.854431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e6d1a-c5fb-4591-8b67-71af3f770d12 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:26.859933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:26.956817 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb15a10-5195-4510-b528-3f7595e9e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:26.957443 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb15a10-5195-4510-b528-3f7595e9e9fd admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:26.957724 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb15a10-5195-4510-b528-3f7595e9e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:26.957996 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb15a10-5195-4510-b528-3f7595e9e9fd admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:26.958668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb15a10-5195-4510-b528-3f7595e9e9fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:26.960760 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb15a10-5195-4510-b528-3f7595e9e9fd admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:26.991194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1230/2471] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:40:26 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:26.997537 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44687f2c-5c21-4843-8825-deb6b54208ea admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:27.010804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44687f2c-5c21-4843-8825-deb6b54208ea admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:27.017146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e8545-732a-4ccf-9c75-445482c3d22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:27.019945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e8545-732a-4ccf-9c75-445482c3d22c admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:27.019945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e8545-732a-4ccf-9c75-445482c3d22c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:27.019945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e8545-732a-4ccf-9c75-445482c3d22c admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:27.019945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e8545-732a-4ccf-9c75-445482c3d22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:27.021097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e8545-732a-4ccf-9c75-445482c3d22c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:27.043075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb15a10-5195-4510-b528-3f7595e9e9fd admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:27.050286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1242/2472] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:27.053967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb15a10-5195-4510-b528-3f7595e9e9fd admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:27.059041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0d0bd-5030-4bb4-8e16-be3644e01a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:27.059684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0d0bd-5030-4bb4-8e16-be3644e01a08 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:27.059963 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0d0bd-5030-4bb4-8e16-be3644e01a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:27.060231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0d0bd-5030-4bb4-8e16-be3644e01a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:27.060877 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0d0bd-5030-4bb4-8e16-be3644e01a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:27.062534 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0d0bd-5030-4bb4-8e16-be3644e01a08 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:27.080283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e8545-732a-4ccf-9c75-445482c3d22c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:27.081200 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1231/2473] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:27.094801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e8545-732a-4ccf-9c75-445482c3d22c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:27.101542 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322a060-167a-4845-bcd0-a3690c443732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:27.102424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322a060-167a-4845-bcd0-a3690c443732 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:27.102749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322a060-167a-4845-bcd0-a3690c443732 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:27.103037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322a060-167a-4845-bcd0-a3690c443732 admin admin] PATH_INFO: `/v3/projects/d96f9ee7d3d34d70bc2c2da7513e13cf/users/cbe789bbeb2f4fb1b9bf22a51d2ee08c/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:27.131585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322a060-167a-4845-bcd0-a3690c443732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96f9ee7d3d34d70bc2c2da7513e13cf, user_id=cbe789bbeb2f4fb1b9bf22a51d2ee08c, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:27.136416 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322a060-167a-4845-bcd0-a3690c443732 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:27.173986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1243/2474] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:27 2022] PUT /identity/v3/projects/d96f9ee7d3d34d70bc2c2da7513e13cf/users/cbe789bbeb2f4fb1b9bf22a51d2ee08c/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:27.187164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81718fcb-0240-4178-a4b5-ea3b1926afaa None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:27.187480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81718fcb-0240-4178-a4b5-ea3b1926afaa None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:27.187764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81718fcb-0240-4178-a4b5-ea3b1926afaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:27.249342 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-81718fcb-0240-4178-a4b5-ea3b1926afaa None None] MFA Rules not processed for user `cbe789bbeb2f4fb1b9bf22a51d2ee08c`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:27.249342 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-81718fcb-0240-4178-a4b5-ea3b1926afaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:27.366257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1232/2475] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:27.376988 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322a060-167a-4845-bcd0-a3690c443732 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:27.378732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d322a060-167a-4845-bcd0-a3690c443732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:27.441709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:27.446323 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322a060-167a-4845-bcd0-a3690c443732 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:27.451674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2067d3b-2dd7-4898-8271-5393677d1832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:27.452795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2067d3b-2dd7-4898-8271-5393677d1832 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:27.453121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2067d3b-2dd7-4898-8271-5393677d1832 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:27.453700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2067d3b-2dd7-4898-8271-5393677d1832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:27.464561 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2067d3b-2dd7-4898-8271-5393677d1832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:27.465999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2067d3b-2dd7-4898-8271-5393677d1832 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:27.475942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1244/2476] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:27.500210 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81718fcb-0240-4178-a4b5-ea3b1926afaa None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:27.568294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81718fcb-0240-4178-a4b5-ea3b1926afaa None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:27.573383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:27.574012 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:27.574285 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:27.574829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] PATH_INFO: `/v3/users/cbe789bbeb2f4fb1b9bf22a51d2ee08c` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:27.576042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe789bbeb2f4fb1b9bf22a51d2ee08c)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:27.577985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:27.601369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:27.632074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe789bbeb2f4fb1b9bf22a51d2ee08c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:27.632732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe789bbeb2f4fb1b9bf22a51d2ee08c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:27.663129 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe789bbeb2f4fb1b9bf22a51d2ee08c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:27.664028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe789bbeb2f4fb1b9bf22a51d2ee08c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:27.679146 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe789bbeb2f4fb1b9bf22a51d2ee08c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:27.692560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1233/2477] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:40:27 2022] DELETE /identity/v3/users/cbe789bbeb2f4fb1b9bf22a51d2ee08c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:27.697640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2368f00-79ea-4e4d-ab46-adf13df408fc None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:27.697923 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2368f00-79ea-4e4d-ab46-adf13df408fc None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:27.698190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2368f00-79ea-4e4d-ab46-adf13df408fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:27.729481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-b2368f00-79ea-4e4d-ab46-adf13df408fc None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:27.730774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b2368f00-79ea-4e4d-ab46-adf13df408fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:27.828053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1245/2478] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:27.837388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:27.839015 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:27.905663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfaef1-1510-464f-8efc-4f4319141e60 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:27.916453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480c67e-ca1f-4149-b396-3f04aec8d28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:27.917079 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c67e-ca1f-4149-b396-3f04aec8d28c service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:27.917606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c67e-ca1f-4149-b396-3f04aec8d28c service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:27.917832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c67e-ca1f-4149-b396-3f04aec8d28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:27.935237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480c67e-ca1f-4149-b396-3f04aec8d28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:27.937122 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480c67e-ca1f-4149-b396-3f04aec8d28c service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:27.958604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1234/2479] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:28.252439 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2368f00-79ea-4e4d-ab46-adf13df408fc None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:28.253998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b2368f00-79ea-4e4d-ab46-adf13df408fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:28.286736 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2368f00-79ea-4e4d-ab46-adf13df408fc None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:28.313769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:28.314616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:28.315153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:28.315660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d admin admin] PATH_INFO: `/v3/projects/d96f9ee7d3d34d70bc2c2da7513e13cf` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:28.317128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96f9ee7d3d34d70bc2c2da7513e13cf)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:28.319872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:28.406997 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96f9ee7d3d34d70bc2c2da7513e13cf', 'request_id': 'req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:28.415076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96f9ee7d3d34d70bc2c2da7513e13cf', 'request_id': 'req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:28.424945 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96f9ee7d3d34d70bc2c2da7513e13cf', 'request_id': 'req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:28.441046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d admin admin] The token cache is being invalidate because project d96f9ee7d3d34d70bc2c2da7513e13cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:40:28.441334 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:28.441982 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-4409a1a8-cd99-4323-97e1-9dfd14d6d09d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:28.443750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1246/2480] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:40:28 2022] DELETE /identity/v3/projects/d96f9ee7d3d34d70bc2c2da7513e13cf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:28.449370 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d84e0-bb2d-4d99-b147-19af7ef2013c None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:28.449654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d84e0-bb2d-4d99-b147-19af7ef2013c None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:28.449923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d84e0-bb2d-4d99-b147-19af7ef2013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:28.492263 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-789d84e0-bb2d-4d99-b147-19af7ef2013c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:28.493504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-789d84e0-bb2d-4d99-b147-19af7ef2013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:28.607058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1235/2481] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:28.610555 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a239e-95f0-4e1c-8a5b-e97cf22f44be None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:28.611038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a239e-95f0-4e1c-8a5b-e97cf22f44be None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:28.611489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a239e-95f0-4e1c-8a5b-e97cf22f44be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:28.644466 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-686a239e-95f0-4e1c-8a5b-e97cf22f44be None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:28.646201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-686a239e-95f0-4e1c-8a5b-e97cf22f44be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:28.666604 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1247/2482] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:28.667895 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d84e0-bb2d-4d99-b147-19af7ef2013c None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:28.686922 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d84e0-bb2d-4d99-b147-19af7ef2013c None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:28.692737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6daeb5-799c-45e6-b74f-84e7628307b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:28.693495 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6daeb5-799c-45e6-b74f-84e7628307b5 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:28.693776 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6daeb5-799c-45e6-b74f-84e7628307b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:28.694044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6daeb5-799c-45e6-b74f-84e7628307b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:28.694919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6daeb5-799c-45e6-b74f-84e7628307b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:40:28.695223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6daeb5-799c-45e6-b74f-84e7628307b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:28.698841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6daeb5-799c-45e6-b74f-84e7628307b5 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:28.723181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1236/2483] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:40:28.728693 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a239e-95f0-4e1c-8a5b-e97cf22f44be None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:28.738334 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a239e-95f0-4e1c-8a5b-e97cf22f44be None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:28.756272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e48eb-74af-453a-b0fd-303aede0a95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:28.756907 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e48eb-74af-453a-b0fd-303aede0a95c admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:28.757184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e48eb-74af-453a-b0fd-303aede0a95c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:28.757450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e48eb-74af-453a-b0fd-303aede0a95c admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:28.758101 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e48eb-74af-453a-b0fd-303aede0a95c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:28.760237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e48eb-74af-453a-b0fd-303aede0a95c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:28.792568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1248/2484] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:40:28 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:28.796965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6daeb5-799c-45e6-b74f-84e7628307b5 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:28.809511 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6daeb5-799c-45e6-b74f-84e7628307b5 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:28.840881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:28.880018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b163fc7-343a-4c39-b8e1-c488ed64a855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:28.880606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b163fc7-343a-4c39-b8e1-c488ed64a855 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:28.880883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b163fc7-343a-4c39-b8e1-c488ed64a855 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:28.881157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b163fc7-343a-4c39-b8e1-c488ed64a855 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:28.881787 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b163fc7-343a-4c39-b8e1-c488ed64a855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:28.883919 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b163fc7-343a-4c39-b8e1-c488ed64a855 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:28.912786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1237/2485] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:40:28 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:28.914806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e48eb-74af-453a-b0fd-303aede0a95c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:28.927151 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e48eb-74af-453a-b0fd-303aede0a95c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:28.932880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4182aa0-c518-4d9f-b8c9-7ef18fdc63e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:28.933469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4182aa0-c518-4d9f-b8c9-7ef18fdc63e6 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:28.933831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4182aa0-c518-4d9f-b8c9-7ef18fdc63e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:28.934148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4182aa0-c518-4d9f-b8c9-7ef18fdc63e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:28.935127 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4182aa0-c518-4d9f-b8c9-7ef18fdc63e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:28.937000 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4182aa0-c518-4d9f-b8c9-7ef18fdc63e6 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:28.956496 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1249/2486] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:28.958800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b163fc7-343a-4c39-b8e1-c488ed64a855 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:28.971812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b163fc7-343a-4c39-b8e1-c488ed64a855 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:28.979763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca6f4f-ca91-4aee-8f82-92add9b57812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:28.980631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca6f4f-ca91-4aee-8f82-92add9b57812 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:28.980978 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca6f4f-ca91-4aee-8f82-92add9b57812 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:28.981430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca6f4f-ca91-4aee-8f82-92add9b57812 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:28.982404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca6f4f-ca91-4aee-8f82-92add9b57812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:28.985326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca6f4f-ca91-4aee-8f82-92add9b57812 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:29.002138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1238/2487] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:29.003633 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4182aa0-c518-4d9f-b8c9-7ef18fdc63e6 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:29.017647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4182aa0-c518-4d9f-b8c9-7ef18fdc63e6 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:29.023112 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73596a-1e8c-4bc8-8cf3-5da8c0ef8541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:29.023942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73596a-1e8c-4bc8-8cf3-5da8c0ef8541 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:29.024284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73596a-1e8c-4bc8-8cf3-5da8c0ef8541 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:29.024695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73596a-1e8c-4bc8-8cf3-5da8c0ef8541 admin admin] PATH_INFO: `/v3/projects/03dd55b892d142328ae0e5738f5179b7/users/09c6e6f7803f4feca497bfc43134a6b2/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:29.047817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73596a-1e8c-4bc8-8cf3-5da8c0ef8541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03dd55b892d142328ae0e5738f5179b7, user_id=09c6e6f7803f4feca497bfc43134a6b2, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:29.050525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73596a-1e8c-4bc8-8cf3-5da8c0ef8541 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:29.069153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1250/2488] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:29 2022] PUT /identity/v3/projects/03dd55b892d142328ae0e5738f5179b7/users/09c6e6f7803f4feca497bfc43134a6b2/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:29.074831 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e58b54-880b-45bd-ab67-489d37da101d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:29.075234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e58b54-880b-45bd-ab67-489d37da101d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:29.075601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e58b54-880b-45bd-ab67-489d37da101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:29.112035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-f7e58b54-880b-45bd-ab67-489d37da101d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:29.113457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f7e58b54-880b-45bd-ab67-489d37da101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:29.209312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1239/2489] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:29.216299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73596a-1e8c-4bc8-8cf3-5da8c0ef8541 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:29.218111 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6a73596a-1e8c-4bc8-8cf3-5da8c0ef8541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:29.233998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:29.293803 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73596a-1e8c-4bc8-8cf3-5da8c0ef8541 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:29.297555 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf1018-3eb8-446d-bd56-db6967f93e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:29.298171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf1018-3eb8-446d-bd56-db6967f93e3a service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:29.298455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf1018-3eb8-446d-bd56-db6967f93e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:29.298760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf1018-3eb8-446d-bd56-db6967f93e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:29.308990 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf1018-3eb8-446d-bd56-db6967f93e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:29.310452 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf1018-3eb8-446d-bd56-db6967f93e3a service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:29.321172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1251/2490] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:40:30.205345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33924b-4c07-47d7-85b9-8aa05fed9fde None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:30.205851 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33924b-4c07-47d7-85b9-8aa05fed9fde None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:30.206001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33924b-4c07-47d7-85b9-8aa05fed9fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:30.280492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-3c33924b-4c07-47d7-85b9-8aa05fed9fde None None] MFA Rules not processed for user `09c6e6f7803f4feca497bfc43134a6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:30.281742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3c33924b-4c07-47d7-85b9-8aa05fed9fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:30.444219 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1240/2491] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:30.452447 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf1018-3eb8-446d-bd56-db6967f93e3a service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:30.453917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-bfdf1018-3eb8-446d-bd56-db6967f93e3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:30.553506 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf1018-3eb8-446d-bd56-db6967f93e3a service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:30.557366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2780d6f-b164-4cae-9605-4757a4ab53fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:30.557980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2780d6f-b164-4cae-9605-4757a4ab53fb service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:30.558262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2780d6f-b164-4cae-9605-4757a4ab53fb service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:30.558562 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2780d6f-b164-4cae-9605-4757a4ab53fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:30.567413 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2780d6f-b164-4cae-9605-4757a4ab53fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:30.568890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2780d6f-b164-4cae-9605-4757a4ab53fb service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:30.578936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1252/2492] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:40:32.029294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde8f3d-29d7-4766-96dd-6992d9e10766 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:32.029915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde8f3d-29d7-4766-96dd-6992d9e10766 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:32.030035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde8f3d-29d7-4766-96dd-6992d9e10766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:32.052910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-1fde8f3d-29d7-4766-96dd-6992d9e10766 None None] MFA Rules not processed for user `09c6e6f7803f4feca497bfc43134a6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:32.054175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1fde8f3d-29d7-4766-96dd-6992d9e10766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:32.063292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1241/2493] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:32.301636 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2780d6f-b164-4cae-9605-4757a4ab53fb service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:32.303102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f2780d6f-b164-4cae-9605-4757a4ab53fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:32.315565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2780d6f-b164-4cae-9605-4757a4ab53fb service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:32.319097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a17ffd-1434-4a5b-93ed-a483bda39dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:32.319694 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a17ffd-1434-4a5b-93ed-a483bda39dec service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:32.319973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a17ffd-1434-4a5b-93ed-a483bda39dec service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:32.320243 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a17ffd-1434-4a5b-93ed-a483bda39dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:32.322662 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-41a17ffd-1434-4a5b-93ed-a483bda39dec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:32.332472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a17ffd-1434-4a5b-93ed-a483bda39dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:32.334176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a17ffd-1434-4a5b-93ed-a483bda39dec service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:32.342539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1253/2494] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:36.310163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde8f3d-29d7-4766-96dd-6992d9e10766 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:36.312752 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1fde8f3d-29d7-4766-96dd-6992d9e10766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:36.401156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:36.468602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde8f3d-29d7-4766-96dd-6992d9e10766 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:36.476285 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c7c12-5a8a-4555-b111-521827b6d009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:36.477530 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7c12-5a8a-4555-b111-521827b6d009 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:36.478155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7c12-5a8a-4555-b111-521827b6d009 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:36.478633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7c12-5a8a-4555-b111-521827b6d009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:36.482163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f55c7c12-5a8a-4555-b111-521827b6d009 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:36.512779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c7c12-5a8a-4555-b111-521827b6d009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:36.515643 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c7c12-5a8a-4555-b111-521827b6d009 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:36.539303 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1242/2495] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:37.097767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a17ffd-1434-4a5b-93ed-a483bda39dec service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:37.115636 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a17ffd-1434-4a5b-93ed-a483bda39dec service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:37.129618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b2e89-5824-45ce-9cff-b71b9d5bfcab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:37.130330 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b2e89-5824-45ce-9cff-b71b9d5bfcab service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:37.130940 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b2e89-5824-45ce-9cff-b71b9d5bfcab service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:37.131295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b2e89-5824-45ce-9cff-b71b9d5bfcab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:37.133743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-983b2e89-5824-45ce-9cff-b71b9d5bfcab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:37.152422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b2e89-5824-45ce-9cff-b71b9d5bfcab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:37.154608 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b2e89-5824-45ce-9cff-b71b9d5bfcab service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:37.169546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1254/2496] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:38.244915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a4635-c76b-4e41-b69c-4667fc93386a None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:38.245307 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a4635-c76b-4e41-b69c-4667fc93386a None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:38.245582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a4635-c76b-4e41-b69c-4667fc93386a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:38.268074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-d39a4635-c76b-4e41-b69c-4667fc93386a None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:38.269291 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d39a4635-c76b-4e41-b69c-4667fc93386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:38.332429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1243/2497] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 16 05:40:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:38.356239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b2e89-5824-45ce-9cff-b71b9d5bfcab service nova] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:38.357762 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-983b2e89-5824-45ce-9cff-b71b9d5bfcab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:38.432449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b2e89-5824-45ce-9cff-b71b9d5bfcab service nova] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:38.437627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d71d6-b773-4356-89ec-77834739da24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:38.438245 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d71d6-b773-4356-89ec-77834739da24 service swift] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:38.438536 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d71d6-b773-4356-89ec-77834739da24 service swift] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:38.438838 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d71d6-b773-4356-89ec-77834739da24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:38.448415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d71d6-b773-4356-89ec-77834739da24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:38.450034 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d71d6-b773-4356-89ec-77834739da24 service swift] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:38.459635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1255/2498] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:40:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:40:48.325275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=46 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:48.456725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=91 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:50.254092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a4635-c76b-4e41-b69c-4667fc93386a None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:50.256369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d39a4635-c76b-4e41-b69c-4667fc93386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:50.272063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a4635-c76b-4e41-b69c-4667fc93386a None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:50.277633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:50.278257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:50.278560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:50.278835 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] PATH_INFO: `/v3/users/a91b14533d5d4f6fb0305918e7d92b35` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:50.279956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a91b14533d5d4f6fb0305918e7d92b35)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:50.281860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:50.335134 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a91b14533d5d4f6fb0305918e7d92b35'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:50.335784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a91b14533d5d4f6fb0305918e7d92b35'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:50.343740 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a91b14533d5d4f6fb0305918e7d92b35'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:50.344559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a91b14533d5d4f6fb0305918e7d92b35'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:50.358363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a91b14533d5d4f6fb0305918e7d92b35'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:50.370641 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1244/2499] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:40:50 2022] DELETE /identity/v3/users/a91b14533d5d4f6fb0305918e7d92b35 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:50.375260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea9d1d-ec49-4757-a4d7-e5ea1776d295 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:50.375725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea9d1d-ec49-4757-a4d7-e5ea1776d295 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:50.375821 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea9d1d-ec49-4757-a4d7-e5ea1776d295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:50.395622 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-76ea9d1d-ec49-4757-a4d7-e5ea1776d295 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:50.396875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-76ea9d1d-ec49-4757-a4d7-e5ea1776d295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:50.459425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1256/2500] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:40:50.471412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:50.472880 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:50.535656 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f8eb0-39b5-4530-9d4d-3589db5b62b6 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:50.539334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6bf20-0895-4f34-875b-62dd78da68f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:50.539941 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6bf20-0895-4f34-875b-62dd78da68f3 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:50.540220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6bf20-0895-4f34-875b-62dd78da68f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:50.540490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6bf20-0895-4f34-875b-62dd78da68f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:50.549334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6bf20-0895-4f34-875b-62dd78da68f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:50.550802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6bf20-0895-4f34-875b-62dd78da68f3 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:50.560315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1245/2501] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:50.857939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea9d1d-ec49-4757-a4d7-e5ea1776d295 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:50.859329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-76ea9d1d-ec49-4757-a4d7-e5ea1776d295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:50.872684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea9d1d-ec49-4757-a4d7-e5ea1776d295 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:50.877751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:50.878388 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:50.878714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:50.878985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] PATH_INFO: `/v3/projects/08886ec9ef1648fa89f2a5eb3500676e` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:50.880159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=08886ec9ef1648fa89f2a5eb3500676e)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:50.882228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:50.949543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08886ec9ef1648fa89f2a5eb3500676e', 'request_id': 'req-24396e70-504c-4d8f-9771-d9a0834a1e7e'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:50.956111 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08886ec9ef1648fa89f2a5eb3500676e', 'request_id': 'req-24396e70-504c-4d8f-9771-d9a0834a1e7e'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:50.963329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08886ec9ef1648fa89f2a5eb3500676e', 'request_id': 'req-24396e70-504c-4d8f-9771-d9a0834a1e7e'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:50.975210 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] The token cache is being invalidate because project 08886ec9ef1648fa89f2a5eb3500676e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:40:50.975576 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:50.976315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:50.977863 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1257/2502] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:40:50 2022] DELETE /identity/v3/projects/08886ec9ef1648fa89f2a5eb3500676e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:50.981966 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6bf20-0895-4f34-875b-62dd78da68f3 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:50.991962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6bf20-0895-4f34-875b-62dd78da68f3 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:51.053689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd467486-4921-43ca-9950-ded434ebf1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:51.054346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd467486-4921-43ca-9950-ded434ebf1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:51.054646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd467486-4921-43ca-9950-ded434ebf1be admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:51.054956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd467486-4921-43ca-9950-ded434ebf1be admin admin] PATH_INFO: `/v3/users/f2e4f4b5e0574819a490af024fc0ce99` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:51.056032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd467486-4921-43ca-9950-ded434ebf1be admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e4f4b5e0574819a490af024fc0ce99)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:51.058477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd467486-4921-43ca-9950-ded434ebf1be admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:51.075154 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:51.110198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-dd467486-4921-43ca-9950-ded434ebf1be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e4f4b5e0574819a490af024fc0ce99'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:51.110877 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-dd467486-4921-43ca-9950-ded434ebf1be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e4f4b5e0574819a490af024fc0ce99'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:51.118373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-dd467486-4921-43ca-9950-ded434ebf1be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e4f4b5e0574819a490af024fc0ce99'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:51.119035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-dd467486-4921-43ca-9950-ded434ebf1be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e4f4b5e0574819a490af024fc0ce99'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:51.140213 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-dd467486-4921-43ca-9950-ded434ebf1be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e4f4b5e0574819a490af024fc0ce99'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:51.152945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1246/2503] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:40:50 2022] DELETE /identity/v3/users/f2e4f4b5e0574819a490af024fc0ce99 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:51.439711 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:51.441254 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:51.455236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24396e70-504c-4d8f-9771-d9a0834a1e7e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:51.512391 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:51.513022 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:51.513300 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:51.513575 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32 admin admin] PATH_INFO: `/v3/projects/4a072179ff364e5794e857b0799f291d` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:51.515160 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a072179ff364e5794e857b0799f291d)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:51.518190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:51.560409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:51.577558 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a072179ff364e5794e857b0799f291d', 'request_id': 'req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:51.583244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a072179ff364e5794e857b0799f291d', 'request_id': 'req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:51.590216 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a072179ff364e5794e857b0799f291d', 'request_id': 'req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:51.600962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32 admin admin] The token cache is being invalidate because project 4a072179ff364e5794e857b0799f291d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:40:51.601252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:51.601870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-c15106de-1aac-4e4a-8d1e-bc1ce9310b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:51.603371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1258/2504] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:40:51 2022] DELETE /identity/v3/projects/4a072179ff364e5794e857b0799f291d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:51.608664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5088b-532d-4b43-8b18-018d358122ee None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:51.609138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5088b-532d-4b43-8b18-018d358122ee None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:51.609247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5088b-532d-4b43-8b18-018d358122ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:51.630144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-e6e5088b-532d-4b43-8b18-018d358122ee None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:51.631499 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e6e5088b-532d-4b43-8b18-018d358122ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:51.690217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1247/2505] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:51.698077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8444418-cac5-41a1-bc70-904cacc8d88a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:51.698369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8444418-cac5-41a1-bc70-904cacc8d88a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:51.698695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8444418-cac5-41a1-bc70-904cacc8d88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:51.719109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c8444418-cac5-41a1-bc70-904cacc8d88a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:51.720346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c8444418-cac5-41a1-bc70-904cacc8d88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:51.728076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1259/2506] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:51.733025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5088b-532d-4b43-8b18-018d358122ee None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:51.743554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5088b-532d-4b43-8b18-018d358122ee None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:51.748501 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40120d64-84e0-4ce0-b823-7b9f919bd477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:51.749115 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40120d64-84e0-4ce0-b823-7b9f919bd477 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:51.749450 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40120d64-84e0-4ce0-b823-7b9f919bd477 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:51.749668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40120d64-84e0-4ce0-b823-7b9f919bd477 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:51.750336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40120d64-84e0-4ce0-b823-7b9f919bd477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:40:51.750673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40120d64-84e0-4ce0-b823-7b9f919bd477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:51.752326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40120d64-84e0-4ce0-b823-7b9f919bd477 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:51.764273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1248/2507] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:40:51.768576 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8444418-cac5-41a1-bc70-904cacc8d88a None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:51.778460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8444418-cac5-41a1-bc70-904cacc8d88a None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:51.783112 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1332107-a699-4478-b8cf-26ed7e7ace05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:51.783700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1332107-a699-4478-b8cf-26ed7e7ace05 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:51.783977 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1332107-a699-4478-b8cf-26ed7e7ace05 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:51.784247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1332107-a699-4478-b8cf-26ed7e7ace05 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:51.784862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1332107-a699-4478-b8cf-26ed7e7ace05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:51.786784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1332107-a699-4478-b8cf-26ed7e7ace05 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:51.817800 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1260/2508] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:40:51 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:51.821993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40120d64-84e0-4ce0-b823-7b9f919bd477 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:51.832199 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40120d64-84e0-4ce0-b823-7b9f919bd477 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:51.892304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1a22b-9be8-4e87-bfd0-53a99a50522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:51.892908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1a22b-9be8-4e87-bfd0-53a99a50522c admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:51.893189 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1a22b-9be8-4e87-bfd0-53a99a50522c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:51.893467 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1a22b-9be8-4e87-bfd0-53a99a50522c admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:51.894088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1a22b-9be8-4e87-bfd0-53a99a50522c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:51.896061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1a22b-9be8-4e87-bfd0-53a99a50522c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:51.918186 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1249/2509] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:40:51 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:51.922389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1332107-a699-4478-b8cf-26ed7e7ace05 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:51.932910 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1332107-a699-4478-b8cf-26ed7e7ace05 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:51.937567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf34f8-dad5-4f4a-87e3-3616fa5678c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:51.938154 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf34f8-dad5-4f4a-87e3-3616fa5678c9 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:51.938445 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf34f8-dad5-4f4a-87e3-3616fa5678c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:51.938769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf34f8-dad5-4f4a-87e3-3616fa5678c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:51.939432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf34f8-dad5-4f4a-87e3-3616fa5678c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:51.941014 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf34f8-dad5-4f4a-87e3-3616fa5678c9 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:51.950796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1261/2510] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:51.955088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1a22b-9be8-4e87-bfd0-53a99a50522c admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:51.965713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1a22b-9be8-4e87-bfd0-53a99a50522c admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:51.970403 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2604-7b3e-449e-b9ad-a9e365ec4abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:51.971038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2604-7b3e-449e-b9ad-a9e365ec4abc admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:51.971314 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2604-7b3e-449e-b9ad-a9e365ec4abc admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:51.971581 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2604-7b3e-449e-b9ad-a9e365ec4abc admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:51.972239 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb2604-7b3e-449e-b9ad-a9e365ec4abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:51.973843 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb2604-7b3e-449e-b9ad-a9e365ec4abc admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:51.980371 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:51.987960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1250/2511] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:51.991249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf34f8-dad5-4f4a-87e3-3616fa5678c9 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:52.001650 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf34f8-dad5-4f4a-87e3-3616fa5678c9 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:52.006299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e159f53-8178-413a-9b6b-ffff626ab8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:52.006977 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e159f53-8178-413a-9b6b-ffff626ab8ef admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:52.007262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e159f53-8178-413a-9b6b-ffff626ab8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:52.007534 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e159f53-8178-413a-9b6b-ffff626ab8ef admin admin] PATH_INFO: `/v3/projects/786e07ba6efd4e749c4b5ac6d0899ce6/users/08fa6acacf6a4ba59a8338adc069be84/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:52.022313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e159f53-8178-413a-9b6b-ffff626ab8ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=786e07ba6efd4e749c4b5ac6d0899ce6, user_id=08fa6acacf6a4ba59a8338adc069be84, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:52.024998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e159f53-8178-413a-9b6b-ffff626ab8ef admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:52.037850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1262/2512] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:51 2022] PUT /identity/v3/projects/786e07ba6efd4e749c4b5ac6d0899ce6/users/08fa6acacf6a4ba59a8338adc069be84/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:52.049175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13260ddb-fd18-48a2-86d7-f13bb3c92887 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:52.049457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13260ddb-fd18-48a2-86d7-f13bb3c92887 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:52.049727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13260ddb-fd18-48a2-86d7-f13bb3c92887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:52.077677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-13260ddb-fd18-48a2-86d7-f13bb3c92887 None None] MFA Rules not processed for user `08fa6acacf6a4ba59a8338adc069be84`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:52.079171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-13260ddb-fd18-48a2-86d7-f13bb3c92887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:52.146491 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1251/2513] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:40:52.151621 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e159f53-8178-413a-9b6b-ffff626ab8ef admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:52.215276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e159f53-8178-413a-9b6b-ffff626ab8ef admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:52.219995 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ad2fa-24a8-455c-9a37-79fd8b4ce3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:52.220599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ad2fa-24a8-455c-9a37-79fd8b4ce3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:52.220881 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ad2fa-24a8-455c-9a37-79fd8b4ce3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:52.221162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ad2fa-24a8-455c-9a37-79fd8b4ce3e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:52.221798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ad2fa-24a8-455c-9a37-79fd8b4ce3e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:52.223742 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ad2fa-24a8-455c-9a37-79fd8b4ce3e6 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:52.251536 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1263/2514] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:40:52 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:52.255698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13260ddb-fd18-48a2-86d7-f13bb3c92887 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:52.267153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13260ddb-fd18-48a2-86d7-f13bb3c92887 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:52.324533 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc35387-7bc3-4463-9a0e-833cc7bc6a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:52.325059 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc35387-7bc3-4463-9a0e-833cc7bc6a39 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:52.325354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc35387-7bc3-4463-9a0e-833cc7bc6a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:52.325771 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc35387-7bc3-4463-9a0e-833cc7bc6a39 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:52.330861 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc35387-7bc3-4463-9a0e-833cc7bc6a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:52.332888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc35387-7bc3-4463-9a0e-833cc7bc6a39 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:52.359854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1252/2515] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:40:52 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:40:52.361118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ad2fa-24a8-455c-9a37-79fd8b4ce3e6 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:52.371792 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ad2fa-24a8-455c-9a37-79fd8b4ce3e6 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:52.376575 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1178c41-7b01-455d-84a5-7423574fa243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:52.377043 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1178c41-7b01-455d-84a5-7423574fa243 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:52.377326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1178c41-7b01-455d-84a5-7423574fa243 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:52.377617 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1178c41-7b01-455d-84a5-7423574fa243 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:52.378260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1178c41-7b01-455d-84a5-7423574fa243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:52.379937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1178c41-7b01-455d-84a5-7423574fa243 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:52.391516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1264/2516] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:52.395595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc35387-7bc3-4463-9a0e-833cc7bc6a39 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:52.406158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc35387-7bc3-4463-9a0e-833cc7bc6a39 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:52.410745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9cef0-e8c8-4434-a509-75fd60a58b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:52.411425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9cef0-e8c8-4434-a509-75fd60a58b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:52.411703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9cef0-e8c8-4434-a509-75fd60a58b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:52.411970 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9cef0-e8c8-4434-a509-75fd60a58b2b admin admin] PATH_INFO: `/v3/projects/ab49e1034d174d538c43356606df3694/users/009fbb3d05d34b77add21ad91d7833eb/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:52.427544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9cef0-e8c8-4434-a509-75fd60a58b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab49e1034d174d538c43356606df3694, user_id=009fbb3d05d34b77add21ad91d7833eb, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:52.430250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9cef0-e8c8-4434-a509-75fd60a58b2b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:52.450779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1253/2517] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:52 2022] PUT /identity/v3/projects/ab49e1034d174d538c43356606df3694/users/009fbb3d05d34b77add21ad91d7833eb/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:40:52.454194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1178c41-7b01-455d-84a5-7423574fa243 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:52.464339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1178c41-7b01-455d-84a5-7423574fa243 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:52.483795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:52.521398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d262d-3bab-4e12-93a0-ac13d0c33f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:52.521920 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d262d-3bab-4e12-93a0-ac13d0c33f04 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:52.522197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d262d-3bab-4e12-93a0-ac13d0c33f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:52.522463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d262d-3bab-4e12-93a0-ac13d0c33f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:52.523120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d262d-3bab-4e12-93a0-ac13d0c33f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:52.524743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d262d-3bab-4e12-93a0-ac13d0c33f04 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:52.534273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1265/2518] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:52.538560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9cef0-e8c8-4434-a509-75fd60a58b2b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:52.551418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9cef0-e8c8-4434-a509-75fd60a58b2b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:52.556229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6448238-d5f8-49c9-ab50-8e14264f5e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:52.557435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448238-d5f8-49c9-ab50-8e14264f5e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:52.557709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448238-d5f8-49c9-ab50-8e14264f5e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:52.557972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448238-d5f8-49c9-ab50-8e14264f5e2c admin admin] PATH_INFO: `/v3/projects/ab49e1034d174d538c43356606df3694/users/009fbb3d05d34b77add21ad91d7833eb/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:52.559925 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6448238-d5f8-49c9-ab50-8e14264f5e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab49e1034d174d538c43356606df3694, user_id=009fbb3d05d34b77add21ad91d7833eb, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:52.562590 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6448238-d5f8-49c9-ab50-8e14264f5e2c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:52.573980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1254/2519] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:52 2022] PUT /identity/v3/projects/ab49e1034d174d538c43356606df3694/users/009fbb3d05d34b77add21ad91d7833eb/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:40:52.584469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed32ea6-7701-4d46-b8bf-f669bd7592f1 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:52.584944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed32ea6-7701-4d46-b8bf-f669bd7592f1 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:52.585222 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed32ea6-7701-4d46-b8bf-f669bd7592f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:52.615855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-eed32ea6-7701-4d46-b8bf-f669bd7592f1 None None] MFA Rules not processed for user `009fbb3d05d34b77add21ad91d7833eb`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:52.617069 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-eed32ea6-7701-4d46-b8bf-f669bd7592f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:52.683817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1266/2520] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:52.695833 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6448238-d5f8-49c9-ab50-8e14264f5e2c admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:52.698631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e6448238-d5f8-49c9-ab50-8e14264f5e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:52.747204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:52.759525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6448238-d5f8-49c9-ab50-8e14264f5e2c admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:52.763755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920174dd-7cbb-47cf-a2a9-4a7e545775a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:52.764354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920174dd-7cbb-47cf-a2a9-4a7e545775a6 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:52.764633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920174dd-7cbb-47cf-a2a9-4a7e545775a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:52.764904 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920174dd-7cbb-47cf-a2a9-4a7e545775a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:52.773720 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920174dd-7cbb-47cf-a2a9-4a7e545775a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:52.775141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920174dd-7cbb-47cf-a2a9-4a7e545775a6 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:52.784420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1255/2521] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:53.177427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed32ea6-7701-4d46-b8bf-f669bd7592f1 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:53.250281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed32ea6-7701-4d46-b8bf-f669bd7592f1 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:53.254900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:53.255525 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:53.255807 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:53.256085 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] PATH_INFO: `/v3/users/08fa6acacf6a4ba59a8338adc069be84` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:53.257209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08fa6acacf6a4ba59a8338adc069be84)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:53.259208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:53.303876 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08fa6acacf6a4ba59a8338adc069be84'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:53.304518 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08fa6acacf6a4ba59a8338adc069be84'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:53.305720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:53.312924 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08fa6acacf6a4ba59a8338adc069be84'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:53.326408 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08fa6acacf6a4ba59a8338adc069be84'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:53.327183 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08fa6acacf6a4ba59a8338adc069be84'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:53.345861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1267/2522] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:40:53 2022] DELETE /identity/v3/users/08fa6acacf6a4ba59a8338adc069be84 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:53.353945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7388-1183-4a19-a52f-b30d4dae303f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:53.354251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7388-1183-4a19-a52f-b30d4dae303f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:53.354538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7388-1183-4a19-a52f-b30d4dae303f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:53.373841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-44cb7388-1183-4a19-a52f-b30d4dae303f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:53.375055 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-44cb7388-1183-4a19-a52f-b30d4dae303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:53.432295 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1256/2523] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:53.443059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:53.444496 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:53.504802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc273762-60fa-446d-b7b6-52223713b905 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:53.508497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3c2c7-bd86-49ee-af69-bd50f9a875ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:53.509103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3c2c7-bd86-49ee-af69-bd50f9a875ab service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:53.509377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3c2c7-bd86-49ee-af69-bd50f9a875ab service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:53.509642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3c2c7-bd86-49ee-af69-bd50f9a875ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:53.519940 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3c2c7-bd86-49ee-af69-bd50f9a875ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:53.521363 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3c2c7-bd86-49ee-af69-bd50f9a875ab service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:53.536737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1268/2524] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:53.891259 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7388-1183-4a19-a52f-b30d4dae303f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:53.892728 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-44cb7388-1183-4a19-a52f-b30d4dae303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:53.912365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7388-1183-4a19-a52f-b30d4dae303f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:53.920908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:53.921609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:53.921914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:53.922158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] PATH_INFO: `/v3/projects/786e07ba6efd4e749c4b5ac6d0899ce6` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:53.923463 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] RBAC: Authorizing `identity:delete_project(project_id=786e07ba6efd4e749c4b5ac6d0899ce6)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:53.925547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:53.973927 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786e07ba6efd4e749c4b5ac6d0899ce6', 'request_id': 'req-38fd7486-a42c-4853-8e69-0758f17a908e'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:53.980664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786e07ba6efd4e749c4b5ac6d0899ce6', 'request_id': 'req-38fd7486-a42c-4853-8e69-0758f17a908e'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:53.988578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786e07ba6efd4e749c4b5ac6d0899ce6', 'request_id': 'req-38fd7486-a42c-4853-8e69-0758f17a908e'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:54.000869 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] The token cache is being invalidate because project 786e07ba6efd4e749c4b5ac6d0899ce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:40:54.001512 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:54.002543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:54.004572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1257/2525] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:40:53 2022] DELETE /identity/v3/projects/786e07ba6efd4e749c4b5ac6d0899ce6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:54.009423 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3c2c7-bd86-49ee-af69-bd50f9a875ab service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:54.020035 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3c2c7-bd86-49ee-af69-bd50f9a875ab service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:54.081052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bba179-a390-46a4-985e-acb183933f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:54.081708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba179-a390-46a4-985e-acb183933f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:54.082218 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba179-a390-46a4-985e-acb183933f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:54.082499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba179-a390-46a4-985e-acb183933f54 admin admin] PATH_INFO: `/v3/users/009fbb3d05d34b77add21ad91d7833eb` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:54.083668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bba179-a390-46a4-985e-acb183933f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=009fbb3d05d34b77add21ad91d7833eb)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:54.085579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bba179-a390-46a4-985e-acb183933f54 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:54.142231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-26bba179-a390-46a4-985e-acb183933f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009fbb3d05d34b77add21ad91d7833eb'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:54.142975 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-26bba179-a390-46a4-985e-acb183933f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009fbb3d05d34b77add21ad91d7833eb'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:54.149874 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-26bba179-a390-46a4-985e-acb183933f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009fbb3d05d34b77add21ad91d7833eb'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:54.158533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-26bba179-a390-46a4-985e-acb183933f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009fbb3d05d34b77add21ad91d7833eb'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:54.159175 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-26bba179-a390-46a4-985e-acb183933f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009fbb3d05d34b77add21ad91d7833eb'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:54.165852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:54.183790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1269/2526] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:40:54 2022] DELETE /identity/v3/users/009fbb3d05d34b77add21ad91d7833eb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:54.785302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:54.791997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:54.817542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd7486-a42c-4853-8e69-0758f17a908e admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:54.911984 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b037724-1546-4b89-a35c-266fcc712f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:54.912637 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b037724-1546-4b89-a35c-266fcc712f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:54.912884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b037724-1546-4b89-a35c-266fcc712f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:54.913300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b037724-1546-4b89-a35c-266fcc712f5a admin admin] PATH_INFO: `/v3/projects/ab49e1034d174d538c43356606df3694` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:54.914965 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b037724-1546-4b89-a35c-266fcc712f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab49e1034d174d538c43356606df3694)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:54.919072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b037724-1546-4b89-a35c-266fcc712f5a admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:54.932676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:54.982606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1b037724-1546-4b89-a35c-266fcc712f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab49e1034d174d538c43356606df3694', 'request_id': 'req-1b037724-1546-4b89-a35c-266fcc712f5a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:54.988058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1b037724-1546-4b89-a35c-266fcc712f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab49e1034d174d538c43356606df3694', 'request_id': 'req-1b037724-1546-4b89-a35c-266fcc712f5a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:54.995513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1b037724-1546-4b89-a35c-266fcc712f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab49e1034d174d538c43356606df3694', 'request_id': 'req-1b037724-1546-4b89-a35c-266fcc712f5a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:55.009054 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1b037724-1546-4b89-a35c-266fcc712f5a admin admin] The token cache is being invalidate because project ab49e1034d174d538c43356606df3694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:40:55.009349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1b037724-1546-4b89-a35c-266fcc712f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:55.010640 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1b037724-1546-4b89-a35c-266fcc712f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:55.012289 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1258/2527] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:40:54 2022] DELETE /identity/v3/projects/ab49e1034d174d538c43356606df3694 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:55.017086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23ca7b-b152-4403-bb0f-31d73c56e647 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:55.017562 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23ca7b-b152-4403-bb0f-31d73c56e647 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:55.017659 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23ca7b-b152-4403-bb0f-31d73c56e647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:55.039287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-4d23ca7b-b152-4403-bb0f-31d73c56e647 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:55.040580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4d23ca7b-b152-4403-bb0f-31d73c56e647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:55.106480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1270/2528] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:55.114291 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0818c0-8928-4c52-bfca-a880466cad18 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:55.114526 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0818c0-8928-4c52-bfca-a880466cad18 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:55.114816 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0818c0-8928-4c52-bfca-a880466cad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:55.137604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-ac0818c0-8928-4c52-bfca-a880466cad18 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:55.139727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ac0818c0-8928-4c52-bfca-a880466cad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:55.153076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1259/2529] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:55.157256 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23ca7b-b152-4403-bb0f-31d73c56e647 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:55.188292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23ca7b-b152-4403-bb0f-31d73c56e647 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:55.196871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bfc89-d281-48f2-ad00-d61d93e8988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:55.197774 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bfc89-d281-48f2-ad00-d61d93e8988c admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:55.198061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bfc89-d281-48f2-ad00-d61d93e8988c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:55.198347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bfc89-d281-48f2-ad00-d61d93e8988c admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:55.199029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bfc89-d281-48f2-ad00-d61d93e8988c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:40:55.199332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bfc89-d281-48f2-ad00-d61d93e8988c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:55.200946 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bfc89-d281-48f2-ad00-d61d93e8988c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:55.219767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1271/2530] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:40:55.225951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0818c0-8928-4c52-bfca-a880466cad18 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:55.248096 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0818c0-8928-4c52-bfca-a880466cad18 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:55.256160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da601e22-9c94-46d7-96ce-9597b0c03cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:55.257544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da601e22-9c94-46d7-96ce-9597b0c03cae admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:55.257979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da601e22-9c94-46d7-96ce-9597b0c03cae admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:55.258431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da601e22-9c94-46d7-96ce-9597b0c03cae admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:55.259825 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da601e22-9c94-46d7-96ce-9597b0c03cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:55.263666 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da601e22-9c94-46d7-96ce-9597b0c03cae admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:55.293404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1260/2531] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:40:55 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:55.297691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bfc89-d281-48f2-ad00-d61d93e8988c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:55.309340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bfc89-d281-48f2-ad00-d61d93e8988c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:55.384262 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cbcaf-f687-4c1d-90a4-cc9216dc6296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:55.384929 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cbcaf-f687-4c1d-90a4-cc9216dc6296 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:55.385245 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cbcaf-f687-4c1d-90a4-cc9216dc6296 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:55.385513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cbcaf-f687-4c1d-90a4-cc9216dc6296 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:55.386139 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cbcaf-f687-4c1d-90a4-cc9216dc6296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:55.388138 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cbcaf-f687-4c1d-90a4-cc9216dc6296 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:55.412493 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1272/2532] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:40:55 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:40:55.417203 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da601e22-9c94-46d7-96ce-9597b0c03cae admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:55.428449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da601e22-9c94-46d7-96ce-9597b0c03cae admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:55.434190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5557af-9b68-47cc-8182-e6367863a359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:55.434841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5557af-9b68-47cc-8182-e6367863a359 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:55.435119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5557af-9b68-47cc-8182-e6367863a359 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:55.435387 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5557af-9b68-47cc-8182-e6367863a359 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:55.436031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5557af-9b68-47cc-8182-e6367863a359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:55.437639 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5557af-9b68-47cc-8182-e6367863a359 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:55.448353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1261/2533] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:55.452485 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cbcaf-f687-4c1d-90a4-cc9216dc6296 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:55.463467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cbcaf-f687-4c1d-90a4-cc9216dc6296 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:55.468150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc3eba-9a53-4bf5-a931-055916d232ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:55.468889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc3eba-9a53-4bf5-a931-055916d232ca admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:55.469062 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc3eba-9a53-4bf5-a931-055916d232ca admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:55.469293 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc3eba-9a53-4bf5-a931-055916d232ca admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:55.470059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc3eba-9a53-4bf5-a931-055916d232ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:55.471710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc3eba-9a53-4bf5-a931-055916d232ca admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:55.483097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1273/2534] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:55.487842 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5557af-9b68-47cc-8182-e6367863a359 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:55.498137 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5557af-9b68-47cc-8182-e6367863a359 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:55.506056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d64b4-6e11-4e5b-8a60-5c3ab7d5cb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:55.506783 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d64b4-6e11-4e5b-8a60-5c3ab7d5cb8d admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:55.507072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d64b4-6e11-4e5b-8a60-5c3ab7d5cb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:55.507351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d64b4-6e11-4e5b-8a60-5c3ab7d5cb8d admin admin] PATH_INFO: `/v3/projects/208a30a9ea3f438585c0ccc6ff51b102/users/6cc1caee36634ee2850f57ac052d95c4/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:55.523669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d64b4-6e11-4e5b-8a60-5c3ab7d5cb8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=208a30a9ea3f438585c0ccc6ff51b102, user_id=6cc1caee36634ee2850f57ac052d95c4, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:55.526982 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d64b4-6e11-4e5b-8a60-5c3ab7d5cb8d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:55.540495 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1262/2535] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:55 2022] PUT /identity/v3/projects/208a30a9ea3f438585c0ccc6ff51b102/users/6cc1caee36634ee2850f57ac052d95c4/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:55.552764 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d59f40-60ba-4f5f-93ad-dc632b5bd575 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:55.553054 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d59f40-60ba-4f5f-93ad-dc632b5bd575 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:55.553336 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d59f40-60ba-4f5f-93ad-dc632b5bd575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:55.582735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c3d59f40-60ba-4f5f-93ad-dc632b5bd575 None None] MFA Rules not processed for user `6cc1caee36634ee2850f57ac052d95c4`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:55.583969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c3d59f40-60ba-4f5f-93ad-dc632b5bd575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:55.631824 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:55.656244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1274/2536] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:55.660794 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d64b4-6e11-4e5b-8a60-5c3ab7d5cb8d admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:55.723756 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d64b4-6e11-4e5b-8a60-5c3ab7d5cb8d admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:55.729069 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bf8d6-a690-432b-9f0f-13243cdc1b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:55.729672 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bf8d6-a690-432b-9f0f-13243cdc1b05 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:55.729952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bf8d6-a690-432b-9f0f-13243cdc1b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:55.730221 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bf8d6-a690-432b-9f0f-13243cdc1b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:55.730894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bf8d6-a690-432b-9f0f-13243cdc1b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:55.732848 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bf8d6-a690-432b-9f0f-13243cdc1b05 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:55.758305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1263/2537] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:40:55 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:55.762959 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d59f40-60ba-4f5f-93ad-dc632b5bd575 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:55.773624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d59f40-60ba-4f5f-93ad-dc632b5bd575 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:55.842161 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e4ffb-5d60-4594-8ddf-3fa3e354f8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:55.842807 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e4ffb-5d60-4594-8ddf-3fa3e354f8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:55.843089 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e4ffb-5d60-4594-8ddf-3fa3e354f8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:55.843429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e4ffb-5d60-4594-8ddf-3fa3e354f8d4 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:55.844019 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e4ffb-5d60-4594-8ddf-3fa3e354f8d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:55.846048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e4ffb-5d60-4594-8ddf-3fa3e354f8d4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:55.869377 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1275/2538] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:40:55 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:40:55.873563 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bf8d6-a690-432b-9f0f-13243cdc1b05 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:55.884138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bf8d6-a690-432b-9f0f-13243cdc1b05 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:55.889495 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65c18d-8d73-48ff-b695-96dcacc68037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:55.890211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65c18d-8d73-48ff-b695-96dcacc68037 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:55.890495 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65c18d-8d73-48ff-b695-96dcacc68037 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:55.890796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65c18d-8d73-48ff-b695-96dcacc68037 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:55.891442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65c18d-8d73-48ff-b695-96dcacc68037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:55.893055 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65c18d-8d73-48ff-b695-96dcacc68037 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:55.910236 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1264/2539] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:55.915053 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e4ffb-5d60-4594-8ddf-3fa3e354f8d4 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:55.925470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e4ffb-5d60-4594-8ddf-3fa3e354f8d4 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:55.931724 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068eca1-e666-4de7-b46f-aedd95ac4eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:55.932590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068eca1-e666-4de7-b46f-aedd95ac4eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:55.933031 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068eca1-e666-4de7-b46f-aedd95ac4eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:55.933283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068eca1-e666-4de7-b46f-aedd95ac4eb6 admin admin] PATH_INFO: `/v3/projects/a6dba33460284c34b2cf137cf3e7e69f/users/3f8c738d56fe454a8f5101816a23586d/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:55.950321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068eca1-e666-4de7-b46f-aedd95ac4eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6dba33460284c34b2cf137cf3e7e69f, user_id=3f8c738d56fe454a8f5101816a23586d, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:55.952994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068eca1-e666-4de7-b46f-aedd95ac4eb6 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:55.967444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1276/2540] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:55 2022] PUT /identity/v3/projects/a6dba33460284c34b2cf137cf3e7e69f/users/3f8c738d56fe454a8f5101816a23586d/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:55.971705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65c18d-8d73-48ff-b695-96dcacc68037 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:55.982151 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65c18d-8d73-48ff-b695-96dcacc68037 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:55.986974 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:56.041324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0243cd2-3a27-4f87-bee3-f498539e2da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:56.042000 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0243cd2-3a27-4f87-bee3-f498539e2da3 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:56.042275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0243cd2-3a27-4f87-bee3-f498539e2da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:56.042636 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0243cd2-3a27-4f87-bee3-f498539e2da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:56.043383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0243cd2-3a27-4f87-bee3-f498539e2da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:56.045279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0243cd2-3a27-4f87-bee3-f498539e2da3 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:56.060039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1265/2541] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:56.064301 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068eca1-e666-4de7-b46f-aedd95ac4eb6 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:56.080367 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068eca1-e666-4de7-b46f-aedd95ac4eb6 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:56.085122 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436b5d9-8640-4d42-8a8d-a52a501a2d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:56.085780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436b5d9-8640-4d42-8a8d-a52a501a2d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:56.086075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436b5d9-8640-4d42-8a8d-a52a501a2d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:56.086338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436b5d9-8640-4d42-8a8d-a52a501a2d28 admin admin] PATH_INFO: `/v3/projects/a6dba33460284c34b2cf137cf3e7e69f/users/3f8c738d56fe454a8f5101816a23586d/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:56.088960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436b5d9-8640-4d42-8a8d-a52a501a2d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6dba33460284c34b2cf137cf3e7e69f, user_id=3f8c738d56fe454a8f5101816a23586d, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:56.091727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436b5d9-8640-4d42-8a8d-a52a501a2d28 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:56.102755 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1277/2542] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:56 2022] PUT /identity/v3/projects/a6dba33460284c34b2cf137cf3e7e69f/users/3f8c738d56fe454a8f5101816a23586d/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:40:56.112962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34073-151e-4588-ae1f-e19e03a38be8 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:56.113250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34073-151e-4588-ae1f-e19e03a38be8 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:56.113523 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34073-151e-4588-ae1f-e19e03a38be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:56.144173 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-9fe34073-151e-4588-ae1f-e19e03a38be8 None None] MFA Rules not processed for user `3f8c738d56fe454a8f5101816a23586d`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:56.145319 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-9fe34073-151e-4588-ae1f-e19e03a38be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:56.221340 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1266/2543] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:56.233745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436b5d9-8640-4d42-8a8d-a52a501a2d28 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:56.235554 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1436b5d9-8640-4d42-8a8d-a52a501a2d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:56.306940 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436b5d9-8640-4d42-8a8d-a52a501a2d28 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:56.311460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f55b9e-285c-4116-a0f0-d39de2a87b62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:56.312300 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f55b9e-285c-4116-a0f0-d39de2a87b62 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:56.312559 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f55b9e-285c-4116-a0f0-d39de2a87b62 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:56.312833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f55b9e-285c-4116-a0f0-d39de2a87b62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:56.323430 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f55b9e-285c-4116-a0f0-d39de2a87b62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:56.324879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f55b9e-285c-4116-a0f0-d39de2a87b62 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:56.338234 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1278/2544] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:40:56.365775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe34073-151e-4588-ae1f-e19e03a38be8 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:56.429804 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe34073-151e-4588-ae1f-e19e03a38be8 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:56.435672 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:56.436305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:56.436583 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:56.436852 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] PATH_INFO: `/v3/users/6cc1caee36634ee2850f57ac052d95c4` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:56.437983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc1caee36634ee2850f57ac052d95c4)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:56.440157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:56.479005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:56.493697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc1caee36634ee2850f57ac052d95c4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:56.494876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc1caee36634ee2850f57ac052d95c4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:56.502128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc1caee36634ee2850f57ac052d95c4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:56.502780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc1caee36634ee2850f57ac052d95c4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:56.519595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc1caee36634ee2850f57ac052d95c4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:56.531587 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1267/2545] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:40:56 2022] DELETE /identity/v3/users/6cc1caee36634ee2850f57ac052d95c4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:56.537441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4ffef-467e-4906-9f6d-163101dd504f None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:56.537718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4ffef-467e-4906-9f6d-163101dd504f None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:56.538009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4ffef-467e-4906-9f6d-163101dd504f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:56.568603 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f8a4ffef-467e-4906-9f6d-163101dd504f None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:56.569831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f8a4ffef-467e-4906-9f6d-163101dd504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:56.613282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:56.652294 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1279/2546] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:56.659006 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:56.660603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:56.720550 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb20f03-396d-4d14-b09b-af1e2e7c66e5 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:56.724245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f8e23-9dd0-41f5-b3ad-e43a126615c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:56.724854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8e23-9dd0-41f5-b3ad-e43a126615c3 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:56.725132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8e23-9dd0-41f5-b3ad-e43a126615c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:56.725406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8e23-9dd0-41f5-b3ad-e43a126615c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:56.734845 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f8e23-9dd0-41f5-b3ad-e43a126615c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:56.736286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f8e23-9dd0-41f5-b3ad-e43a126615c3 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:56.746217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1268/2547] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:57.023157 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4ffef-467e-4906-9f6d-163101dd504f None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:57.024626 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f8a4ffef-467e-4906-9f6d-163101dd504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:57.037777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4ffef-467e-4906-9f6d-163101dd504f None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:57.043505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:57.044155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:57.044420 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:57.044694 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] PATH_INFO: `/v3/projects/208a30a9ea3f438585c0ccc6ff51b102` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:57.045833 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=208a30a9ea3f438585c0ccc6ff51b102)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:57.047775 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:57.096888 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208a30a9ea3f438585c0ccc6ff51b102', 'request_id': 'req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.102624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208a30a9ea3f438585c0ccc6ff51b102', 'request_id': 'req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.111148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208a30a9ea3f438585c0ccc6ff51b102', 'request_id': 'req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.122194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] The token cache is being invalidate because project 208a30a9ea3f438585c0ccc6ff51b102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:40:57.122480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.123140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.124625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1280/2548] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:40:57 2022] DELETE /identity/v3/projects/208a30a9ea3f438585c0ccc6ff51b102 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:57.128628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f8e23-9dd0-41f5-b3ad-e43a126615c3 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:57.138377 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f8e23-9dd0-41f5-b3ad-e43a126615c3 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:57.195635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346109f7-7aa0-451a-80eb-e7371f715505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:57.196304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346109f7-7aa0-451a-80eb-e7371f715505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:57.196611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346109f7-7aa0-451a-80eb-e7371f715505 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:57.196901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346109f7-7aa0-451a-80eb-e7371f715505 admin admin] PATH_INFO: `/v3/users/3f8c738d56fe454a8f5101816a23586d` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:57.198225 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346109f7-7aa0-451a-80eb-e7371f715505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8c738d56fe454a8f5101816a23586d)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:57.200317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346109f7-7aa0-451a-80eb-e7371f715505 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:57.246854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-346109f7-7aa0-451a-80eb-e7371f715505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8c738d56fe454a8f5101816a23586d'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.247502 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-346109f7-7aa0-451a-80eb-e7371f715505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8c738d56fe454a8f5101816a23586d'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.254633 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-346109f7-7aa0-451a-80eb-e7371f715505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8c738d56fe454a8f5101816a23586d'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.255234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-346109f7-7aa0-451a-80eb-e7371f715505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8c738d56fe454a8f5101816a23586d'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.256353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:57.269099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-346109f7-7aa0-451a-80eb-e7371f715505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8c738d56fe454a8f5101816a23586d'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.281761 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1269/2549] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:40:57 2022] DELETE /identity/v3/users/3f8c738d56fe454a8f5101816a23586d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:57.551976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:57.553461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:57.568211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b8273-a8f9-4c9e-aa91-8b98acfb20a3 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:57.626336 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:57.626990 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:57.627266 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:57.627533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d admin admin] PATH_INFO: `/v3/projects/a6dba33460284c34b2cf137cf3e7e69f` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:57.628635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6dba33460284c34b2cf137cf3e7e69f)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:57.630533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:57.676631 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6dba33460284c34b2cf137cf3e7e69f', 'request_id': 'req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.682656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6dba33460284c34b2cf137cf3e7e69f', 'request_id': 'req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.686112 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:57.690985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6dba33460284c34b2cf137cf3e7e69f', 'request_id': 'req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.703697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d admin admin] The token cache is being invalidate because project a6dba33460284c34b2cf137cf3e7e69f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:40:57.704250 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.704902 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f0c738c9-05aa-4cbf-a858-3de74ba1ec3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:40:57.706375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1281/2550] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:40:57 2022] DELETE /identity/v3/projects/a6dba33460284c34b2cf137cf3e7e69f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:57.711438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b11cae-ad18-4739-bfcb-9c34ac6e4cd1 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:57.711733 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b11cae-ad18-4739-bfcb-9c34ac6e4cd1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:57.712009 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b11cae-ad18-4739-bfcb-9c34ac6e4cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:57.732546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-37b11cae-ad18-4739-bfcb-9c34ac6e4cd1 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:57.733769 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-37b11cae-ad18-4739-bfcb-9c34ac6e4cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:57.803025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1270/2551] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:57.812877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e3bf-1d14-4ad1-abf7-a0c3552bf314 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:57.813169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e3bf-1d14-4ad1-abf7-a0c3552bf314 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:57.813469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e3bf-1d14-4ad1-abf7-a0c3552bf314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:57.835099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-30c5e3bf-1d14-4ad1-abf7-a0c3552bf314 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:57.836354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-30c5e3bf-1d14-4ad1-abf7-a0c3552bf314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:57.844354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1282/2552] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:57.848492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b11cae-ad18-4739-bfcb-9c34ac6e4cd1 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:57.858207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b11cae-ad18-4739-bfcb-9c34ac6e4cd1 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:57.863012 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f7105-b7b9-43dd-88b0-f284b22ae6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:57.863608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f7105-b7b9-43dd-88b0-f284b22ae6fc admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:57.863885 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f7105-b7b9-43dd-88b0-f284b22ae6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:57.864153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f7105-b7b9-43dd-88b0-f284b22ae6fc admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:57.864791 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f7105-b7b9-43dd-88b0-f284b22ae6fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:40:57.865091 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f7105-b7b9-43dd-88b0-f284b22ae6fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:57.866708 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f7105-b7b9-43dd-88b0-f284b22ae6fc admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:57.883774 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1271/2553] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:40:57.888671 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5e3bf-1d14-4ad1-abf7-a0c3552bf314 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:57.897923 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5e3bf-1d14-4ad1-abf7-a0c3552bf314 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:57.902931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704ecf1-c422-4921-98ba-13952f2cb316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:57.903536 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704ecf1-c422-4921-98ba-13952f2cb316 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:57.903815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704ecf1-c422-4921-98ba-13952f2cb316 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:57.904086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704ecf1-c422-4921-98ba-13952f2cb316 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:57.904743 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704ecf1-c422-4921-98ba-13952f2cb316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:57.906675 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704ecf1-c422-4921-98ba-13952f2cb316 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:57.939705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1283/2554] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:40:57 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:40:57.941486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f7105-b7b9-43dd-88b0-f284b22ae6fc admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:57.953707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f7105-b7b9-43dd-88b0-f284b22ae6fc admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:58.012699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc1fc5-6b2e-4720-a9d9-e968a66738eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:58.013228 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1fc5-6b2e-4720-a9d9-e968a66738eb admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:58.013509 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1fc5-6b2e-4720-a9d9-e968a66738eb admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:58.013778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1fc5-6b2e-4720-a9d9-e968a66738eb admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:58.014416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc1fc5-6b2e-4720-a9d9-e968a66738eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:58.016384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc1fc5-6b2e-4720-a9d9-e968a66738eb admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:58.039841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1272/2555] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:40:57 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:40:58.041757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704ecf1-c422-4921-98ba-13952f2cb316 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:58.052398 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704ecf1-c422-4921-98ba-13952f2cb316 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:58.058337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaf961-8a6d-4ffb-9b24-e9139c2b976c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:58.059050 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaf961-8a6d-4ffb-9b24-e9139c2b976c admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:58.059335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaf961-8a6d-4ffb-9b24-e9139c2b976c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:58.059600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaf961-8a6d-4ffb-9b24-e9139c2b976c admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:58.060236 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaf961-8a6d-4ffb-9b24-e9139c2b976c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:58.061813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaf961-8a6d-4ffb-9b24-e9139c2b976c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:58.072018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1284/2556] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:58.076663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc1fc5-6b2e-4720-a9d9-e968a66738eb admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:58.086896 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc1fc5-6b2e-4720-a9d9-e968a66738eb admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:58.091536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e6f2a-8628-49ab-8ca1-b658a9829afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:58.092128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e6f2a-8628-49ab-8ca1-b658a9829afe admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:58.092406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e6f2a-8628-49ab-8ca1-b658a9829afe admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:58.092676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e6f2a-8628-49ab-8ca1-b658a9829afe admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:58.093304 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e6f2a-8628-49ab-8ca1-b658a9829afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:58.094938 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e6f2a-8628-49ab-8ca1-b658a9829afe admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:58.105801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1273/2557] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:58.109766 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaf961-8a6d-4ffb-9b24-e9139c2b976c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:58.120203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaf961-8a6d-4ffb-9b24-e9139c2b976c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:58.124725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf2df6-32c1-471a-9592-e469524d9c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:58.125356 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf2df6-32c1-471a-9592-e469524d9c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:58.125692 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf2df6-32c1-471a-9592-e469524d9c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:58.125960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf2df6-32c1-471a-9592-e469524d9c21 admin admin] PATH_INFO: `/v3/projects/a5412c7b7d2e44d4bf5290424ba2fd01/users/d879837b419a4b16967009e2c3b28ccc/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:58.142551 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf2df6-32c1-471a-9592-e469524d9c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5412c7b7d2e44d4bf5290424ba2fd01, user_id=d879837b419a4b16967009e2c3b28ccc, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:58.145173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf2df6-32c1-471a-9592-e469524d9c21 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:58.158710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1285/2558] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:58 2022] PUT /identity/v3/projects/a5412c7b7d2e44d4bf5290424ba2fd01/users/d879837b419a4b16967009e2c3b28ccc/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:58.163670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfd1b6-7a29-4f3a-a552-a1247a36c593 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:58.164119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfd1b6-7a29-4f3a-a552-a1247a36c593 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:58.164215 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfd1b6-7a29-4f3a-a552-a1247a36c593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:58.184057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-c8cfd1b6-7a29-4f3a-a552-a1247a36c593 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:58.185278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c8cfd1b6-7a29-4f3a-a552-a1247a36c593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:58.223081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:58.268565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1274/2559] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:40:58.279208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf2df6-32c1-471a-9592-e469524d9c21 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:58.280939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-00bf2df6-32c1-471a-9592-e469524d9c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:58.340720 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf2df6-32c1-471a-9592-e469524d9c21 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:58.344642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ff18-68dc-4d2f-bbd4-c304b0a1c12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:58.345305 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ff18-68dc-4d2f-bbd4-c304b0a1c12b service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:58.345582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ff18-68dc-4d2f-bbd4-c304b0a1c12b service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:58.345896 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ff18-68dc-4d2f-bbd4-c304b0a1c12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:58.357730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080ff18-68dc-4d2f-bbd4-c304b0a1c12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:58.359325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080ff18-68dc-4d2f-bbd4-c304b0a1c12b service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:58.369276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1286/2560] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:40:58.990449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219a5c3-06d7-4003-b446-b1a5727d240b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:58.990890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219a5c3-06d7-4003-b446-b1a5727d240b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:58.991239 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219a5c3-06d7-4003-b446-b1a5727d240b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:59.023715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b219a5c3-06d7-4003-b446-b1a5727d240b None None] MFA Rules not processed for user `d879837b419a4b16967009e2c3b28ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:40:59.025321 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b219a5c3-06d7-4003-b446-b1a5727d240b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:40:59.132175 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1275/2561] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:40:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:40:59.136812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ff18-68dc-4d2f-bbd4-c304b0a1c12b service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:59.146626 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ff18-68dc-4d2f-bbd4-c304b0a1c12b service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:59.152238 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5fc58-3379-4efd-ac57-1df971f7e82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:59.152869 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5fc58-3379-4efd-ac57-1df971f7e82b admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:59.153231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5fc58-3379-4efd-ac57-1df971f7e82b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:59.153506 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5fc58-3379-4efd-ac57-1df971f7e82b admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:59.154136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5fc58-3379-4efd-ac57-1df971f7e82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:59.156059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5fc58-3379-4efd-ac57-1df971f7e82b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:59.186326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1287/2562] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:40:59 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:40:59.187520 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219a5c3-06d7-4003-b446-b1a5727d240b None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:59.198417 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219a5c3-06d7-4003-b446-b1a5727d240b None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:59.255719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b435c-2e23-4816-baef-9bd35cc3d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:59.256362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b435c-2e23-4816-baef-9bd35cc3d8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:59.256638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b435c-2e23-4816-baef-9bd35cc3d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:59.256906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b435c-2e23-4816-baef-9bd35cc3d8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:59.257574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b435c-2e23-4816-baef-9bd35cc3d8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:59.259564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b435c-2e23-4816-baef-9bd35cc3d8c1 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:59.280473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1276/2563] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:40:59 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:40:59.284805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5fc58-3379-4efd-ac57-1df971f7e82b admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:59.296883 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5fc58-3379-4efd-ac57-1df971f7e82b admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:59.302426 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35014ea1-b198-48ac-94e7-496d40592553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:59.303056 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35014ea1-b198-48ac-94e7-496d40592553 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:59.303366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35014ea1-b198-48ac-94e7-496d40592553 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:59.303642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35014ea1-b198-48ac-94e7-496d40592553 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:59.304284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35014ea1-b198-48ac-94e7-496d40592553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:59.305872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35014ea1-b198-48ac-94e7-496d40592553 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:59.316487 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1288/2564] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:59.320763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b435c-2e23-4816-baef-9bd35cc3d8c1 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:59.330906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b435c-2e23-4816-baef-9bd35cc3d8c1 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:59.335440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bebd5-4eba-4ec2-bbba-f89cc4e41a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:59.336075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bebd5-4eba-4ec2-bbba-f89cc4e41a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:59.336353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bebd5-4eba-4ec2-bbba-f89cc4e41a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:59.336622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bebd5-4eba-4ec2-bbba-f89cc4e41a40 admin admin] PATH_INFO: `/v3/projects/807b0ca45d65483c95ef640fb03f7851/users/cb3b222dc17d48faa301bde45d79b793/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:59.351383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bebd5-4eba-4ec2-bbba-f89cc4e41a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807b0ca45d65483c95ef640fb03f7851, user_id=cb3b222dc17d48faa301bde45d79b793, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:59.354758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bebd5-4eba-4ec2-bbba-f89cc4e41a40 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:59.367358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1277/2565] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:59 2022] PUT /identity/v3/projects/807b0ca45d65483c95ef640fb03f7851/users/cb3b222dc17d48faa301bde45d79b793/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:40:59.371252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35014ea1-b198-48ac-94e7-496d40592553 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:59.381410 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35014ea1-b198-48ac-94e7-496d40592553 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:59.432492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:40:59.439460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512f947-d9e1-4a8d-8555-2822b48f4474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:59.440093 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512f947-d9e1-4a8d-8555-2822b48f4474 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:59.440538 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512f947-d9e1-4a8d-8555-2822b48f4474 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:59.440832 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512f947-d9e1-4a8d-8555-2822b48f4474 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:59.441507 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512f947-d9e1-4a8d-8555-2822b48f4474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:59.443127 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512f947-d9e1-4a8d-8555-2822b48f4474 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:59.452749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1289/2566] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:40:59.457119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bebd5-4eba-4ec2-bbba-f89cc4e41a40 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:40:59.468040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bebd5-4eba-4ec2-bbba-f89cc4e41a40 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:40:59.472695 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f468cd0-8e5d-4bbf-b2fb-b7bb6cefe02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:40:59.473332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f468cd0-8e5d-4bbf-b2fb-b7bb6cefe02c admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:40:59.473607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f468cd0-8e5d-4bbf-b2fb-b7bb6cefe02c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:40:59.473932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f468cd0-8e5d-4bbf-b2fb-b7bb6cefe02c admin admin] PATH_INFO: `/v3/projects/807b0ca45d65483c95ef640fb03f7851/users/cb3b222dc17d48faa301bde45d79b793/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:40:59.475901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f468cd0-8e5d-4bbf-b2fb-b7bb6cefe02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=807b0ca45d65483c95ef640fb03f7851, user_id=cb3b222dc17d48faa301bde45d79b793, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:40:59.479163 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f468cd0-8e5d-4bbf-b2fb-b7bb6cefe02c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:40:59.489047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1278/2567] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:40:59 2022] PUT /identity/v3/projects/807b0ca45d65483c95ef640fb03f7851/users/cb3b222dc17d48faa301bde45d79b793/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:00.098717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb780-bba1-4218-ab0c-a93cd4d23e27 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:00.099190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb780-bba1-4218-ab0c-a93cd4d23e27 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:00.099564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb780-bba1-4218-ab0c-a93cd4d23e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:00.140776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-ae5eb780-bba1-4218-ab0c-a93cd4d23e27 None None] MFA Rules not processed for user `cb3b222dc17d48faa301bde45d79b793`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:00.142015 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ae5eb780-bba1-4218-ab0c-a93cd4d23e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:00.223443 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f468cd0-8e5d-4bbf-b2fb-b7bb6cefe02c admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:00.231054 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1290/2568] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:00.242487 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bebbe-703e-42da-96d3-d30f139acda4 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:00.242825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bebbe-703e-42da-96d3-d30f139acda4 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:00.243119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bebbe-703e-42da-96d3-d30f139acda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:00.254368 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:00.264441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-9d5bebbe-703e-42da-96d3-d30f139acda4 None None] MFA Rules not processed for user `d879837b419a4b16967009e2c3b28ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:00.265782 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9d5bebbe-703e-42da-96d3-d30f139acda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:00.296302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f468cd0-8e5d-4bbf-b2fb-b7bb6cefe02c admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:00.301054 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d8b59-2888-49d7-99d8-b2557f153957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:00.301677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d8b59-2888-49d7-99d8-b2557f153957 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:00.301957 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d8b59-2888-49d7-99d8-b2557f153957 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:00.302232 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d8b59-2888-49d7-99d8-b2557f153957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:00.305509 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5c3d8b59-2888-49d7-99d8-b2557f153957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:00.325872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1291/2569] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:00.336595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bebbe-703e-42da-96d3-d30f139acda4 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:00.338090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9d5bebbe-703e-42da-96d3-d30f139acda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:00.373645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d8b59-2888-49d7-99d8-b2557f153957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:00.375149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d8b59-2888-49d7-99d8-b2557f153957 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:00.384972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1279/2570] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:00.413483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bebbe-703e-42da-96d3-d30f139acda4 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:00.419549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035db905-bb8c-476b-9bcd-8afd26264cb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:00.420157 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035db905-bb8c-476b-9bcd-8afd26264cb3 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:00.420435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035db905-bb8c-476b-9bcd-8afd26264cb3 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:00.420709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035db905-bb8c-476b-9bcd-8afd26264cb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:00.428808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035db905-bb8c-476b-9bcd-8afd26264cb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:00.430539 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035db905-bb8c-476b-9bcd-8afd26264cb3 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:00.440654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1292/2571] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:41:00.671194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d8b59-2888-49d7-99d8-b2557f153957 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:00.672628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5c3d8b59-2888-49d7-99d8-b2557f153957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:00.683504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d8b59-2888-49d7-99d8-b2557f153957 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:00.687057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381391a-95ad-407e-94ee-3cbc2b6c60fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:00.687654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381391a-95ad-407e-94ee-3cbc2b6c60fa service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:00.687933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381391a-95ad-407e-94ee-3cbc2b6c60fa service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:00.688203 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381391a-95ad-407e-94ee-3cbc2b6c60fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:00.689935 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8381391a-95ad-407e-94ee-3cbc2b6c60fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:00.700171 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381391a-95ad-407e-94ee-3cbc2b6c60fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:00.701893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381391a-95ad-407e-94ee-3cbc2b6c60fa service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:00.710891 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1280/2572] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:03.865421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035db905-bb8c-476b-9bcd-8afd26264cb3 service nova] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:03.867021 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-035db905-bb8c-476b-9bcd-8afd26264cb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:03.881641 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035db905-bb8c-476b-9bcd-8afd26264cb3 service nova] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:03.887909 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61aa78-4a70-45c5-9627-931d55c5f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:03.888792 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61aa78-4a70-45c5-9627-931d55c5f506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:03.889068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61aa78-4a70-45c5-9627-931d55c5f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:03.889337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61aa78-4a70-45c5-9627-931d55c5f506 admin admin] PATH_INFO: `/v3/users/7d6f98709d8443bebe278a78499c8b3a` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:03.890482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61aa78-4a70-45c5-9627-931d55c5f506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d6f98709d8443bebe278a78499c8b3a)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:03.892628 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61aa78-4a70-45c5-9627-931d55c5f506 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:03.896068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:03.951994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1d61aa78-4a70-45c5-9627-931d55c5f506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d6f98709d8443bebe278a78499c8b3a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:03.952670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1d61aa78-4a70-45c5-9627-931d55c5f506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d6f98709d8443bebe278a78499c8b3a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:03.961264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1d61aa78-4a70-45c5-9627-931d55c5f506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d6f98709d8443bebe278a78499c8b3a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:03.969794 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1d61aa78-4a70-45c5-9627-931d55c5f506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d6f98709d8443bebe278a78499c8b3a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:03.971797 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1d61aa78-4a70-45c5-9627-931d55c5f506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d6f98709d8443bebe278a78499c8b3a'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:04.000045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1293/2573] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:03 2022] DELETE /identity/v3/users/7d6f98709d8443bebe278a78499c8b3a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:04.204702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381391a-95ad-407e-94ee-3cbc2b6c60fa service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:04.223645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381391a-95ad-407e-94ee-3cbc2b6c60fa service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:04.288055 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306e370-188d-4f21-bd2b-0fb173845f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:04.288692 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e370-188d-4f21-bd2b-0fb173845f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:04.288967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e370-188d-4f21-bd2b-0fb173845f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:04.289238 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e370-188d-4f21-bd2b-0fb173845f1d admin admin] PATH_INFO: `/v3/projects/0a6263d07b2b4b35b4abdb76a22c24be` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:04.290372 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306e370-188d-4f21-bd2b-0fb173845f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6263d07b2b4b35b4abdb76a22c24be)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:04.292369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306e370-188d-4f21-bd2b-0fb173845f1d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:04.342020 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f306e370-188d-4f21-bd2b-0fb173845f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6263d07b2b4b35b4abdb76a22c24be', 'request_id': 'req-f306e370-188d-4f21-bd2b-0fb173845f1d'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:04.347818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f306e370-188d-4f21-bd2b-0fb173845f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6263d07b2b4b35b4abdb76a22c24be', 'request_id': 'req-f306e370-188d-4f21-bd2b-0fb173845f1d'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:04.352675 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:04.356391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f306e370-188d-4f21-bd2b-0fb173845f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6263d07b2b4b35b4abdb76a22c24be', 'request_id': 'req-f306e370-188d-4f21-bd2b-0fb173845f1d'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:04.368986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f306e370-188d-4f21-bd2b-0fb173845f1d admin admin] The token cache is being invalidate because project 0a6263d07b2b4b35b4abdb76a22c24be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:04.369487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f306e370-188d-4f21-bd2b-0fb173845f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:04.370127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f306e370-188d-4f21-bd2b-0fb173845f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:04.371642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1281/2574] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:04 2022] DELETE /identity/v3/projects/0a6263d07b2b4b35b4abdb76a22c24be => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:04.376884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d139d6-169c-4687-ad38-e42fa4338c10 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:04.377243 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d139d6-169c-4687-ad38-e42fa4338c10 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:04.377586 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d139d6-169c-4687-ad38-e42fa4338c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:04.398184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c2d139d6-169c-4687-ad38-e42fa4338c10 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:04.399545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c2d139d6-169c-4687-ad38-e42fa4338c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:04.452326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3049902-4033-4d4a-b6d9-f6bf00521ea1 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:04.452832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3049902-4033-4d4a-b6d9-f6bf00521ea1 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:04.453197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3049902-4033-4d4a-b6d9-f6bf00521ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:04.463849 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1294/2575] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:04.476482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a671057-1871-4757-a531-312ad7858966 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:04.476482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a671057-1871-4757-a531-312ad7858966 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:04.476718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a671057-1871-4757-a531-312ad7858966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:04.477500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-c3049902-4033-4d4a-b6d9-f6bf00521ea1 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:04.478986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c3049902-4033-4d4a-b6d9-f6bf00521ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:04.492722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1282/2576] 10.222.0.16 () {58 vars in 1016 bytes} [Fri Sep 16 05:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:04.503366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8a671057-1871-4757-a531-312ad7858966 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:04.504652 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8a671057-1871-4757-a531-312ad7858966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:04.518408 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1295/2577] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:04.522877 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3049902-4033-4d4a-b6d9-f6bf00521ea1 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:04.523772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a671057-1871-4757-a531-312ad7858966 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:04.525282 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8a671057-1871-4757-a531-312ad7858966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:04.535365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3049902-4033-4d4a-b6d9-f6bf00521ea1 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:04.542762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ff173-5c3d-40e9-8a4f-7ec92692d188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:04.543993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ff173-5c3d-40e9-8a4f-7ec92692d188 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:04.544475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ff173-5c3d-40e9-8a4f-7ec92692d188 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:04.544945 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ff173-5c3d-40e9-8a4f-7ec92692d188 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:04.546488 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ff173-5c3d-40e9-8a4f-7ec92692d188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:04.547021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ff173-5c3d-40e9-8a4f-7ec92692d188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:04.549326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ff173-5c3d-40e9-8a4f-7ec92692d188 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:04.570208 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1283/2578] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:41:04.571266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ff173-5c3d-40e9-8a4f-7ec92692d188 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:04.584553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ff173-5c3d-40e9-8a4f-7ec92692d188 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:04.591552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cfd83-ab11-4efc-a93a-cfcabe4bad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:04.592130 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cfd83-ab11-4efc-a93a-cfcabe4bad50 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:04.592414 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cfd83-ab11-4efc-a93a-cfcabe4bad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:04.592687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cfd83-ab11-4efc-a93a-cfcabe4bad50 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:04.593614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cfd83-ab11-4efc-a93a-cfcabe4bad50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:04.595853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cfd83-ab11-4efc-a93a-cfcabe4bad50 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:04.632257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a671057-1871-4757-a531-312ad7858966 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:04.641120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1284/2579] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:04 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:04.641324 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e9bf9-1ede-4907-a268-64bb4f50e7fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:04.641324 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9bf9-1ede-4907-a268-64bb4f50e7fd service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:04.641515 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9bf9-1ede-4907-a268-64bb4f50e7fd service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:04.642010 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9bf9-1ede-4907-a268-64bb4f50e7fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:04.644062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cfd83-ab11-4efc-a93a-cfcabe4bad50 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:04.650854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e9bf9-1ede-4907-a268-64bb4f50e7fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:04.652555 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e9bf9-1ede-4907-a268-64bb4f50e7fd service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:04.658149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:04.663944 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1296/2580] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:41:04.734829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cfd83-ab11-4efc-a93a-cfcabe4bad50 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:04.739987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c489f01-8635-45a4-9ce8-52eb730c4427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:04.740595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c489f01-8635-45a4-9ce8-52eb730c4427 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:04.740870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c489f01-8635-45a4-9ce8-52eb730c4427 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:04.741614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c489f01-8635-45a4-9ce8-52eb730c4427 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:04.741888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c489f01-8635-45a4-9ce8-52eb730c4427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:04.744413 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c489f01-8635-45a4-9ce8-52eb730c4427 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:04.769794 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1285/2581] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:04 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:04.773949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e9bf9-1ede-4907-a268-64bb4f50e7fd service nova] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:04.783823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e9bf9-1ede-4907-a268-64bb4f50e7fd service nova] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:04.788585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4007d53-5e47-4f9c-8986-777cc91e6e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:04.789180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4007d53-5e47-4f9c-8986-777cc91e6e4c admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:04.789463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4007d53-5e47-4f9c-8986-777cc91e6e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:04.790004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4007d53-5e47-4f9c-8986-777cc91e6e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:04.790365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4007d53-5e47-4f9c-8986-777cc91e6e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:04.792518 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4007d53-5e47-4f9c-8986-777cc91e6e4c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:04.803346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1297/2582] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:04.808116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c489f01-8635-45a4-9ce8-52eb730c4427 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:04.820275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c489f01-8635-45a4-9ce8-52eb730c4427 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:04.825907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732dab31-e242-4328-8ae0-7b6d63c37974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:04.826560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dab31-e242-4328-8ae0-7b6d63c37974 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:04.826831 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dab31-e242-4328-8ae0-7b6d63c37974 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:04.827104 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dab31-e242-4328-8ae0-7b6d63c37974 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:04.827768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dab31-e242-4328-8ae0-7b6d63c37974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:04.829758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dab31-e242-4328-8ae0-7b6d63c37974 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:04.840903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1286/2583] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:04.844909 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4007d53-5e47-4f9c-8986-777cc91e6e4c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:04.856259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4007d53-5e47-4f9c-8986-777cc91e6e4c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:04.861275 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dd6ed-8dfb-461d-a8e3-0b909ab2c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:04.861989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dd6ed-8dfb-461d-a8e3-0b909ab2c73f admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:04.862271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dd6ed-8dfb-461d-a8e3-0b909ab2c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:04.862574 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dd6ed-8dfb-461d-a8e3-0b909ab2c73f admin admin] PATH_INFO: `/v3/projects/ac8ae8d9a84b41979ad6c5509910774e/users/b652f16186b5429aa99ad5bbe357aa18/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:04.884364 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dd6ed-8dfb-461d-a8e3-0b909ab2c73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8ae8d9a84b41979ad6c5509910774e, user_id=b652f16186b5429aa99ad5bbe357aa18, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:04.887208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dd6ed-8dfb-461d-a8e3-0b909ab2c73f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:04.902460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1298/2584] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:04 2022] PUT /identity/v3/projects/ac8ae8d9a84b41979ad6c5509910774e/users/b652f16186b5429aa99ad5bbe357aa18/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:04.913961 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fac66d-bc22-4552-9da4-3b9a918c8058 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:04.914256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fac66d-bc22-4552-9da4-3b9a918c8058 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:04.914539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fac66d-bc22-4552-9da4-3b9a918c8058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:04.944028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-66fac66d-bc22-4552-9da4-3b9a918c8058 None None] MFA Rules not processed for user `b652f16186b5429aa99ad5bbe357aa18`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:04.945303 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-66fac66d-bc22-4552-9da4-3b9a918c8058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:05.018428 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1287/2585] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:05.034315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dd6ed-8dfb-461d-a8e3-0b909ab2c73f admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:05.105029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dd6ed-8dfb-461d-a8e3-0b909ab2c73f admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:05.111710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ce933-74cf-4444-835b-239c8d6c49d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:05.112304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ce933-74cf-4444-835b-239c8d6c49d3 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:05.112580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ce933-74cf-4444-835b-239c8d6c49d3 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:05.112854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ce933-74cf-4444-835b-239c8d6c49d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:05.121250 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ce933-74cf-4444-835b-239c8d6c49d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:05.122869 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ce933-74cf-4444-835b-239c8d6c49d3 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:05.132284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1299/2586] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:07.515625 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5fea7-a881-4a8e-b13b-cade93681fed None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:07.516125 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5fea7-a881-4a8e-b13b-cade93681fed None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:07.516242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5fea7-a881-4a8e-b13b-cade93681fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:07.535182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-e5a5fea7-a881-4a8e-b13b-cade93681fed None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:07.536380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e5a5fea7-a881-4a8e-b13b-cade93681fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:07.544502 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:07.597618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1288/2587] 10.222.0.16 () {58 vars in 1016 bytes} [Fri Sep 16 05:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:07.619916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ce933-74cf-4444-835b-239c8d6c49d3 service nova] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:07.631206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ce933-74cf-4444-835b-239c8d6c49d3 service nova] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:07.637565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79700ffa-2a88-4288-9357-d5ce4f26e70b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:07.638159 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79700ffa-2a88-4288-9357-d5ce4f26e70b service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:07.638435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79700ffa-2a88-4288-9357-d5ce4f26e70b service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:07.638735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79700ffa-2a88-4288-9357-d5ce4f26e70b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:07.647001 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79700ffa-2a88-4288-9357-d5ce4f26e70b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:07.648553 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79700ffa-2a88-4288-9357-d5ce4f26e70b service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:07.657918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1300/2588] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:07.829248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5fea7-a881-4a8e-b13b-cade93681fed None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:07.836881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5fea7-a881-4a8e-b13b-cade93681fed None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:07.841378 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:07.841987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:07.842259 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:07.842538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] PATH_INFO: `/v3/users/b652f16186b5429aa99ad5bbe357aa18` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:07.843660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b652f16186b5429aa99ad5bbe357aa18)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:07.845571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:07.891369 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b652f16186b5429aa99ad5bbe357aa18'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:07.891948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b652f16186b5429aa99ad5bbe357aa18'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:07.899058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b652f16186b5429aa99ad5bbe357aa18'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:07.899666 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b652f16186b5429aa99ad5bbe357aa18'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:07.911243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b652f16186b5429aa99ad5bbe357aa18'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:07.923917 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1289/2589] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:07 2022] DELETE /identity/v3/users/b652f16186b5429aa99ad5bbe357aa18 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:07.928482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38724115-f3b8-456d-96b6-4d44bd3f0451 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:07.928763 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38724115-f3b8-456d-96b6-4d44bd3f0451 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:07.929028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38724115-f3b8-456d-96b6-4d44bd3f0451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:07.949632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-38724115-f3b8-456d-96b6-4d44bd3f0451 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:07.950850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-38724115-f3b8-456d-96b6-4d44bd3f0451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:08.009826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1301/2590] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:08.019549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:08.020936 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:08.077245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6a62f-d000-4676-b969-2ccdd36977b2 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:08.081156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b41d5c-d0c1-4496-b115-ffa5c6eaa708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:08.081753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b41d5c-d0c1-4496-b115-ffa5c6eaa708 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:08.082033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b41d5c-d0c1-4496-b115-ffa5c6eaa708 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:08.082301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b41d5c-d0c1-4496-b115-ffa5c6eaa708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:08.092100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b41d5c-d0c1-4496-b115-ffa5c6eaa708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:08.093531 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b41d5c-d0c1-4496-b115-ffa5c6eaa708 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:08.103807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1290/2591] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:08.384059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38724115-f3b8-456d-96b6-4d44bd3f0451 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:08.385585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-38724115-f3b8-456d-96b6-4d44bd3f0451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:08.409475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38724115-f3b8-456d-96b6-4d44bd3f0451 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:08.419979 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:08.422339 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:08.422812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:08.423475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7 admin admin] PATH_INFO: `/v3/projects/ac8ae8d9a84b41979ad6c5509910774e` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:08.439035 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8ae8d9a84b41979ad6c5509910774e)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:08.445315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:08.490141 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:08.506639 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8ae8d9a84b41979ad6c5509910774e', 'request_id': 'req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:08.513531 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8ae8d9a84b41979ad6c5509910774e', 'request_id': 'req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:08.522758 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8ae8d9a84b41979ad6c5509910774e', 'request_id': 'req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:08.536486 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7 admin admin] The token cache is being invalidate because project ac8ae8d9a84b41979ad6c5509910774e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:08.536804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:08.537513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3d4e4425-2f03-4495-bfe9-fcf27ec146f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:08.539151 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1302/2592] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:08 2022] DELETE /identity/v3/projects/ac8ae8d9a84b41979ad6c5509910774e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:08.544068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f14353-c6dd-496a-8a70-7a041cf2ad88 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:08.544565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f14353-c6dd-496a-8a70-7a041cf2ad88 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:08.544742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f14353-c6dd-496a-8a70-7a041cf2ad88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:08.564948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-20f14353-c6dd-496a-8a70-7a041cf2ad88 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:08.566275 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-20f14353-c6dd-496a-8a70-7a041cf2ad88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:08.594893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:08.632710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1291/2593] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:08.641534 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c58c6-53bc-4c72-8d65-855f64f2856d None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:08.642071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c58c6-53bc-4c72-8d65-855f64f2856d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:08.642071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c58c6-53bc-4c72-8d65-855f64f2856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:08.663832 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-9c1c58c6-53bc-4c72-8d65-855f64f2856d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:08.665152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9c1c58c6-53bc-4c72-8d65-855f64f2856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:08.673273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1303/2594] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:08.677476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f14353-c6dd-496a-8a70-7a041cf2ad88 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:08.688027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f14353-c6dd-496a-8a70-7a041cf2ad88 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:08.693683 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec30e7c-7f41-4a52-b967-20c4e6f08f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:08.694800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec30e7c-7f41-4a52-b967-20c4e6f08f75 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:08.694800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec30e7c-7f41-4a52-b967-20c4e6f08f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:08.695016 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec30e7c-7f41-4a52-b967-20c4e6f08f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:08.695526 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec30e7c-7f41-4a52-b967-20c4e6f08f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:08.695828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec30e7c-7f41-4a52-b967-20c4e6f08f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:08.698193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec30e7c-7f41-4a52-b967-20c4e6f08f75 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:08.715294 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1292/2595] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:41:08.716370 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c58c6-53bc-4c72-8d65-855f64f2856d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:08.729472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c58c6-53bc-4c72-8d65-855f64f2856d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:08.734355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62ce62-19cf-473f-8860-915379e52922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:08.734996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ce62-19cf-473f-8860-915379e52922 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:08.735277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ce62-19cf-473f-8860-915379e52922 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:08.735546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ce62-19cf-473f-8860-915379e52922 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:08.736171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62ce62-19cf-473f-8860-915379e52922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:08.738041 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62ce62-19cf-473f-8860-915379e52922 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:08.765781 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1304/2596] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:08 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:08.770188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec30e7c-7f41-4a52-b967-20c4e6f08f75 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:08.780591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec30e7c-7f41-4a52-b967-20c4e6f08f75 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:08.837890 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c05189-12c4-4d87-b8ed-4acd87c983b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:08.838489 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c05189-12c4-4d87-b8ed-4acd87c983b7 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:08.838799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c05189-12c4-4d87-b8ed-4acd87c983b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:08.839074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c05189-12c4-4d87-b8ed-4acd87c983b7 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:08.839700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c05189-12c4-4d87-b8ed-4acd87c983b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:08.841644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c05189-12c4-4d87-b8ed-4acd87c983b7 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:08.867717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1293/2597] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:08 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:08.868980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62ce62-19cf-473f-8860-915379e52922 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:08.879205 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62ce62-19cf-473f-8860-915379e52922 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:08.884738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe6685-0408-4f16-8ab0-b868ef647a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:08.885346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe6685-0408-4f16-8ab0-b868ef647a34 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:08.885651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe6685-0408-4f16-8ab0-b868ef647a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:08.885918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe6685-0408-4f16-8ab0-b868ef647a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:08.886578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe6685-0408-4f16-8ab0-b868ef647a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:08.888472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe6685-0408-4f16-8ab0-b868ef647a34 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:08.902344 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1305/2598] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:08.903594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c05189-12c4-4d87-b8ed-4acd87c983b7 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:08.913846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c05189-12c4-4d87-b8ed-4acd87c983b7 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:08.918570 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e6045-598f-4317-b5b0-2289d4d6b6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:08.919173 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e6045-598f-4317-b5b0-2289d4d6b6cc admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:08.919456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e6045-598f-4317-b5b0-2289d4d6b6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:08.919730 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e6045-598f-4317-b5b0-2289d4d6b6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:08.920366 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e6045-598f-4317-b5b0-2289d4d6b6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:08.921998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e6045-598f-4317-b5b0-2289d4d6b6cc admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:08.933941 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1294/2599] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:08.938480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe6685-0408-4f16-8ab0-b868ef647a34 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:08.949232 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe6685-0408-4f16-8ab0-b868ef647a34 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:08.954113 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42873689-007d-4411-908a-ba62eb08675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:08.954786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42873689-007d-4411-908a-ba62eb08675d admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:08.955068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42873689-007d-4411-908a-ba62eb08675d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:08.955372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42873689-007d-4411-908a-ba62eb08675d admin admin] PATH_INFO: `/v3/projects/36e90230cdb14e7fb6ce9bbb29ea164d/users/e47f6c21ddd647ce84b636f4a172eb78/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:08.969647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42873689-007d-4411-908a-ba62eb08675d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e90230cdb14e7fb6ce9bbb29ea164d, user_id=e47f6c21ddd647ce84b636f4a172eb78, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:08.972349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42873689-007d-4411-908a-ba62eb08675d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:08.985279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1306/2600] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:08 2022] PUT /identity/v3/projects/36e90230cdb14e7fb6ce9bbb29ea164d/users/e47f6c21ddd647ce84b636f4a172eb78/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:08.997685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0e46-ee50-4b42-af90-7c96cd4c8ae0 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:08.997974 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0e46-ee50-4b42-af90-7c96cd4c8ae0 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:08.998324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0e46-ee50-4b42-af90-7c96cd4c8ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:09.028835 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-68df0e46-ee50-4b42-af90-7c96cd4c8ae0 None None] MFA Rules not processed for user `e47f6c21ddd647ce84b636f4a172eb78`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:09.030035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-68df0e46-ee50-4b42-af90-7c96cd4c8ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:09.092656 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1295/2601] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:09.097358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42873689-007d-4411-908a-ba62eb08675d admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:09.158983 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42873689-007d-4411-908a-ba62eb08675d admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:09.163575 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055e78e-12bb-4087-ad76-5ddca2c0ffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:09.164169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055e78e-12bb-4087-ad76-5ddca2c0ffde admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:09.164467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055e78e-12bb-4087-ad76-5ddca2c0ffde admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:09.164721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055e78e-12bb-4087-ad76-5ddca2c0ffde admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:09.165360 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055e78e-12bb-4087-ad76-5ddca2c0ffde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:09.167286 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055e78e-12bb-4087-ad76-5ddca2c0ffde admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:09.193701 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1307/2602] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:09 2022] POST /identity/v3/projects => generated 401 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:09.198939 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df0e46-ee50-4b42-af90-7c96cd4c8ae0 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:09.209662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df0e46-ee50-4b42-af90-7c96cd4c8ae0 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:09.229210 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:09.284380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91183efb-9801-40f8-9191-6ec6a00f1c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:09.285000 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183efb-9801-40f8-9191-6ec6a00f1c98 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:09.285301 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183efb-9801-40f8-9191-6ec6a00f1c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:09.285576 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183efb-9801-40f8-9191-6ec6a00f1c98 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:09.286220 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91183efb-9801-40f8-9191-6ec6a00f1c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:09.288282 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91183efb-9801-40f8-9191-6ec6a00f1c98 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:09.313469 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1296/2603] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:09 2022] POST /identity/v3/users => generated 307 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:09.314685 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055e78e-12bb-4087-ad76-5ddca2c0ffde admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:09.325092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055e78e-12bb-4087-ad76-5ddca2c0ffde admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:09.330738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad7a10-91c4-4388-8eba-e814a70bcc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:09.331335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad7a10-91c4-4388-8eba-e814a70bcc36 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:09.331610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad7a10-91c4-4388-8eba-e814a70bcc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:09.331875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad7a10-91c4-4388-8eba-e814a70bcc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:09.332509 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad7a10-91c4-4388-8eba-e814a70bcc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:09.334110 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad7a10-91c4-4388-8eba-e814a70bcc36 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:09.344727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1308/2604] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:09.349063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91183efb-9801-40f8-9191-6ec6a00f1c98 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:09.359803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91183efb-9801-40f8-9191-6ec6a00f1c98 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:09.364440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c60a-f2b6-49d4-a221-a654cf5ef420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:09.365094 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c60a-f2b6-49d4-a221-a654cf5ef420 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:09.365391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c60a-f2b6-49d4-a221-a654cf5ef420 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:09.365658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c60a-f2b6-49d4-a221-a654cf5ef420 admin admin] PATH_INFO: `/v3/projects/86494e2e601e4ef5a6cb72be0decaa20/users/9a8bb611448f4fa4b3f13d4b5ca90559/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:09.380928 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380c60a-f2b6-49d4-a221-a654cf5ef420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86494e2e601e4ef5a6cb72be0decaa20, user_id=9a8bb611448f4fa4b3f13d4b5ca90559, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:09.383606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380c60a-f2b6-49d4-a221-a654cf5ef420 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:09.397005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1297/2605] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:09 2022] PUT /identity/v3/projects/86494e2e601e4ef5a6cb72be0decaa20/users/9a8bb611448f4fa4b3f13d4b5ca90559/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:09.401242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad7a10-91c4-4388-8eba-e814a70bcc36 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:09.411942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad7a10-91c4-4388-8eba-e814a70bcc36 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:09.442939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:09.473435 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c1226-ed45-4e3c-9f80-35bd017057fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:09.474045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c1226-ed45-4e3c-9f80-35bd017057fa admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:09.474326 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c1226-ed45-4e3c-9f80-35bd017057fa admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:09.474637 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c1226-ed45-4e3c-9f80-35bd017057fa admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:09.475308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c1226-ed45-4e3c-9f80-35bd017057fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:09.476921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c1226-ed45-4e3c-9f80-35bd017057fa admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:09.487342 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1309/2606] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:09.491679 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c60a-f2b6-49d4-a221-a654cf5ef420 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:09.502749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c60a-f2b6-49d4-a221-a654cf5ef420 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:09.507469 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa180bc-76c1-474f-b752-dadc4dc2d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:09.508168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa180bc-76c1-474f-b752-dadc4dc2d9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:09.508447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa180bc-76c1-474f-b752-dadc4dc2d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:09.508832 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa180bc-76c1-474f-b752-dadc4dc2d9bd admin admin] PATH_INFO: `/v3/projects/86494e2e601e4ef5a6cb72be0decaa20/users/9a8bb611448f4fa4b3f13d4b5ca90559/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:09.510760 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa180bc-76c1-474f-b752-dadc4dc2d9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=86494e2e601e4ef5a6cb72be0decaa20, user_id=9a8bb611448f4fa4b3f13d4b5ca90559, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:09.513410 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa180bc-76c1-474f-b752-dadc4dc2d9bd admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:09.523542 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1298/2607] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:09 2022] PUT /identity/v3/projects/86494e2e601e4ef5a6cb72be0decaa20/users/9a8bb611448f4fa4b3f13d4b5ca90559/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:09.533523 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e9947-5e24-4045-8e38-9a799922de61 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:09.533811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e9947-5e24-4045-8e38-9a799922de61 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:09.534088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e9947-5e24-4045-8e38-9a799922de61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:09.681233 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-266e9947-5e24-4045-8e38-9a799922de61 None None] MFA Rules not processed for user `9a8bb611448f4fa4b3f13d4b5ca90559`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:09.682460 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-266e9947-5e24-4045-8e38-9a799922de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:09.748005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1310/2608] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:09 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:09.758487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa180bc-76c1-474f-b752-dadc4dc2d9bd admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:09.761098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-2aa180bc-76c1-474f-b752-dadc4dc2d9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:09.820564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa180bc-76c1-474f-b752-dadc4dc2d9bd admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:09.824324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00402d27-5973-4e93-b460-526c745425ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:09.824993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00402d27-5973-4e93-b460-526c745425ea service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:09.825267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00402d27-5973-4e93-b460-526c745425ea service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:09.825533 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00402d27-5973-4e93-b460-526c745425ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:09.835598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00402d27-5973-4e93-b460-526c745425ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:09.837614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00402d27-5973-4e93-b460-526c745425ea service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:09.847864 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1299/2609] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:09 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:09.929836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e9947-5e24-4045-8e38-9a799922de61 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:09.941568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e9947-5e24-4045-8e38-9a799922de61 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:09.945104 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf1a98-40a6-4a15-98f6-53151623043f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:09.945689 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf1a98-40a6-4a15-98f6-53151623043f service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:09.945958 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf1a98-40a6-4a15-98f6-53151623043f service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:09.946237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf1a98-40a6-4a15-98f6-53151623043f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:10.002361 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf1a98-40a6-4a15-98f6-53151623043f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:10.003809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf1a98-40a6-4a15-98f6-53151623043f service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:10.014104 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1311/2610] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:10.863758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d1f8-3508-4e2b-9537-8a9ce2c93278 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:10.864322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d1f8-3508-4e2b-9537-8a9ce2c93278 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:10.864322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d1f8-3508-4e2b-9537-8a9ce2c93278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:10.885353 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-1bf5d1f8-3508-4e2b-9537-8a9ce2c93278 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:10.886631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1bf5d1f8-3508-4e2b-9537-8a9ce2c93278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:10.955394 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1300/2611] 10.222.0.16 () {58 vars in 1016 bytes} [Fri Sep 16 05:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:10.980216 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf1a98-40a6-4a15-98f6-53151623043f service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:10.981584 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-aecf1a98-40a6-4a15-98f6-53151623043f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:11.061873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:11.085824 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf1a98-40a6-4a15-98f6-53151623043f service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:11.095173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7212016-89a3-412f-90d3-c1a9e8a2f3e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:11.095804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7212016-89a3-412f-90d3-c1a9e8a2f3e8 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:11.096081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7212016-89a3-412f-90d3-c1a9e8a2f3e8 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:11.096384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7212016-89a3-412f-90d3-c1a9e8a2f3e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:11.109152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7212016-89a3-412f-90d3-c1a9e8a2f3e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:11.110767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7212016-89a3-412f-90d3-c1a9e8a2f3e8 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:11.121349 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1312/2612] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:14.072168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5d1f8-3508-4e2b-9537-8a9ce2c93278 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:14.082064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5d1f8-3508-4e2b-9537-8a9ce2c93278 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:14.086672 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:14.087286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:14.087559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:14.087879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] PATH_INFO: `/v3/users/e47f6c21ddd647ce84b636f4a172eb78` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:14.089078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47f6c21ddd647ce84b636f4a172eb78)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:14.090379 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0f2ce-2302-4ca0-ae37-59be8917b6ae None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:14.090834 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0f2ce-2302-4ca0-ae37-59be8917b6ae None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:14.090935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0f2ce-2302-4ca0-ae37-59be8917b6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:14.091023 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:14.107065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:14.111428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-dea0f2ce-2302-4ca0-ae37-59be8917b6ae None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:14.112926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-dea0f2ce-2302-4ca0-ae37-59be8917b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:14.122419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1313/2613] 10.222.0.16 () {58 vars in 1016 bytes} [Fri Sep 16 05:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:14.141837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47f6c21ddd647ce84b636f4a172eb78'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.142487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47f6c21ddd647ce84b636f4a172eb78'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.150420 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47f6c21ddd647ce84b636f4a172eb78'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.151118 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47f6c21ddd647ce84b636f4a172eb78'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.163243 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47f6c21ddd647ce84b636f4a172eb78'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.175911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1301/2614] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:14 2022] DELETE /identity/v3/users/e47f6c21ddd647ce84b636f4a172eb78 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:14.180431 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b9d2d-8ca4-4537-b8c2-f776656e912b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:14.180750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b9d2d-8ca4-4537-b8c2-f776656e912b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:14.181025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b9d2d-8ca4-4537-b8c2-f776656e912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:14.185860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:14.187218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:14.200302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-6f1b9d2d-8ca4-4537-b8c2-f776656e912b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:14.201488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6f1b9d2d-8ca4-4537-b8c2-f776656e912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:14.268863 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1314/2615] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:14.271763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aafa23-4397-4f74-84e5-9ad8938ed790 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:14.278081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c2992-f7e4-4e70-96ac-0a48fca2626c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:14.278727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2992-f7e4-4e70-96ac-0a48fca2626c service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:14.279008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2992-f7e4-4e70-96ac-0a48fca2626c service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:14.279285 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2992-f7e4-4e70-96ac-0a48fca2626c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:14.279480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b9d2d-8ca4-4537-b8c2-f776656e912b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:14.280791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6f1b9d2d-8ca4-4537-b8c2-f776656e912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:14.280993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ca5c2992-f7e4-4e70-96ac-0a48fca2626c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:14.292522 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c2992-f7e4-4e70-96ac-0a48fca2626c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:14.294114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c2992-f7e4-4e70-96ac-0a48fca2626c service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:14.304298 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1302/2616] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:14.340551 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b9d2d-8ca4-4537-b8c2-f776656e912b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:14.344193 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d42045-7290-42c5-ab71-07ad54277b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:14.344787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d42045-7290-42c5-ab71-07ad54277b4a service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:14.345064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d42045-7290-42c5-ab71-07ad54277b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:14.345333 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d42045-7290-42c5-ab71-07ad54277b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:14.357369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d42045-7290-42c5-ab71-07ad54277b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:14.359103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d42045-7290-42c5-ab71-07ad54277b4a service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:14.368623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1315/2617] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:41:14.638351 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c2992-f7e4-4e70-96ac-0a48fca2626c service nova] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:14.639829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ca5c2992-f7e4-4e70-96ac-0a48fca2626c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:14.652534 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c2992-f7e4-4e70-96ac-0a48fca2626c service nova] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:14.657956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:14.658620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:14.658960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:14.659249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] PATH_INFO: `/v3/projects/36e90230cdb14e7fb6ce9bbb29ea164d` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:14.660445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e90230cdb14e7fb6ce9bbb29ea164d)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:14.663240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:14.710853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e90230cdb14e7fb6ce9bbb29ea164d', 'request_id': 'req-906c8746-bb3c-4b5b-98fe-6b1399e40f50'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.717216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e90230cdb14e7fb6ce9bbb29ea164d', 'request_id': 'req-906c8746-bb3c-4b5b-98fe-6b1399e40f50'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.724462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e90230cdb14e7fb6ce9bbb29ea164d', 'request_id': 'req-906c8746-bb3c-4b5b-98fe-6b1399e40f50'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.732672 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:14.736891 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] The token cache is being invalidate because project 36e90230cdb14e7fb6ce9bbb29ea164d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:14.737539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.738333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.740054 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1303/2618] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:14 2022] DELETE /identity/v3/projects/36e90230cdb14e7fb6ce9bbb29ea164d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:14.744006 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d42045-7290-42c5-ab71-07ad54277b4a service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:14.753695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d42045-7290-42c5-ab71-07ad54277b4a service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:14.811239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:14.811871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:14.812149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:14.812421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] PATH_INFO: `/v3/users/9a8bb611448f4fa4b3f13d4b5ca90559` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:14.813558 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8bb611448f4fa4b3f13d4b5ca90559)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:14.815499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:14.833740 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:14.876024 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8bb611448f4fa4b3f13d4b5ca90559'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.876919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8bb611448f4fa4b3f13d4b5ca90559'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.885270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8bb611448f4fa4b3f13d4b5ca90559'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.892612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8bb611448f4fa4b3f13d4b5ca90559'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.893414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8bb611448f4fa4b3f13d4b5ca90559'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:14.911731 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1316/2619] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:14 2022] DELETE /identity/v3/users/9a8bb611448f4fa4b3f13d4b5ca90559 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:15.187412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:15.189419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:15.200527 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:15.203004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:15.265659 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c8746-bb3c-4b5b-98fe-6b1399e40f50 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:15.290709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721da8f-e7cf-4b85-8e27-887a99df3deb admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:15.295733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6359a4-f62d-4eae-8972-c7244e6ba612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:15.296417 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6359a4-f62d-4eae-8972-c7244e6ba612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:15.296733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6359a4-f62d-4eae-8972-c7244e6ba612 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:15.297001 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6359a4-f62d-4eae-8972-c7244e6ba612 admin admin] PATH_INFO: `/v3/projects/86494e2e601e4ef5a6cb72be0decaa20` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:15.298144 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6359a4-f62d-4eae-8972-c7244e6ba612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86494e2e601e4ef5a6cb72be0decaa20)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:15.300073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6359a4-f62d-4eae-8972-c7244e6ba612 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:15.316559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d11aa-ace3-4b2f-ae91-0b28329458a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:15.317194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d11aa-ace3-4b2f-ae91-0b28329458a6 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:15.317477 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d11aa-ace3-4b2f-ae91-0b28329458a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:15.317747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d11aa-ace3-4b2f-ae91-0b28329458a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:15.319492 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a01d11aa-ace3-4b2f-ae91-0b28329458a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:15.346900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-cf6359a4-f62d-4eae-8972-c7244e6ba612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86494e2e601e4ef5a6cb72be0decaa20', 'request_id': 'req-cf6359a4-f62d-4eae-8972-c7244e6ba612'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:15.353813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-cf6359a4-f62d-4eae-8972-c7244e6ba612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86494e2e601e4ef5a6cb72be0decaa20', 'request_id': 'req-cf6359a4-f62d-4eae-8972-c7244e6ba612'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:15.361195 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-cf6359a4-f62d-4eae-8972-c7244e6ba612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86494e2e601e4ef5a6cb72be0decaa20', 'request_id': 'req-cf6359a4-f62d-4eae-8972-c7244e6ba612'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:15.373130 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-cf6359a4-f62d-4eae-8972-c7244e6ba612 admin admin] The token cache is being invalidate because project 86494e2e601e4ef5a6cb72be0decaa20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:15.373415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-cf6359a4-f62d-4eae-8972-c7244e6ba612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:15.374039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-cf6359a4-f62d-4eae-8972-c7244e6ba612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:15.375533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1317/2620] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:15 2022] DELETE /identity/v3/projects/86494e2e601e4ef5a6cb72be0decaa20 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:15.380200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb631924-483a-4357-95ad-151ae3f7c177 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:15.380477 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb631924-483a-4357-95ad-151ae3f7c177 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:15.380742 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb631924-483a-4357-95ad-151ae3f7c177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:15.381873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d11aa-ace3-4b2f-ae91-0b28329458a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:15.383427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d11aa-ace3-4b2f-ae91-0b28329458a6 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:15.393773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1304/2621] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:15.399802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-bb631924-483a-4357-95ad-151ae3f7c177 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:15.400969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-bb631924-483a-4357-95ad-151ae3f7c177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:15.418531 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:15.465146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1318/2622] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:15.473467 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07547023-cfde-4151-af3c-ecd3cef00616 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:15.474416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07547023-cfde-4151-af3c-ecd3cef00616 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:15.474983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07547023-cfde-4151-af3c-ecd3cef00616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:15.502201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-07547023-cfde-4151-af3c-ecd3cef00616 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:15.503547 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-07547023-cfde-4151-af3c-ecd3cef00616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:15.516844 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1305/2623] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:15.518309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb631924-483a-4357-95ad-151ae3f7c177 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:15.530556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb631924-483a-4357-95ad-151ae3f7c177 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:15.536384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd195ba5-f121-4208-ac5f-26e5ba2158a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:15.537082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195ba5-f121-4208-ac5f-26e5ba2158a1 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:15.537433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195ba5-f121-4208-ac5f-26e5ba2158a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:15.537769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195ba5-f121-4208-ac5f-26e5ba2158a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:15.538529 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd195ba5-f121-4208-ac5f-26e5ba2158a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:15.538931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd195ba5-f121-4208-ac5f-26e5ba2158a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:15.541100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd195ba5-f121-4208-ac5f-26e5ba2158a1 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:15.553645 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1319/2624] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:41:15.558603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07547023-cfde-4151-af3c-ecd3cef00616 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:15.568263 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07547023-cfde-4151-af3c-ecd3cef00616 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:15.573000 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c9035-4ada-491f-a6c1-2797661cb71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:15.573594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c9035-4ada-491f-a6c1-2797661cb71b admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:15.573879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c9035-4ada-491f-a6c1-2797661cb71b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:15.574146 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c9035-4ada-491f-a6c1-2797661cb71b admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:15.574879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c9035-4ada-491f-a6c1-2797661cb71b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:15.576777 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c9035-4ada-491f-a6c1-2797661cb71b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:15.606635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1306/2625] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:15 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:15.609735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd195ba5-f121-4208-ac5f-26e5ba2158a1 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:15.620150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd195ba5-f121-4208-ac5f-26e5ba2158a1 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:15.679049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7bbd0-b42e-41ed-b067-5c8021cbf502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:15.679749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7bbd0-b42e-41ed-b067-5c8021cbf502 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:15.680077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7bbd0-b42e-41ed-b067-5c8021cbf502 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:15.680353 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7bbd0-b42e-41ed-b067-5c8021cbf502 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:15.681023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7bbd0-b42e-41ed-b067-5c8021cbf502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:15.682965 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7bbd0-b42e-41ed-b067-5c8021cbf502 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:15.703414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1320/2626] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:15 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:15.708053 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c9035-4ada-491f-a6c1-2797661cb71b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:15.718744 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c9035-4ada-491f-a6c1-2797661cb71b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:15.723318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d339c0c-d7e4-4172-85c6-4fe465a2a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:15.723906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d339c0c-d7e4-4172-85c6-4fe465a2a93d admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:15.724184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d339c0c-d7e4-4172-85c6-4fe465a2a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:15.724456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d339c0c-d7e4-4172-85c6-4fe465a2a93d admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:15.725081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d339c0c-d7e4-4172-85c6-4fe465a2a93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:15.726747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d339c0c-d7e4-4172-85c6-4fe465a2a93d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:15.737198 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1307/2627] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:15.741046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7bbd0-b42e-41ed-b067-5c8021cbf502 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:15.753011 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7bbd0-b42e-41ed-b067-5c8021cbf502 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:15.758296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135a137-2b0d-4ec7-9dcc-6c41fb5e3643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:15.758961 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135a137-2b0d-4ec7-9dcc-6c41fb5e3643 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:15.759243 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135a137-2b0d-4ec7-9dcc-6c41fb5e3643 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:15.759513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135a137-2b0d-4ec7-9dcc-6c41fb5e3643 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:15.760228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135a137-2b0d-4ec7-9dcc-6c41fb5e3643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:15.761889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135a137-2b0d-4ec7-9dcc-6c41fb5e3643 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:15.772915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1321/2628] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:15.777710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d339c0c-d7e4-4172-85c6-4fe465a2a93d admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:15.787828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d339c0c-d7e4-4172-85c6-4fe465a2a93d admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:15.793034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a525cf2-0db5-4758-a8f9-2ef0c86b6c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:15.793674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a525cf2-0db5-4758-a8f9-2ef0c86b6c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:15.793954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a525cf2-0db5-4758-a8f9-2ef0c86b6c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:15.794236 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a525cf2-0db5-4758-a8f9-2ef0c86b6c04 admin admin] PATH_INFO: `/v3/projects/0d132fea18db4974ad91a91d1261141e/users/522f4ac04c904240a3aad5e5666f3f81/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:15.809375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a525cf2-0db5-4758-a8f9-2ef0c86b6c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d132fea18db4974ad91a91d1261141e, user_id=522f4ac04c904240a3aad5e5666f3f81, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:15.812078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a525cf2-0db5-4758-a8f9-2ef0c86b6c04 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:15.825047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1308/2629] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:15 2022] PUT /identity/v3/projects/0d132fea18db4974ad91a91d1261141e/users/522f4ac04c904240a3aad5e5666f3f81/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:15.837315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00889d-e582-4427-9fba-c405d6041db1 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:15.837814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00889d-e582-4427-9fba-c405d6041db1 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:15.838094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00889d-e582-4427-9fba-c405d6041db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:15.866103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-6a00889d-e582-4427-9fba-c405d6041db1 None None] MFA Rules not processed for user `522f4ac04c904240a3aad5e5666f3f81`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:15.867350 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6a00889d-e582-4427-9fba-c405d6041db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:15.936289 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1322/2630] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:15.941506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a525cf2-0db5-4758-a8f9-2ef0c86b6c04 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:15.945911 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:16.006026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a525cf2-0db5-4758-a8f9-2ef0c86b6c04 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:16.012295 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf81e9-8ecf-4e1f-b340-28b64dbb1406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:16.012902 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf81e9-8ecf-4e1f-b340-28b64dbb1406 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:16.013264 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf81e9-8ecf-4e1f-b340-28b64dbb1406 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:16.013473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf81e9-8ecf-4e1f-b340-28b64dbb1406 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:16.014096 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf81e9-8ecf-4e1f-b340-28b64dbb1406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:16.016088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf81e9-8ecf-4e1f-b340-28b64dbb1406 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:16.046312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1309/2631] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:15 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:16.050340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00889d-e582-4427-9fba-c405d6041db1 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:16.061071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00889d-e582-4427-9fba-c405d6041db1 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:16.074178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:16.129489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885738c-b019-4f45-b2cc-7169924669fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:16.130098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885738c-b019-4f45-b2cc-7169924669fe admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:16.130496 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885738c-b019-4f45-b2cc-7169924669fe admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:16.130796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885738c-b019-4f45-b2cc-7169924669fe admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:16.131433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885738c-b019-4f45-b2cc-7169924669fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:16.133347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885738c-b019-4f45-b2cc-7169924669fe admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:16.156148 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1323/2632] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:16 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:16.160325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf81e9-8ecf-4e1f-b340-28b64dbb1406 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:16.172000 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf81e9-8ecf-4e1f-b340-28b64dbb1406 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:16.176960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac4bb3-9f28-4d42-a697-a27adaa59a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:16.177565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac4bb3-9f28-4d42-a697-a27adaa59a80 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:16.177840 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac4bb3-9f28-4d42-a697-a27adaa59a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:16.178110 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac4bb3-9f28-4d42-a697-a27adaa59a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:16.178900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac4bb3-9f28-4d42-a697-a27adaa59a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:16.181230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac4bb3-9f28-4d42-a697-a27adaa59a80 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:16.193205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1310/2633] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:16.198030 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885738c-b019-4f45-b2cc-7169924669fe admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:16.208696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885738c-b019-4f45-b2cc-7169924669fe admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:16.214572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d8427-9797-4b02-ab11-03210fead04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:16.215234 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d8427-9797-4b02-ab11-03210fead04b admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:16.215517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d8427-9797-4b02-ab11-03210fead04b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:16.215790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d8427-9797-4b02-ab11-03210fead04b admin admin] PATH_INFO: `/v3/projects/d2a59bba25554dcfaf8a646c6f727ec2/users/42829a25e2874ae0891a6f0ff39bd647/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:16.232999 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d8427-9797-4b02-ab11-03210fead04b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a59bba25554dcfaf8a646c6f727ec2, user_id=42829a25e2874ae0891a6f0ff39bd647, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:16.235660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d8427-9797-4b02-ab11-03210fead04b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:16.259713 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1324/2634] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:16 2022] PUT /identity/v3/projects/d2a59bba25554dcfaf8a646c6f727ec2/users/42829a25e2874ae0891a6f0ff39bd647/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:16.263784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac4bb3-9f28-4d42-a697-a27adaa59a80 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:16.273707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac4bb3-9f28-4d42-a697-a27adaa59a80 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:16.332584 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8734b04-d184-497e-ad5b-6664035fe553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:16.333190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8734b04-d184-497e-ad5b-6664035fe553 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:16.333471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8734b04-d184-497e-ad5b-6664035fe553 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:16.333770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8734b04-d184-497e-ad5b-6664035fe553 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:16.334431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8734b04-d184-497e-ad5b-6664035fe553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:16.336087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8734b04-d184-497e-ad5b-6664035fe553 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:16.346915 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1311/2635] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:16.350859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d8427-9797-4b02-ab11-03210fead04b admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:16.361028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d8427-9797-4b02-ab11-03210fead04b admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:16.365629 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbd67f-3b1a-4d66-aa9a-1d67f195baeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:16.366295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbd67f-3b1a-4d66-aa9a-1d67f195baeb admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:16.366585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbd67f-3b1a-4d66-aa9a-1d67f195baeb admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:16.366859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbd67f-3b1a-4d66-aa9a-1d67f195baeb admin admin] PATH_INFO: `/v3/projects/d2a59bba25554dcfaf8a646c6f727ec2/users/42829a25e2874ae0891a6f0ff39bd647/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:16.368754 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbd67f-3b1a-4d66-aa9a-1d67f195baeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a59bba25554dcfaf8a646c6f727ec2, user_id=42829a25e2874ae0891a6f0ff39bd647, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:16.371454 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbd67f-3b1a-4d66-aa9a-1d67f195baeb admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:16.381411 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1325/2636] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:16 2022] PUT /identity/v3/projects/d2a59bba25554dcfaf8a646c6f727ec2/users/42829a25e2874ae0891a6f0ff39bd647/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:16.392074 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504b1e4-d36d-40c0-bb84-a441094324e9 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:16.392358 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504b1e4-d36d-40c0-bb84-a441094324e9 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:16.392629 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504b1e4-d36d-40c0-bb84-a441094324e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:16.420647 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b504b1e4-d36d-40c0-bb84-a441094324e9 None None] MFA Rules not processed for user `42829a25e2874ae0891a6f0ff39bd647`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:16.421846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b504b1e4-d36d-40c0-bb84-a441094324e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:16.482634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:16.488670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1312/2637] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:16.499702 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbd67f-3b1a-4d66-aa9a-1d67f195baeb admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:16.501473 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-53dbd67f-3b1a-4d66-aa9a-1d67f195baeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:16.560540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbd67f-3b1a-4d66-aa9a-1d67f195baeb admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:16.564479 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e75db-e6e3-426c-a028-7a45ee2f7a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:16.565078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e75db-e6e3-426c-a028-7a45ee2f7a02 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:16.565352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e75db-e6e3-426c-a028-7a45ee2f7a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:16.565618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e75db-e6e3-426c-a028-7a45ee2f7a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:16.575402 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e75db-e6e3-426c-a028-7a45ee2f7a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:16.576814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e75db-e6e3-426c-a028-7a45ee2f7a02 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:16.586390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1326/2638] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:16.957828 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504b1e4-d36d-40c0-bb84-a441094324e9 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:17.024433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504b1e4-d36d-40c0-bb84-a441094324e9 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:17.029155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:17.029784 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:17.030056 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:17.030324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] PATH_INFO: `/v3/users/522f4ac04c904240a3aad5e5666f3f81` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:17.031515 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=522f4ac04c904240a3aad5e5666f3f81)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:17.033570 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:17.068654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d781453-5e8c-4427-8fcb-371a190afee8 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:17.068940 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d781453-5e8c-4427-8fcb-371a190afee8 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:17.069223 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d781453-5e8c-4427-8fcb-371a190afee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:17.081211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522f4ac04c904240a3aad5e5666f3f81'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.081825 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522f4ac04c904240a3aad5e5666f3f81'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.089661 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522f4ac04c904240a3aad5e5666f3f81'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.090106 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-9d781453-5e8c-4427-8fcb-371a190afee8 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:17.090496 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522f4ac04c904240a3aad5e5666f3f81'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.091381 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9d781453-5e8c-4427-8fcb-371a190afee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:17.099811 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1327/2639] 10.222.0.16 () {58 vars in 1016 bytes} [Fri Sep 16 05:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:17.103845 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522f4ac04c904240a3aad5e5666f3f81'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.115900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1313/2640] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:16 2022] DELETE /identity/v3/users/522f4ac04c904240a3aad5e5666f3f81 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:17.120596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3ca2e-f577-4867-a119-eed9154bc361 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:17.120875 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3ca2e-f577-4867-a119-eed9154bc361 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:17.121181 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3ca2e-f577-4867-a119-eed9154bc361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:17.122029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:17.123412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:17.139530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-d3c3ca2e-f577-4867-a119-eed9154bc361 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:17.140686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d3c3ca2e-f577-4867-a119-eed9154bc361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:17.196710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513d032-b7a6-4773-a182-09a9a6c9e313 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:17.199642 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1328/2641] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:17.202317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945f1f4-f180-4853-9ebb-85ac82d51c56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:17.202967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945f1f4-f180-4853-9ebb-85ac82d51c56 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:17.203247 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945f1f4-f180-4853-9ebb-85ac82d51c56 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:17.203907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945f1f4-f180-4853-9ebb-85ac82d51c56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:17.210383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3ca2e-f577-4867-a119-eed9154bc361 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:17.212271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d3c3ca2e-f577-4867-a119-eed9154bc361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:17.213404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945f1f4-f180-4853-9ebb-85ac82d51c56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:17.215052 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945f1f4-f180-4853-9ebb-85ac82d51c56 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:17.226705 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:17.229702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1314/2642] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:41:17.281020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3ca2e-f577-4867-a119-eed9154bc361 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:17.284823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1209d3-fdd3-4530-8b3f-b8185c86c4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:17.285468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1209d3-fdd3-4530-8b3f-b8185c86c4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:17.285745 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1209d3-fdd3-4530-8b3f-b8185c86c4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:17.286016 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1209d3-fdd3-4530-8b3f-b8185c86c4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:17.297032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1209d3-fdd3-4530-8b3f-b8185c86c4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:17.298489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1209d3-fdd3-4530-8b3f-b8185c86c4e2 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:17.309632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1329/2643] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:41:17.618619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945f1f4-f180-4853-9ebb-85ac82d51c56 service nova] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:17.620193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d945f1f4-f180-4853-9ebb-85ac82d51c56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:17.629345 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:17.635842 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945f1f4-f180-4853-9ebb-85ac82d51c56 service nova] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:17.642305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:17.643178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:17.643888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:17.644456 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] PATH_INFO: `/v3/projects/0d132fea18db4974ad91a91d1261141e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:17.645772 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d132fea18db4974ad91a91d1261141e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:17.647642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:17.694324 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d132fea18db4974ad91a91d1261141e', 'request_id': 'req-6ba189c8-dd0b-4653-af9a-fd0c435354eb'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.700461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d132fea18db4974ad91a91d1261141e', 'request_id': 'req-6ba189c8-dd0b-4653-af9a-fd0c435354eb'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.707958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d132fea18db4974ad91a91d1261141e', 'request_id': 'req-6ba189c8-dd0b-4653-af9a-fd0c435354eb'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.719555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] The token cache is being invalidate because project 0d132fea18db4974ad91a91d1261141e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:17.719837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.720452 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.721899 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1315/2644] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:17 2022] DELETE /identity/v3/projects/0d132fea18db4974ad91a91d1261141e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:17.725956 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1209d3-fdd3-4530-8b3f-b8185c86c4e2 service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:17.735381 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1209d3-fdd3-4530-8b3f-b8185c86c4e2 service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:17.791437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08dd74-48d5-43cd-9904-413814a6b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:17.792068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08dd74-48d5-43cd-9904-413814a6b7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:17.792346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08dd74-48d5-43cd-9904-413814a6b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:17.792620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08dd74-48d5-43cd-9904-413814a6b7e4 admin admin] PATH_INFO: `/v3/users/42829a25e2874ae0891a6f0ff39bd647` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:17.793738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08dd74-48d5-43cd-9904-413814a6b7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42829a25e2874ae0891a6f0ff39bd647)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:17.795683 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08dd74-48d5-43cd-9904-413814a6b7e4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:17.840225 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-7c08dd74-48d5-43cd-9904-413814a6b7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42829a25e2874ae0891a6f0ff39bd647'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.840863 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-7c08dd74-48d5-43cd-9904-413814a6b7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42829a25e2874ae0891a6f0ff39bd647'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.847623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-7c08dd74-48d5-43cd-9904-413814a6b7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42829a25e2874ae0891a6f0ff39bd647'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.854768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-7c08dd74-48d5-43cd-9904-413814a6b7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42829a25e2874ae0891a6f0ff39bd647'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.855397 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-7c08dd74-48d5-43cd-9904-413814a6b7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42829a25e2874ae0891a6f0ff39bd647'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:17.872312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1330/2645] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:17 2022] DELETE /identity/v3/users/42829a25e2874ae0891a6f0ff39bd647 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:18.139585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:18.141049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:18.154700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba189c8-dd0b-4653-af9a-fd0c435354eb admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:18.212413 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:18.213029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:18.213325 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:18.213617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced admin admin] PATH_INFO: `/v3/projects/d2a59bba25554dcfaf8a646c6f727ec2` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:18.214873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a59bba25554dcfaf8a646c6f727ec2)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:18.216824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:18.263968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a59bba25554dcfaf8a646c6f727ec2', 'request_id': 'req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:18.269521 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a59bba25554dcfaf8a646c6f727ec2', 'request_id': 'req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:18.276831 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a59bba25554dcfaf8a646c6f727ec2', 'request_id': 'req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:18.287829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced admin admin] The token cache is being invalidate because project d2a59bba25554dcfaf8a646c6f727ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:18.288110 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:18.288736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-39c8f1e1-6748-488b-b5ec-3a71b6a48ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:18.290800 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1316/2646] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:18 2022] DELETE /identity/v3/projects/d2a59bba25554dcfaf8a646c6f727ec2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:18.295722 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaf48d-61b1-48d8-bd02-425cf2102f51 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:18.296180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaf48d-61b1-48d8-bd02-425cf2102f51 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:18.296278 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaf48d-61b1-48d8-bd02-425cf2102f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:18.316475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-dfdaf48d-61b1-48d8-bd02-425cf2102f51 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:18.317670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-dfdaf48d-61b1-48d8-bd02-425cf2102f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:18.344707 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:18.384468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1331/2647] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:18.392499 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e445-738b-441e-a22a-716592334966 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:18.392715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e445-738b-441e-a22a-716592334966 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:18.392989 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e445-738b-441e-a22a-716592334966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:18.412278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-4733e445-738b-441e-a22a-716592334966 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:18.413464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4733e445-738b-441e-a22a-716592334966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:18.421687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1317/2648] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:18.425789 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaf48d-61b1-48d8-bd02-425cf2102f51 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:18.435937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaf48d-61b1-48d8-bd02-425cf2102f51 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:18.440409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6802b-cf10-461f-bcf9-3ea3738d40a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:18.440994 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6802b-cf10-461f-bcf9-3ea3738d40a8 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:18.441267 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6802b-cf10-461f-bcf9-3ea3738d40a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:18.441524 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6802b-cf10-461f-bcf9-3ea3738d40a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:18.442164 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6802b-cf10-461f-bcf9-3ea3738d40a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:18.442485 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6802b-cf10-461f-bcf9-3ea3738d40a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:18.444067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6802b-cf10-461f-bcf9-3ea3738d40a8 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:18.455627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1332/2649] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:41:18.459643 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733e445-738b-441e-a22a-716592334966 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:18.468702 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733e445-738b-441e-a22a-716592334966 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:18.473234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f611c5-de16-4333-b44b-ad5a9ca6233b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:18.473815 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f611c5-de16-4333-b44b-ad5a9ca6233b admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:18.474089 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f611c5-de16-4333-b44b-ad5a9ca6233b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:18.474355 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f611c5-de16-4333-b44b-ad5a9ca6233b admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:18.475015 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f611c5-de16-4333-b44b-ad5a9ca6233b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:18.476899 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f611c5-de16-4333-b44b-ad5a9ca6233b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:18.482524 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:18.505876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1318/2650] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:18 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:18.510073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6802b-cf10-461f-bcf9-3ea3738d40a8 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:18.519791 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6802b-cf10-461f-bcf9-3ea3738d40a8 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:18.575580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f6996-9903-4659-8cb9-27bef4438043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:18.576180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f6996-9903-4659-8cb9-27bef4438043 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:18.576462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f6996-9903-4659-8cb9-27bef4438043 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:18.576734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f6996-9903-4659-8cb9-27bef4438043 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:18.577358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f6996-9903-4659-8cb9-27bef4438043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:18.579656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f6996-9903-4659-8cb9-27bef4438043 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:18.601424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1333/2651] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:18 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:18.606375 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f611c5-de16-4333-b44b-ad5a9ca6233b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:18.616664 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f611c5-de16-4333-b44b-ad5a9ca6233b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:18.621948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460c8e2-f145-4fdb-8b21-7a4a0dce30d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:18.622670 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460c8e2-f145-4fdb-8b21-7a4a0dce30d2 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:18.622996 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460c8e2-f145-4fdb-8b21-7a4a0dce30d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:18.623364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460c8e2-f145-4fdb-8b21-7a4a0dce30d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:18.624067 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460c8e2-f145-4fdb-8b21-7a4a0dce30d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:18.625709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460c8e2-f145-4fdb-8b21-7a4a0dce30d2 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:18.638544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1319/2652] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:18.641169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f6996-9903-4659-8cb9-27bef4438043 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:18.651823 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f6996-9903-4659-8cb9-27bef4438043 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:18.656806 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fcfb9-5ee2-4d3d-aa40-10725a6fda10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:18.657412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fcfb9-5ee2-4d3d-aa40-10725a6fda10 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:18.657690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fcfb9-5ee2-4d3d-aa40-10725a6fda10 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:18.657956 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fcfb9-5ee2-4d3d-aa40-10725a6fda10 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:18.658627 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fcfb9-5ee2-4d3d-aa40-10725a6fda10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:18.660829 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fcfb9-5ee2-4d3d-aa40-10725a6fda10 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:18.672935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1334/2653] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:18.682615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460c8e2-f145-4fdb-8b21-7a4a0dce30d2 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:18.693761 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460c8e2-f145-4fdb-8b21-7a4a0dce30d2 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:18.698390 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fa91f-3881-4cc4-b127-7ca2144a05db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:18.699087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fa91f-3881-4cc4-b127-7ca2144a05db admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:18.699365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fa91f-3881-4cc4-b127-7ca2144a05db admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:18.699654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fa91f-3881-4cc4-b127-7ca2144a05db admin admin] PATH_INFO: `/v3/projects/4d3bb61bb8004ee9b1257474cf79c461/users/6d35072aad8a418e933135c5f1eafdfd/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:18.715811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fa91f-3881-4cc4-b127-7ca2144a05db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3bb61bb8004ee9b1257474cf79c461, user_id=6d35072aad8a418e933135c5f1eafdfd, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:18.718455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fa91f-3881-4cc4-b127-7ca2144a05db admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:18.733349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1320/2654] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:18 2022] PUT /identity/v3/projects/4d3bb61bb8004ee9b1257474cf79c461/users/6d35072aad8a418e933135c5f1eafdfd/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:18.744318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb8b3-6110-4924-9927-968fbf0c8538 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:18.744603 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb8b3-6110-4924-9927-968fbf0c8538 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:18.744870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb8b3-6110-4924-9927-968fbf0c8538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:18.773409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-3f1cb8b3-6110-4924-9927-968fbf0c8538 None None] MFA Rules not processed for user `6d35072aad8a418e933135c5f1eafdfd`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:18.775168 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3f1cb8b3-6110-4924-9927-968fbf0c8538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:18.845635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1335/2655] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:18.857660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fa91f-3881-4cc4-b127-7ca2144a05db admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:18.859522 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-6e6fa91f-3881-4cc4-b127-7ca2144a05db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:18.916866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fa91f-3881-4cc4-b127-7ca2144a05db admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:18.920431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87456e74-50a6-4d6b-bcce-97986c6e7e07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20d8e253a72c44f7a5a986f981660df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:18.921028 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87456e74-50a6-4d6b-bcce-97986c6e7e07 service glance] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:18.921306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87456e74-50a6-4d6b-bcce-97986c6e7e07 service glance] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:18.921573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87456e74-50a6-4d6b-bcce-97986c6e7e07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:18.929764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87456e74-50a6-4d6b-bcce-97986c6e7e07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:18.931331 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87456e74-50a6-4d6b-bcce-97986c6e7e07 service glance] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:18.940177 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1321/2656] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:20.237414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300ae9-6e76-44e0-a872-0467b7e4163b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:20.237987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300ae9-6e76-44e0-a872-0467b7e4163b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:20.238247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300ae9-6e76-44e0-a872-0467b7e4163b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:20.260825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8c300ae9-6e76-44e0-a872-0467b7e4163b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:20.262052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8c300ae9-6e76-44e0-a872-0467b7e4163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:20.281346 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:20.327387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1336/2657] 10.222.0.16 () {58 vars in 1016 bytes} [Fri Sep 16 05:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:20.352169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87456e74-50a6-4d6b-bcce-97986c6e7e07 service glance] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:20.354537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-87456e74-50a6-4d6b-bcce-97986c6e7e07 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:20.437750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87456e74-50a6-4d6b-bcce-97986c6e7e07 service glance] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:20.443398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d77f02-fde2-4305-abd9-d0155f680f9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:20.444002 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d77f02-fde2-4305-abd9-d0155f680f9b service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:20.444278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d77f02-fde2-4305-abd9-d0155f680f9b service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:20.444548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d77f02-fde2-4305-abd9-d0155f680f9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:20.453242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d77f02-fde2-4305-abd9-d0155f680f9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:20.455119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d77f02-fde2-4305-abd9-d0155f680f9b service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:20.465279 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1322/2658] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:28.003462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c300ae9-6e76-44e0-a872-0467b7e4163b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:28.005061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8c300ae9-6e76-44e0-a872-0467b7e4163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:28.064484 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c300ae9-6e76-44e0-a872-0467b7e4163b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:28.068809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd106a-4031-4d25-b81f-d628466c373f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:28.069466 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd106a-4031-4d25-b81f-d628466c373f service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:28.069741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd106a-4031-4d25-b81f-d628466c373f service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:28.070150 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd106a-4031-4d25-b81f-d628466c373f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:28.072264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-cebd106a-4031-4d25-b81f-d628466c373f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:28.085353 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd106a-4031-4d25-b81f-d628466c373f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:28.086830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd106a-4031-4d25-b81f-d628466c373f service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:28.096373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1337/2659] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:30.460549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=80,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:31.468779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d77f02-fde2-4305-abd9-d0155f680f9b service nova] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:31.470548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-24d77f02-fde2-4305-abd9-d0155f680f9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:31.592339 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d77f02-fde2-4305-abd9-d0155f680f9b service nova] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:31.600217 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25831-1c41-4310-82fc-4a010071bd2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef60b27f5f545aa8ea063009ec66eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:31.601131 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25831-1c41-4310-82fc-4a010071bd2d service placement] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:31.601416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25831-1c41-4310-82fc-4a010071bd2d service placement] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:31.601694 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25831-1c41-4310-82fc-4a010071bd2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:31.604454 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ded25831-1c41-4310-82fc-4a010071bd2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:31.620260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25831-1c41-4310-82fc-4a010071bd2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:31.622071 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25831-1c41-4310-82fc-4a010071bd2d service placement] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:31.633667 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1323/2660] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:31.840730 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd106a-4031-4d25-b81f-d628466c373f service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:31.842215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-cebd106a-4031-4d25-b81f-d628466c373f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:31.855059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd106a-4031-4d25-b81f-d628466c373f service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:31.859728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7bebe-ee7d-42a1-b4de-30f73496439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:31.860359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7bebe-ee7d-42a1-b4de-30f73496439a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:31.860750 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7bebe-ee7d-42a1-b4de-30f73496439a admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:31.860900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7bebe-ee7d-42a1-b4de-30f73496439a admin admin] PATH_INFO: `/v3/users/fa478cd622a949d58a2f0eb4bb437368` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:31.862017 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7bebe-ee7d-42a1-b4de-30f73496439a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa478cd622a949d58a2f0eb4bb437368)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:31.863978 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7bebe-ee7d-42a1-b4de-30f73496439a admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:31.913250 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a2e7bebe-ee7d-42a1-b4de-30f73496439a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa478cd622a949d58a2f0eb4bb437368'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:31.913917 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a2e7bebe-ee7d-42a1-b4de-30f73496439a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa478cd622a949d58a2f0eb4bb437368'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:31.922453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a2e7bebe-ee7d-42a1-b4de-30f73496439a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa478cd622a949d58a2f0eb4bb437368'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:31.931267 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a2e7bebe-ee7d-42a1-b4de-30f73496439a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa478cd622a949d58a2f0eb4bb437368'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:31.933495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-a2e7bebe-ee7d-42a1-b4de-30f73496439a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa478cd622a949d58a2f0eb4bb437368'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:31.955966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1338/2661] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:31 2022] DELETE /identity/v3/users/fa478cd622a949d58a2f0eb4bb437368 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:32.152561 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25831-1c41-4310-82fc-4a010071bd2d service placement] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:32.204402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25831-1c41-4310-82fc-4a010071bd2d service placement] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:32.268939 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11827542-6f71-41e1-98c4-35dd4731de63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:32.269643 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11827542-6f71-41e1-98c4-35dd4731de63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:32.270117 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11827542-6f71-41e1-98c4-35dd4731de63 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:32.270451 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11827542-6f71-41e1-98c4-35dd4731de63 admin admin] PATH_INFO: `/v3/projects/a3ef615467f74f0ba9718bee8e388766` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:32.271847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11827542-6f71-41e1-98c4-35dd4731de63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ef615467f74f0ba9718bee8e388766)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:32.273885 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11827542-6f71-41e1-98c4-35dd4731de63 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:32.330592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-11827542-6f71-41e1-98c4-35dd4731de63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ef615467f74f0ba9718bee8e388766', 'request_id': 'req-11827542-6f71-41e1-98c4-35dd4731de63'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:32.337029 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-11827542-6f71-41e1-98c4-35dd4731de63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ef615467f74f0ba9718bee8e388766', 'request_id': 'req-11827542-6f71-41e1-98c4-35dd4731de63'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:32.346988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-11827542-6f71-41e1-98c4-35dd4731de63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ef615467f74f0ba9718bee8e388766', 'request_id': 'req-11827542-6f71-41e1-98c4-35dd4731de63'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:32.359516 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-11827542-6f71-41e1-98c4-35dd4731de63 admin admin] The token cache is being invalidate because project a3ef615467f74f0ba9718bee8e388766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:32.359804 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-11827542-6f71-41e1-98c4-35dd4731de63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:32.360429 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-11827542-6f71-41e1-98c4-35dd4731de63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:32.361914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1324/2662] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:32 2022] DELETE /identity/v3/projects/a3ef615467f74f0ba9718bee8e388766 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:32.366841 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebefa2-b702-4e81-9fec-b03cde9ac2f5 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:32.367124 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebefa2-b702-4e81-9fec-b03cde9ac2f5 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:32.367390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebefa2-b702-4e81-9fec-b03cde9ac2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:32.387679 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-63ebefa2-b702-4e81-9fec-b03cde9ac2f5 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:32.388900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-63ebefa2-b702-4e81-9fec-b03cde9ac2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:32.439048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:32.465704 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1339/2663] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:32.474558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31af6-35d2-42eb-8d44-9f0b0f28ebf9 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:32.475088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31af6-35d2-42eb-8d44-9f0b0f28ebf9 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:32.475197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31af6-35d2-42eb-8d44-9f0b0f28ebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:32.496603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-d9d31af6-35d2-42eb-8d44-9f0b0f28ebf9 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:32.497805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d9d31af6-35d2-42eb-8d44-9f0b0f28ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:32.505780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1325/2664] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:32.510468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebefa2-b702-4e81-9fec-b03cde9ac2f5 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:32.520820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebefa2-b702-4e81-9fec-b03cde9ac2f5 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:32.526950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdff96-0205-45e8-a36e-e5cf9e3b173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:32.527617 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdff96-0205-45e8-a36e-e5cf9e3b173d admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:32.528081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdff96-0205-45e8-a36e-e5cf9e3b173d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:32.528480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdff96-0205-45e8-a36e-e5cf9e3b173d admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:32.528997 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdff96-0205-45e8-a36e-e5cf9e3b173d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:32.529329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdff96-0205-45e8-a36e-e5cf9e3b173d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:32.530941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdff96-0205-45e8-a36e-e5cf9e3b173d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:32.546543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1340/2665] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:41:32.547763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d31af6-35d2-42eb-8d44-9f0b0f28ebf9 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:32.557486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d31af6-35d2-42eb-8d44-9f0b0f28ebf9 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:32.562431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b395efc-1379-4b5e-89dd-dc6ac4040bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:32.563057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b395efc-1379-4b5e-89dd-dc6ac4040bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:32.563335 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b395efc-1379-4b5e-89dd-dc6ac4040bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:32.563604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b395efc-1379-4b5e-89dd-dc6ac4040bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:32.564240 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b395efc-1379-4b5e-89dd-dc6ac4040bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:32.566140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b395efc-1379-4b5e-89dd-dc6ac4040bf7 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:32.578904 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:32.599352 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1326/2666] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:32 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:32.603741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdff96-0205-45e8-a36e-e5cf9e3b173d admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:32.620155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdff96-0205-45e8-a36e-e5cf9e3b173d admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:32.675401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb8ac6-c17f-4eb5-959d-168d17f2a64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:32.676025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb8ac6-c17f-4eb5-959d-168d17f2a64e admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:32.676277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb8ac6-c17f-4eb5-959d-168d17f2a64e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:32.676550 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb8ac6-c17f-4eb5-959d-168d17f2a64e admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:32.677183 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb8ac6-c17f-4eb5-959d-168d17f2a64e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:32.679114 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb8ac6-c17f-4eb5-959d-168d17f2a64e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:32.703267 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1341/2667] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:32 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:32.708109 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b395efc-1379-4b5e-89dd-dc6ac4040bf7 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:32.719641 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b395efc-1379-4b5e-89dd-dc6ac4040bf7 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:32.724485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f260511-64d4-4dee-8c9f-7788bbe47d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:32.725082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f260511-64d4-4dee-8c9f-7788bbe47d5b admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:32.725355 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f260511-64d4-4dee-8c9f-7788bbe47d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:32.725621 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f260511-64d4-4dee-8c9f-7788bbe47d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:32.726282 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f260511-64d4-4dee-8c9f-7788bbe47d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:32.727884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f260511-64d4-4dee-8c9f-7788bbe47d5b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:32.741535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1327/2668] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:32.743555 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb8ac6-c17f-4eb5-959d-168d17f2a64e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:32.754197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb8ac6-c17f-4eb5-959d-168d17f2a64e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:32.759094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a50b6-57fa-424a-89fa-ee6a8ff95677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:32.760228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a50b6-57fa-424a-89fa-ee6a8ff95677 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:32.760508 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a50b6-57fa-424a-89fa-ee6a8ff95677 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:32.760773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a50b6-57fa-424a-89fa-ee6a8ff95677 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:32.761418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a50b6-57fa-424a-89fa-ee6a8ff95677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:32.763635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a50b6-57fa-424a-89fa-ee6a8ff95677 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:32.774780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1342/2669] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:32.779454 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f260511-64d4-4dee-8c9f-7788bbe47d5b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:32.789960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f260511-64d4-4dee-8c9f-7788bbe47d5b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:32.795076 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537f84c-84a5-4ed1-8bcc-302b930156c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:32.795729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537f84c-84a5-4ed1-8bcc-302b930156c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:32.796004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537f84c-84a5-4ed1-8bcc-302b930156c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:32.796274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537f84c-84a5-4ed1-8bcc-302b930156c9 admin admin] PATH_INFO: `/v3/projects/32ae7d2543a0441cbdc7f83326838a54/users/4e05eb9a34c74421b7b94fe1ba1e1a09/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:32.814303 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537f84c-84a5-4ed1-8bcc-302b930156c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ae7d2543a0441cbdc7f83326838a54, user_id=4e05eb9a34c74421b7b94fe1ba1e1a09, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:32.817102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537f84c-84a5-4ed1-8bcc-302b930156c9 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:32.830972 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1328/2670] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:32 2022] PUT /identity/v3/projects/32ae7d2543a0441cbdc7f83326838a54/users/4e05eb9a34c74421b7b94fe1ba1e1a09/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:32.843258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9873ab2-6800-4fa1-a458-e483c45e3f4d None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:32.843753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9873ab2-6800-4fa1-a458-e483c45e3f4d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:32.843877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9873ab2-6800-4fa1-a458-e483c45e3f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:32.878891 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-c9873ab2-6800-4fa1-a458-e483c45e3f4d None None] MFA Rules not processed for user `4e05eb9a34c74421b7b94fe1ba1e1a09`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:32.880132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-c9873ab2-6800-4fa1-a458-e483c45e3f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:32.945516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1343/2671] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:32.950691 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537f84c-84a5-4ed1-8bcc-302b930156c9 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:33.015259 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537f84c-84a5-4ed1-8bcc-302b930156c9 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:33.020293 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a37b0e-a702-40dc-8742-396e287f252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:33.020903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a37b0e-a702-40dc-8742-396e287f252e admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:33.021185 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a37b0e-a702-40dc-8742-396e287f252e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:33.021457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a37b0e-a702-40dc-8742-396e287f252e admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:33.022091 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a37b0e-a702-40dc-8742-396e287f252e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:33.024035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a37b0e-a702-40dc-8742-396e287f252e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:33.050960 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1329/2672] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:32 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:33.055319 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9873ab2-6800-4fa1-a458-e483c45e3f4d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:33.066409 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9873ab2-6800-4fa1-a458-e483c45e3f4d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:33.099380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:33.124972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e765a-d784-414d-98e7-a5d97397f310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:33.125576 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e765a-d784-414d-98e7-a5d97397f310 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:33.125861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e765a-d784-414d-98e7-a5d97397f310 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:33.126136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e765a-d784-414d-98e7-a5d97397f310 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:33.126805 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e765a-d784-414d-98e7-a5d97397f310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:33.128716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e765a-d784-414d-98e7-a5d97397f310 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:33.150276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1344/2673] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:33 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:33.154500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a37b0e-a702-40dc-8742-396e287f252e admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:33.166846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a37b0e-a702-40dc-8742-396e287f252e admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:33.172139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d86a0-844a-4ad5-95bc-540d5eda1a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:33.172750 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d86a0-844a-4ad5-95bc-540d5eda1a22 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:33.173031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d86a0-844a-4ad5-95bc-540d5eda1a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:33.173305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d86a0-844a-4ad5-95bc-540d5eda1a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:33.174005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d86a0-844a-4ad5-95bc-540d5eda1a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:33.175707 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d86a0-844a-4ad5-95bc-540d5eda1a22 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:33.187718 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1330/2674] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:33.192024 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e765a-d784-414d-98e7-a5d97397f310 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:33.204389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e765a-d784-414d-98e7-a5d97397f310 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:33.209149 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d3493-cb1c-4320-a8a6-ec6500418c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:33.209815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d3493-cb1c-4320-a8a6-ec6500418c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:33.210095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d3493-cb1c-4320-a8a6-ec6500418c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:33.210368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d3493-cb1c-4320-a8a6-ec6500418c96 admin admin] PATH_INFO: `/v3/projects/0382de9ad6cb4ef1a7e7e4a85e046d78/users/6e261501b95b474c82a88573459bff07/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:33.228937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d3493-cb1c-4320-a8a6-ec6500418c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0382de9ad6cb4ef1a7e7e4a85e046d78, user_id=6e261501b95b474c82a88573459bff07, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:33.231818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d3493-cb1c-4320-a8a6-ec6500418c96 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:33.257888 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1345/2675] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:33 2022] PUT /identity/v3/projects/0382de9ad6cb4ef1a7e7e4a85e046d78/users/6e261501b95b474c82a88573459bff07/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:33.261994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d86a0-844a-4ad5-95bc-540d5eda1a22 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:33.272732 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d86a0-844a-4ad5-95bc-540d5eda1a22 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:33.333309 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb790351-b67b-45d6-9063-c29468ba3ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:33.333925 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790351-b67b-45d6-9063-c29468ba3ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:33.334202 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790351-b67b-45d6-9063-c29468ba3ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:33.334627 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790351-b67b-45d6-9063-c29468ba3ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:33.335269 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb790351-b67b-45d6-9063-c29468ba3ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:33.336881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb790351-b67b-45d6-9063-c29468ba3ae2 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:33.357023 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1331/2676] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:33.358785 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d3493-cb1c-4320-a8a6-ec6500418c96 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:33.382281 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d3493-cb1c-4320-a8a6-ec6500418c96 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:33.387859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0a1f8-47f0-49fe-8d79-074f68e204bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:33.388606 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0a1f8-47f0-49fe-8d79-074f68e204bd admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:33.388886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0a1f8-47f0-49fe-8d79-074f68e204bd admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:33.389155 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0a1f8-47f0-49fe-8d79-074f68e204bd admin admin] PATH_INFO: `/v3/projects/0382de9ad6cb4ef1a7e7e4a85e046d78/users/6e261501b95b474c82a88573459bff07/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:33.391136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0a1f8-47f0-49fe-8d79-074f68e204bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0382de9ad6cb4ef1a7e7e4a85e046d78, user_id=6e261501b95b474c82a88573459bff07, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:33.393952 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0a1f8-47f0-49fe-8d79-074f68e204bd admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:33.409782 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1346/2677] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:33 2022] PUT /identity/v3/projects/0382de9ad6cb4ef1a7e7e4a85e046d78/users/6e261501b95b474c82a88573459bff07/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:33.421873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2f0cd-442c-43f7-b0ee-8e0efab23e84 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:33.422203 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2f0cd-442c-43f7-b0ee-8e0efab23e84 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:33.422650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2f0cd-442c-43f7-b0ee-8e0efab23e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:33.460893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b9b2f0cd-442c-43f7-b0ee-8e0efab23e84 None None] MFA Rules not processed for user `6e261501b95b474c82a88573459bff07`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:33.462128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b9b2f0cd-442c-43f7-b0ee-8e0efab23e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:33.474588 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:33.530326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1332/2678] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:33.542672 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0a1f8-47f0-49fe-8d79-074f68e204bd admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:33.544408 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-bab0a1f8-47f0-49fe-8d79-074f68e204bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:33.605032 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0a1f8-47f0-49fe-8d79-074f68e204bd admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:33.608757 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f99099-b640-4528-a216-78620ee8cb76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:33.609299 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f99099-b640-4528-a216-78620ee8cb76 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:33.609570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f99099-b640-4528-a216-78620ee8cb76 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:33.609836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f99099-b640-4528-a216-78620ee8cb76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:33.619030 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f99099-b640-4528-a216-78620ee8cb76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:33.620471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f99099-b640-4528-a216-78620ee8cb76 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:33.630224 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1347/2679] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:33.705852 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2f0cd-442c-43f7-b0ee-8e0efab23e84 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:33.716471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2f0cd-442c-43f7-b0ee-8e0efab23e84 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:33.720111 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a5e39-ce57-45e9-90db-3226023f9010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:33.720713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5e39-ce57-45e9-90db-3226023f9010 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:33.720985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5e39-ce57-45e9-90db-3226023f9010 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:33.721246 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5e39-ce57-45e9-90db-3226023f9010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:33.777281 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a5e39-ce57-45e9-90db-3226023f9010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:33.778751 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a5e39-ce57-45e9-90db-3226023f9010 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:33.787601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1333/2680] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:36.539104 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f99099-b640-4528-a216-78620ee8cb76 service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:36.600541 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f99099-b640-4528-a216-78620ee8cb76 service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:36.605549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:36.606152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:36.606424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:36.606718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] PATH_INFO: `/v3/users/4e05eb9a34c74421b7b94fe1ba1e1a09` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:36.607818 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e05eb9a34c74421b7b94fe1ba1e1a09)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:36.609696 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:36.642625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:36.657567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e05eb9a34c74421b7b94fe1ba1e1a09'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:36.658220 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e05eb9a34c74421b7b94fe1ba1e1a09'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:36.665444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e05eb9a34c74421b7b94fe1ba1e1a09'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:36.673209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e05eb9a34c74421b7b94fe1ba1e1a09'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:36.673830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e05eb9a34c74421b7b94fe1ba1e1a09'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:36.690437 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1348/2681] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:36 2022] DELETE /identity/v3/users/4e05eb9a34c74421b7b94fe1ba1e1a09 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:36.694829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e88105-e65d-4abe-bbf1-3029602a7585 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:36.695288 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e88105-e65d-4abe-bbf1-3029602a7585 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:36.695389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e88105-e65d-4abe-bbf1-3029602a7585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:36.714700 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-b1e88105-e65d-4abe-bbf1-3029602a7585 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:36.715900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b1e88105-e65d-4abe-bbf1-3029602a7585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:36.773380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1334/2682] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:36.783425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:36.784826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:36.815205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e88105-e65d-4abe-bbf1-3029602a7585 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:36.816662 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-b1e88105-e65d-4abe-bbf1-3029602a7585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:36.828209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e88105-e65d-4abe-bbf1-3029602a7585 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:36.833025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819ce58-f7a8-45e2-89e2-9dd14c659360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:36.833644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819ce58-f7a8-45e2-89e2-9dd14c659360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:36.833918 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819ce58-f7a8-45e2-89e2-9dd14c659360 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:36.834187 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819ce58-f7a8-45e2-89e2-9dd14c659360 admin admin] PATH_INFO: `/v3/users/6d35072aad8a418e933135c5f1eafdfd` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:36.835332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819ce58-f7a8-45e2-89e2-9dd14c659360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d35072aad8a418e933135c5f1eafdfd)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:36.837227 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819ce58-f7a8-45e2-89e2-9dd14c659360 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:36.843052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadd6dd-b7d5-4ba6-8d63-da74cdd3cd7e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:36.846895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff53112-8be6-4aa6-bae3-9582a2d171cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:36.847496 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff53112-8be6-4aa6-bae3-9582a2d171cb service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:36.847775 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff53112-8be6-4aa6-bae3-9582a2d171cb service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:36.848045 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff53112-8be6-4aa6-bae3-9582a2d171cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:36.857756 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff53112-8be6-4aa6-bae3-9582a2d171cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:36.859228 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff53112-8be6-4aa6-bae3-9582a2d171cb service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:36.869033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1349/2683] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:36.884475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:36.886158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6819ce58-f7a8-45e2-89e2-9dd14c659360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d35072aad8a418e933135c5f1eafdfd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:36.887127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6819ce58-f7a8-45e2-89e2-9dd14c659360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d35072aad8a418e933135c5f1eafdfd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:36.894852 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6819ce58-f7a8-45e2-89e2-9dd14c659360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d35072aad8a418e933135c5f1eafdfd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:36.895505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6819ce58-f7a8-45e2-89e2-9dd14c659360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d35072aad8a418e933135c5f1eafdfd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:36.910457 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-6819ce58-f7a8-45e2-89e2-9dd14c659360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d35072aad8a418e933135c5f1eafdfd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:36.926946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1335/2684] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:36 2022] DELETE /identity/v3/users/6d35072aad8a418e933135c5f1eafdfd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:36.931318 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a61af-b836-4af4-a9e2-7738f5796aa7 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:36.932879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a61af-b836-4af4-a9e2-7738f5796aa7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:36.932879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a61af-b836-4af4-a9e2-7738f5796aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:36.955550 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f09a61af-b836-4af4-a9e2-7738f5796aa7 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:36.956703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f09a61af-b836-4af4-a9e2-7738f5796aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:37.047572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d7919-66bb-407a-b074-57fb53a664db None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:37.047866 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d7919-66bb-407a-b074-57fb53a664db None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:37.048143 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d7919-66bb-407a-b074-57fb53a664db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:37.075804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1350/2685] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:37.085434 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-8c8d7919-66bb-407a-b074-57fb53a664db None None] MFA Rules not processed for user `09c6e6f7803f4feca497bfc43134a6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:37.086714 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8c8d7919-66bb-407a-b074-57fb53a664db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:37.086985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a61af-b836-4af4-a9e2-7738f5796aa7 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:37.089427 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f09a61af-b836-4af4-a9e2-7738f5796aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:37.169700 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a61af-b836-4af4-a9e2-7738f5796aa7 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:37.175181 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870bcaf-148d-417d-b1ce-a1659c58674c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:37.175783 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870bcaf-148d-417d-b1ce-a1659c58674c service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:37.176481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870bcaf-148d-417d-b1ce-a1659c58674c service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:37.176765 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870bcaf-148d-417d-b1ce-a1659c58674c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:37.181487 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1336/2686] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:37.188535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d7919-66bb-407a-b074-57fb53a664db None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:37.191097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:37.191233 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-8c8d7919-66bb-407a-b074-57fb53a664db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:37.195037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870bcaf-148d-417d-b1ce-a1659c58674c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:37.198815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870bcaf-148d-417d-b1ce-a1659c58674c service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:37.211697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1351/2687] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:37.215103 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d7919-66bb-407a-b074-57fb53a664db None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:37.220310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:37.220956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:37.221235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:37.221594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] PATH_INFO: `/v3/projects/32ae7d2543a0441cbdc7f83326838a54` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:37.222692 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ae7d2543a0441cbdc7f83326838a54)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:37.224627 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:37.291329 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ae7d2543a0441cbdc7f83326838a54', 'request_id': 'req-d63be0ed-51bd-4805-822f-0bcfaf00e480'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.299642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ae7d2543a0441cbdc7f83326838a54', 'request_id': 'req-d63be0ed-51bd-4805-822f-0bcfaf00e480'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.307771 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ae7d2543a0441cbdc7f83326838a54', 'request_id': 'req-d63be0ed-51bd-4805-822f-0bcfaf00e480'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.326715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] The token cache is being invalidate because project 32ae7d2543a0441cbdc7f83326838a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:37.327652 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.328123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.330438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1337/2688] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:37 2022] DELETE /identity/v3/projects/32ae7d2543a0441cbdc7f83326838a54 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:37.334588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870bcaf-148d-417d-b1ce-a1659c58674c service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:37.347136 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870bcaf-148d-417d-b1ce-a1659c58674c service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:37.422039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:37.422677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:37.422952 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:37.423221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] PATH_INFO: `/v3/users/6e261501b95b474c82a88573459bff07` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:37.424345 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e261501b95b474c82a88573459bff07)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:37.426273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:37.483971 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e261501b95b474c82a88573459bff07'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.485119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e261501b95b474c82a88573459bff07'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.493429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e261501b95b474c82a88573459bff07'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.500923 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e261501b95b474c82a88573459bff07'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.501531 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e261501b95b474c82a88573459bff07'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.520117 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1352/2689] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:37 2022] DELETE /identity/v3/users/6e261501b95b474c82a88573459bff07 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:37.659046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:37.661138 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:37.686141 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63be0ed-51bd-4805-822f-0bcfaf00e480 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:37.750139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:37.766993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5b50c-8628-40d0-958b-b3cd953a310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:37.767749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5b50c-8628-40d0-958b-b3cd953a310b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:37.768160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5b50c-8628-40d0-958b-b3cd953a310b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:37.768497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5b50c-8628-40d0-958b-b3cd953a310b admin admin] PATH_INFO: `/v3/projects/4d3bb61bb8004ee9b1257474cf79c461` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:37.769731 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5b50c-8628-40d0-958b-b3cd953a310b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d3bb61bb8004ee9b1257474cf79c461)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:37.771923 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5b50c-8628-40d0-958b-b3cd953a310b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:37.812613 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:37.814106 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:37.832035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-85c5b50c-8628-40d0-958b-b3cd953a310b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d3bb61bb8004ee9b1257474cf79c461', 'request_id': 'req-85c5b50c-8628-40d0-958b-b3cd953a310b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.836331 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71565999-7194-42ac-9e1e-5ccf9be1ce51 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:37.838887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-85c5b50c-8628-40d0-958b-b3cd953a310b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d3bb61bb8004ee9b1257474cf79c461', 'request_id': 'req-85c5b50c-8628-40d0-958b-b3cd953a310b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.850180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-85c5b50c-8628-40d0-958b-b3cd953a310b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d3bb61bb8004ee9b1257474cf79c461', 'request_id': 'req-85c5b50c-8628-40d0-958b-b3cd953a310b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.864901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-85c5b50c-8628-40d0-958b-b3cd953a310b admin admin] The token cache is being invalidate because project 4d3bb61bb8004ee9b1257474cf79c461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:37.865188 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-85c5b50c-8628-40d0-958b-b3cd953a310b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.865907 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-85c5b50c-8628-40d0-958b-b3cd953a310b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:37.867823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1338/2690] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:37 2022] DELETE /identity/v3/projects/4d3bb61bb8004ee9b1257474cf79c461 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:37.874204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c8ee0-7511-43c5-af37-0ec60080d537 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:37.874565 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c8ee0-7511-43c5-af37-0ec60080d537 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:37.874892 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c8ee0-7511-43c5-af37-0ec60080d537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:37.897992 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-780c8ee0-7511-43c5-af37-0ec60080d537 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:37.900752 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-780c8ee0-7511-43c5-af37-0ec60080d537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:37.923608 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:37.924360 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:37.924638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:37.924909 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61 admin admin] PATH_INFO: `/v3/projects/0382de9ad6cb4ef1a7e7e4a85e046d78` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:37.926269 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0382de9ad6cb4ef1a7e7e4a85e046d78)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:37.928347 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:37.951590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:37.989450 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1339/2691] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:37.998302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98971cc-068a-4c46-adc0-d4fd0bc55ee3 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:37.998682 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98971cc-068a-4c46-adc0-d4fd0bc55ee3 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:37.998951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98971cc-068a-4c46-adc0-d4fd0bc55ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.004441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0382de9ad6cb4ef1a7e7e4a85e046d78', 'request_id': 'req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:38.012969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0382de9ad6cb4ef1a7e7e4a85e046d78', 'request_id': 'req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:38.021778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-e98971cc-068a-4c46-adc0-d4fd0bc55ee3 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:38.022586 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0382de9ad6cb4ef1a7e7e4a85e046d78', 'request_id': 'req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:38.023514 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e98971cc-068a-4c46-adc0-d4fd0bc55ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:38.036737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61 admin admin] The token cache is being invalidate because project 0382de9ad6cb4ef1a7e7e4a85e046d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:38.037091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:38.038269 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3955c42a-c908-4cd4-b3bd-b50abaf6ce61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:38.040242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1353/2692] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:37 2022] DELETE /identity/v3/projects/0382de9ad6cb4ef1a7e7e4a85e046d78 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:38.045386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399bd0e-3337-4e74-95c0-f67c47c71402 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.045770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399bd0e-3337-4e74-95c0-f67c47c71402 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.046088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399bd0e-3337-4e74-95c0-f67c47c71402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.071428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-6399bd0e-3337-4e74-95c0-f67c47c71402 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:38.072782 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6399bd0e-3337-4e74-95c0-f67c47c71402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:38.097427 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1340/2693] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:38.101526 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98971cc-068a-4c46-adc0-d4fd0bc55ee3 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.113594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98971cc-068a-4c46-adc0-d4fd0bc55ee3 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.120249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68ecdf-13df-40fe-8838-24d74ea5eab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.120857 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68ecdf-13df-40fe-8838-24d74ea5eab6 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.121140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68ecdf-13df-40fe-8838-24d74ea5eab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.121436 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68ecdf-13df-40fe-8838-24d74ea5eab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.122106 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68ecdf-13df-40fe-8838-24d74ea5eab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:38.122398 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68ecdf-13df-40fe-8838-24d74ea5eab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.124047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68ecdf-13df-40fe-8838-24d74ea5eab6 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.136280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1341/2694] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:41:38.140376 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68ecdf-13df-40fe-8838-24d74ea5eab6 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.150565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1354/2695] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:38.152631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68ecdf-13df-40fe-8838-24d74ea5eab6 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.158223 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a7ad8-daee-449d-9ae1-df0ca83c79f7 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.158527 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a7ad8-daee-449d-9ae1-df0ca83c79f7 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.158808 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a7ad8-daee-449d-9ae1-df0ca83c79f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.160361 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b576a-e4d7-4259-888e-9c5247928a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.161910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b576a-e4d7-4259-888e-9c5247928a3f admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.162204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b576a-e4d7-4259-888e-9c5247928a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.162485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b576a-e4d7-4259-888e-9c5247928a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.163153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b576a-e4d7-4259-888e-9c5247928a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.166827 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b576a-e4d7-4259-888e-9c5247928a3f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.174030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:38.180921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-7c0a7ad8-daee-449d-9ae1-df0ca83c79f7 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:38.182630 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7c0a7ad8-daee-449d-9ae1-df0ca83c79f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:38.191919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1355/2696] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:38.196197 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a7ad8-daee-449d-9ae1-df0ca83c79f7 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.205273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1342/2697] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:38 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:38.208889 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a7ad8-daee-449d-9ae1-df0ca83c79f7 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.209238 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b576a-e4d7-4259-888e-9c5247928a3f admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.282411 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32360e45-b727-4f2d-98d3-e4b6964cbbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.283128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32360e45-b727-4f2d-98d3-e4b6964cbbba admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.283508 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32360e45-b727-4f2d-98d3-e4b6964cbbba admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.283884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32360e45-b727-4f2d-98d3-e4b6964cbbba admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.284759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32360e45-b727-4f2d-98d3-e4b6964cbbba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:38.285166 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32360e45-b727-4f2d-98d3-e4b6964cbbba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.287010 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32360e45-b727-4f2d-98d3-e4b6964cbbba admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.305702 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1356/2698] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:41:38.308308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32360e45-b727-4f2d-98d3-e4b6964cbbba admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.312096 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b576a-e4d7-4259-888e-9c5247928a3f admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.317413 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f559ea-6f3a-4716-8973-5fa8ac625eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.318395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f559ea-6f3a-4716-8973-5fa8ac625eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.318875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f559ea-6f3a-4716-8973-5fa8ac625eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.319305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f559ea-6f3a-4716-8973-5fa8ac625eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.320440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f559ea-6f3a-4716-8973-5fa8ac625eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.323407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f559ea-6f3a-4716-8973-5fa8ac625eb0 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.325717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32360e45-b727-4f2d-98d3-e4b6964cbbba admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.331728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eceb2-9a3a-4e08-9008-c78920e5882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.332596 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eceb2-9a3a-4e08-9008-c78920e5882c admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.332925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eceb2-9a3a-4e08-9008-c78920e5882c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.333272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eceb2-9a3a-4e08-9008-c78920e5882c admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.334163 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3eceb2-9a3a-4e08-9008-c78920e5882c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.338951 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3eceb2-9a3a-4e08-9008-c78920e5882c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.355349 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1343/2699] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:38 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:38.359560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f559ea-6f3a-4716-8973-5fa8ac625eb0 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.371431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f559ea-6f3a-4716-8973-5fa8ac625eb0 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.384218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6bc87-0cc9-458e-b21a-f04886639363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.386752 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1357/2700] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:38 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:38.388354 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eceb2-9a3a-4e08-9008-c78920e5882c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.389041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6bc87-0cc9-458e-b21a-f04886639363 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.389482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6bc87-0cc9-458e-b21a-f04886639363 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.389763 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6bc87-0cc9-458e-b21a-f04886639363 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.390485 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6bc87-0cc9-458e-b21a-f04886639363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.392222 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6bc87-0cc9-458e-b21a-f04886639363 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.403599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:38.405064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1344/2701] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:38.408933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6bc87-0cc9-458e-b21a-f04886639363 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.422749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6bc87-0cc9-458e-b21a-f04886639363 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.463365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eceb2-9a3a-4e08-9008-c78920e5882c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.469626 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b0aa-6caf-4447-a2d9-b1d3ede3571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.470242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b0aa-6caf-4447-a2d9-b1d3ede3571f admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.470545 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b0aa-6caf-4447-a2d9-b1d3ede3571f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.470817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b0aa-6caf-4447-a2d9-b1d3ede3571f admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.471455 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4b0aa-6caf-4447-a2d9-b1d3ede3571f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.474557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4b0aa-6caf-4447-a2d9-b1d3ede3571f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.502697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1358/2702] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:38 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:38.506417 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b0aa-6caf-4447-a2d9-b1d3ede3571f admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.512645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8221b57-e3e3-4b35-a17a-fcf8ba32fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.513399 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8221b57-e3e3-4b35-a17a-fcf8ba32fcfa admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.513764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8221b57-e3e3-4b35-a17a-fcf8ba32fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.514012 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8221b57-e3e3-4b35-a17a-fcf8ba32fcfa admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.514790 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8221b57-e3e3-4b35-a17a-fcf8ba32fcfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.516435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8221b57-e3e3-4b35-a17a-fcf8ba32fcfa admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.520470 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b0aa-6caf-4447-a2d9-b1d3ede3571f admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.527272 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe90b5-ea3e-42db-9f02-8559a577e861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.528263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe90b5-ea3e-42db-9f02-8559a577e861 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.528613 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe90b5-ea3e-42db-9f02-8559a577e861 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.529136 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1345/2703] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:38.530620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe90b5-ea3e-42db-9f02-8559a577e861 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.531405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe90b5-ea3e-42db-9f02-8559a577e861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.533191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8221b57-e3e3-4b35-a17a-fcf8ba32fcfa admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.540252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe90b5-ea3e-42db-9f02-8559a577e861 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.552005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8221b57-e3e3-4b35-a17a-fcf8ba32fcfa admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.554588 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1359/2704] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:38.556902 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe90b5-ea3e-42db-9f02-8559a577e861 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.563092 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4a5cb-2381-4507-aa72-ec1c667781e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.564931 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4a5cb-2381-4507-aa72-ec1c667781e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.565209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4a5cb-2381-4507-aa72-ec1c667781e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.565642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4a5cb-2381-4507-aa72-ec1c667781e9 admin admin] PATH_INFO: `/v3/projects/9f7a5c6810da42608c1f74ef297ff546/users/efe510cadf8648dc962d1ee3e715d129/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.568900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe90b5-ea3e-42db-9f02-8559a577e861 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.575610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112d68e-f701-4f7c-acee-9c8b813d5994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.576327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112d68e-f701-4f7c-acee-9c8b813d5994 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.576726 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112d68e-f701-4f7c-acee-9c8b813d5994 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.577099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112d68e-f701-4f7c-acee-9c8b813d5994 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.577844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112d68e-f701-4f7c-acee-9c8b813d5994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.579877 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112d68e-f701-4f7c-acee-9c8b813d5994 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.588135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4a5cb-2381-4507-aa72-ec1c667781e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7a5c6810da42608c1f74ef297ff546, user_id=efe510cadf8648dc962d1ee3e715d129, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.592057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1360/2705] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:38.592180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4a5cb-2381-4507-aa72-ec1c667781e9 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.596046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112d68e-f701-4f7c-acee-9c8b813d5994 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.607589 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112d68e-f701-4f7c-acee-9c8b813d5994 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.608836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1346/2706] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:38 2022] PUT /identity/v3/projects/9f7a5c6810da42608c1f74ef297ff546/users/efe510cadf8648dc962d1ee3e715d129/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:38.620227 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1dc04-fa74-4a53-956f-127ae2ae2574 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.621065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1dc04-fa74-4a53-956f-127ae2ae2574 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.621065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1dc04-fa74-4a53-956f-127ae2ae2574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.653075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-d5f1dc04-fa74-4a53-956f-127ae2ae2574 None None] MFA Rules not processed for user `efe510cadf8648dc962d1ee3e715d129`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:38.654475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d5f1dc04-fa74-4a53-956f-127ae2ae2574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:38.684638 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:38.691812 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fa4e2-e37a-411e-8b66-cb1cb10243b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.693530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa4e2-e37a-411e-8b66-cb1cb10243b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.693530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa4e2-e37a-411e-8b66-cb1cb10243b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.693784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa4e2-e37a-411e-8b66-cb1cb10243b3 admin admin] PATH_INFO: `/v3/projects/9e474214e6c74dacb1c9fb025b2cdeae/users/6703f903089342d08519343d2376b6dd/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.713096 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fa4e2-e37a-411e-8b66-cb1cb10243b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e474214e6c74dacb1c9fb025b2cdeae, user_id=6703f903089342d08519343d2376b6dd, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.716475 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fa4e2-e37a-411e-8b66-cb1cb10243b3 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.733893 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1361/2707] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:38 2022] PUT /identity/v3/projects/9e474214e6c74dacb1c9fb025b2cdeae/users/6703f903089342d08519343d2376b6dd/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:38.744259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cfec3-c4a4-44f0-9d1d-3e6ec19ccd72 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.744706 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cfec3-c4a4-44f0-9d1d-3e6ec19ccd72 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.744914 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cfec3-c4a4-44f0-9d1d-3e6ec19ccd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.757628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1347/2708] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:38.759680 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1dc04-fa74-4a53-956f-127ae2ae2574 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.775473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1dc04-fa74-4a53-956f-127ae2ae2574 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.786577 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-914cfec3-c4a4-44f0-9d1d-3e6ec19ccd72 None None] MFA Rules not processed for user `6703f903089342d08519343d2376b6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:38.788410 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-914cfec3-c4a4-44f0-9d1d-3e6ec19ccd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:38.853923 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:38.862058 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cc290-ae87-436f-baa8-1c5e04db4ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.862697 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cc290-ae87-436f-baa8-1c5e04db4ddc admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.862969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cc290-ae87-436f-baa8-1c5e04db4ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.863242 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cc290-ae87-436f-baa8-1c5e04db4ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.863986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cc290-ae87-436f-baa8-1c5e04db4ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.866300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cc290-ae87-436f-baa8-1c5e04db4ddc admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.887186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1362/2709] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:38.891474 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cfec3-c4a4-44f0-9d1d-3e6ec19ccd72 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.903763 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cfec3-c4a4-44f0-9d1d-3e6ec19ccd72 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.905933 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1348/2710] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:38 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:38.910238 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cc290-ae87-436f-baa8-1c5e04db4ddc admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:38.973190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab81e45-d207-4e25-b9e7-c3fdcb1eb85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.974288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab81e45-d207-4e25-b9e7-c3fdcb1eb85e admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.974602 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab81e45-d207-4e25-b9e7-c3fdcb1eb85e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.974879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab81e45-d207-4e25-b9e7-c3fdcb1eb85e admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.975898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab81e45-d207-4e25-b9e7-c3fdcb1eb85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.977908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab81e45-d207-4e25-b9e7-c3fdcb1eb85e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:38.988837 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cc290-ae87-436f-baa8-1c5e04db4ddc admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:38.994245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa09b4-9601-4033-9702-04e73cb4dd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:38.995010 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa09b4-9601-4033-9702-04e73cb4dd0f admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:38.995384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa09b4-9601-4033-9702-04e73cb4dd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:38.996444 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa09b4-9601-4033-9702-04e73cb4dd0f admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:38.997402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa09b4-9601-4033-9702-04e73cb4dd0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:38.999758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa09b4-9601-4033-9702-04e73cb4dd0f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:39.014931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1363/2711] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:38 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:39.019065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab81e45-d207-4e25-b9e7-c3fdcb1eb85e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:39.033988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1349/2712] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:38 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:39.037464 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa09b4-9601-4033-9702-04e73cb4dd0f admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:39.055270 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa09b4-9601-4033-9702-04e73cb4dd0f admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:39.101918 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:39.105850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab81e45-d207-4e25-b9e7-c3fdcb1eb85e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:39.116145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b2404-2280-42bd-a54d-c6243308aaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:39.116857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b2404-2280-42bd-a54d-c6243308aaad admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.117297 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b2404-2280-42bd-a54d-c6243308aaad admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.117499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b2404-2280-42bd-a54d-c6243308aaad admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.118247 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b2404-2280-42bd-a54d-c6243308aaad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:39.121120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b2404-2280-42bd-a54d-c6243308aaad admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:39.135541 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639411a-5523-4041-8ec6-a0093e0a6b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:39.136229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639411a-5523-4041-8ec6-a0093e0a6b3d admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.136509 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639411a-5523-4041-8ec6-a0093e0a6b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.137207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639411a-5523-4041-8ec6-a0093e0a6b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.137922 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639411a-5523-4041-8ec6-a0093e0a6b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:39.139921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639411a-5523-4041-8ec6-a0093e0a6b3d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:39.151428 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1364/2713] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:39 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:39.157677 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1350/2714] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:39.158764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639411a-5523-4041-8ec6-a0093e0a6b3d admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:39.159147 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b2404-2280-42bd-a54d-c6243308aaad admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:39.173073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b2404-2280-42bd-a54d-c6243308aaad admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:39.176297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639411a-5523-4041-8ec6-a0093e0a6b3d admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:39.183611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ce2f2-c929-48d9-8197-85fe24e603aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:39.184411 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae446b6-19b5-422a-afd1-413665274868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:39.184565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ce2f2-c929-48d9-8197-85fe24e603aa admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.184741 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ce2f2-c929-48d9-8197-85fe24e603aa admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.185008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ce2f2-c929-48d9-8197-85fe24e603aa admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.185248 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae446b6-19b5-422a-afd1-413665274868 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.185640 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae446b6-19b5-422a-afd1-413665274868 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.185772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ce2f2-c929-48d9-8197-85fe24e603aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:39.185979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae446b6-19b5-422a-afd1-413665274868 admin admin] PATH_INFO: `/v3/projects/4a45902dd6804ea78ee30624d7a2bb8e/users/0ee7680aed894c87a0a3065539ed5156/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.187375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ce2f2-c929-48d9-8197-85fe24e603aa admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:39.203969 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1365/2715] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:39.204660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae446b6-19b5-422a-afd1-413665274868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a45902dd6804ea78ee30624d7a2bb8e, user_id=0ee7680aed894c87a0a3065539ed5156, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:39.205543 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ce2f2-c929-48d9-8197-85fe24e603aa admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:39.207437 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae446b6-19b5-422a-afd1-413665274868 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:39.225453 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ce2f2-c929-48d9-8197-85fe24e603aa admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:39.246337 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1351/2716] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:39 2022] PUT /identity/v3/projects/4a45902dd6804ea78ee30624d7a2bb8e/users/0ee7680aed894c87a0a3065539ed5156/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:39.247803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae446b6-19b5-422a-afd1-413665274868 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:39.289629 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:39.307986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1018b1-5047-47ff-99fd-da80698d48b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:39.308652 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1018b1-5047-47ff-99fd-da80698d48b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.308926 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1018b1-5047-47ff-99fd-da80698d48b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.309196 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1018b1-5047-47ff-99fd-da80698d48b3 admin admin] PATH_INFO: `/v3/projects/485d8adc7e504933906191e107754426/users/e46dfd826e6b4b888b266e882776bdbe/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.317116 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae446b6-19b5-422a-afd1-413665274868 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:39.323063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efc9d7-5bb5-4778-8493-7e69394f387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:39.324049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc9d7-5bb5-4778-8493-7e69394f387f admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.324519 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc9d7-5bb5-4778-8493-7e69394f387f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.324796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc9d7-5bb5-4778-8493-7e69394f387f admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.325438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efc9d7-5bb5-4778-8493-7e69394f387f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:39.327310 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1018b1-5047-47ff-99fd-da80698d48b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=485d8adc7e504933906191e107754426, user_id=e46dfd826e6b4b888b266e882776bdbe, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:39.327459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efc9d7-5bb5-4778-8493-7e69394f387f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:39.338543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1352/2717] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:39.342393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efc9d7-5bb5-4778-8493-7e69394f387f admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:39.343703 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1018b1-5047-47ff-99fd-da80698d48b3 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:39.356760 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efc9d7-5bb5-4778-8493-7e69394f387f admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:39.366768 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1366/2718] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:39 2022] PUT /identity/v3/projects/485d8adc7e504933906191e107754426/users/e46dfd826e6b4b888b266e882776bdbe/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:39.371610 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1018b1-5047-47ff-99fd-da80698d48b3 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:39.449762 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1018b1-5047-47ff-99fd-da80698d48b3 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:39.457309 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae411715-874c-4296-8cb0-3635884769eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:39.458285 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae411715-874c-4296-8cb0-3635884769eb admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.458875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db357e-4837-45ec-9c0b-ae4a46ce65e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:39.459241 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db357e-4837-45ec-9c0b-ae4a46ce65e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.460230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db357e-4837-45ec-9c0b-ae4a46ce65e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.460230 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db357e-4837-45ec-9c0b-ae4a46ce65e2 admin admin] PATH_INFO: `/v3/projects/4a45902dd6804ea78ee30624d7a2bb8e/users/0ee7680aed894c87a0a3065539ed5156/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.460941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae411715-874c-4296-8cb0-3635884769eb admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.461425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae411715-874c-4296-8cb0-3635884769eb admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.462046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db357e-4837-45ec-9c0b-ae4a46ce65e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a45902dd6804ea78ee30624d7a2bb8e, user_id=0ee7680aed894c87a0a3065539ed5156, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:39.462464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae411715-874c-4296-8cb0-3635884769eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:39.464374 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae411715-874c-4296-8cb0-3635884769eb admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:39.465054 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db357e-4837-45ec-9c0b-ae4a46ce65e2 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:39.485716 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1367/2720] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:39.487005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae411715-874c-4296-8cb0-3635884769eb admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:39.491062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1353/2720] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:39 2022] PUT /identity/v3/projects/4a45902dd6804ea78ee30624d7a2bb8e/users/0ee7680aed894c87a0a3065539ed5156/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:39.492342 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cfd03-b438-40d6-9df2-894e1ae61786 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.492624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cfd03-b438-40d6-9df2-894e1ae61786 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.492901 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cfd03-b438-40d6-9df2-894e1ae61786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.499852 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae411715-874c-4296-8cb0-3635884769eb admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:39.523425 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-9f9cfd03-b438-40d6-9df2-894e1ae61786 None None] MFA Rules not processed for user `0ee7680aed894c87a0a3065539ed5156`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:39.525258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-9f9cfd03-b438-40d6-9df2-894e1ae61786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:39.565953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:39.571802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822da61-584d-4496-88f4-a63f5926351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:39.573464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822da61-584d-4496-88f4-a63f5926351c admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.573464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822da61-584d-4496-88f4-a63f5926351c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.573464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822da61-584d-4496-88f4-a63f5926351c admin admin] PATH_INFO: `/v3/projects/485d8adc7e504933906191e107754426/users/e46dfd826e6b4b888b266e882776bdbe/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.576061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822da61-584d-4496-88f4-a63f5926351c admin admin] RBAC: Authorizing `identity:create_grant(project_id=485d8adc7e504933906191e107754426, user_id=e46dfd826e6b4b888b266e882776bdbe, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:39.579202 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822da61-584d-4496-88f4-a63f5926351c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:39.591396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1368/2721] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:39 2022] PUT /identity/v3/projects/485d8adc7e504933906191e107754426/users/e46dfd826e6b4b888b266e882776bdbe/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:39.602618 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a256017-404d-41bf-9429-ff9f435f6c41 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.602989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a256017-404d-41bf-9429-ff9f435f6c41 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.603738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a256017-404d-41bf-9429-ff9f435f6c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.629256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1354/2722] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:39.633441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-5a256017-404d-41bf-9429-ff9f435f6c41 None None] MFA Rules not processed for user `e46dfd826e6b4b888b266e882776bdbe`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:39.634996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5a256017-404d-41bf-9429-ff9f435f6c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:39.636635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cfd03-b438-40d6-9df2-894e1ae61786 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:39.638533 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-9f9cfd03-b438-40d6-9df2-894e1ae61786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:39.658127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cfd03-b438-40d6-9df2-894e1ae61786 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:39.707563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:39.722663 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1369/2723] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:39.723450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a256017-404d-41bf-9429-ff9f435f6c41 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:39.724809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5a256017-404d-41bf-9429-ff9f435f6c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:39.741297 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:39.741950 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.742226 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.742499 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] PATH_INFO: `/v3/users/d879837b419a4b16967009e2c3b28ccc` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.743742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d879837b419a4b16967009e2c3b28ccc)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:39.745716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:39.796566 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a256017-404d-41bf-9429-ff9f435f6c41 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:39.800257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2e6ff-3af2-46ce-926e-ff753836c9d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:39.800867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2e6ff-3af2-46ce-926e-ff753836c9d2 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.801862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2e6ff-3af2-46ce-926e-ff753836c9d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.801862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2e6ff-3af2-46ce-926e-ff753836c9d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.803620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd879837b419a4b16967009e2c3b28ccc'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:39.804701 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd879837b419a4b16967009e2c3b28ccc'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:39.812914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd879837b419a4b16967009e2c3b28ccc'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:39.813850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd879837b419a4b16967009e2c3b28ccc'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:39.830433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd879837b419a4b16967009e2c3b28ccc'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:39.843905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1355/2724] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:39 2022] DELETE /identity/v3/users/d879837b419a4b16967009e2c3b28ccc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:39.844810 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:39.846291 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:39.867325 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2e6ff-3af2-46ce-926e-ff753836c9d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:39.869116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2e6ff-3af2-46ce-926e-ff753836c9d2 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:39.880035 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1370/2725] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:39.913912 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:39.931829 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c5d9b-40e8-47f1-a512-a12abc246c18 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:39.942445 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8388d9b-c9ad-4ad0-9b28-514a3f8ff020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:39.943592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8388d9b-c9ad-4ad0-9b28-514a3f8ff020 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:39.943879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8388d9b-c9ad-4ad0-9b28-514a3f8ff020 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:39.944153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8388d9b-c9ad-4ad0-9b28-514a3f8ff020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:39.948441 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a8388d9b-c9ad-4ad0-9b28-514a3f8ff020 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:40.036894 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8388d9b-c9ad-4ad0-9b28-514a3f8ff020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:40.038801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8388d9b-c9ad-4ad0-9b28-514a3f8ff020 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:40.051455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1356/2726] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:40.088599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2e6ff-3af2-46ce-926e-ff753836c9d2 service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:40.115710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2e6ff-3af2-46ce-926e-ff753836c9d2 service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:40.137244 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8388d9b-c9ad-4ad0-9b28-514a3f8ff020 service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:40.153687 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8388d9b-c9ad-4ad0-9b28-514a3f8ff020 service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:40.163180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aa7a7-95b7-4d52-a4fe-b905f4fbad1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:40.163882 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa7a7-95b7-4d52-a4fe-b905f4fbad1e service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:40.164164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa7a7-95b7-4d52-a4fe-b905f4fbad1e service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:40.164444 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa7a7-95b7-4d52-a4fe-b905f4fbad1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:40.166921 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d99aa7a7-95b7-4d52-a4fe-b905f4fbad1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:40.283291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:40.284825 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:40.285109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:40.286048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] PATH_INFO: `/v3/projects/a5412c7b7d2e44d4bf5290424ba2fd01` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:40.288371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5412c7b7d2e44d4bf5290424ba2fd01)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:40.292872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:40.303001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99aa7a7-95b7-4d52-a4fe-b905f4fbad1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:40.303001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99aa7a7-95b7-4d52-a4fe-b905f4fbad1e service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:40.323018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1357/2727] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:40.385316 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5412c7b7d2e44d4bf5290424ba2fd01', 'request_id': 'req-fdd849e9-77a2-445d-8b0a-01d5d5095b23'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:40.386116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:40.394883 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5412c7b7d2e44d4bf5290424ba2fd01', 'request_id': 'req-fdd849e9-77a2-445d-8b0a-01d5d5095b23'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:40.404025 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5412c7b7d2e44d4bf5290424ba2fd01', 'request_id': 'req-fdd849e9-77a2-445d-8b0a-01d5d5095b23'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:40.417546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] The token cache is being invalidate because project a5412c7b7d2e44d4bf5290424ba2fd01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:40.417836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:40.418552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:40.420235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1371/2728] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:40 2022] DELETE /identity/v3/projects/a5412c7b7d2e44d4bf5290424ba2fd01 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:40.424274 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aa7a7-95b7-4d52-a4fe-b905f4fbad1e service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:40.426583 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d99aa7a7-95b7-4d52-a4fe-b905f4fbad1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:40.441144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aa7a7-95b7-4d52-a4fe-b905f4fbad1e service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:40.526385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa79362-2958-4502-b5f7-cf5fd3ae0b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:40.527099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa79362-2958-4502-b5f7-cf5fd3ae0b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:40.527384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa79362-2958-4502-b5f7-cf5fd3ae0b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:40.527656 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa79362-2958-4502-b5f7-cf5fd3ae0b26 admin admin] PATH_INFO: `/v3/users/cb3b222dc17d48faa301bde45d79b793` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:40.528905 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa79362-2958-4502-b5f7-cf5fd3ae0b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3b222dc17d48faa301bde45d79b793)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:40.531311 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa79362-2958-4502-b5f7-cf5fd3ae0b26 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:40.583490 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:40.591703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-cfa79362-2958-4502-b5f7-cf5fd3ae0b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3b222dc17d48faa301bde45d79b793'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:40.592461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-cfa79362-2958-4502-b5f7-cf5fd3ae0b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3b222dc17d48faa301bde45d79b793'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:40.603401 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-cfa79362-2958-4502-b5f7-cf5fd3ae0b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3b222dc17d48faa301bde45d79b793'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:40.604228 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-cfa79362-2958-4502-b5f7-cf5fd3ae0b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3b222dc17d48faa301bde45d79b793'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:40.622556 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-cfa79362-2958-4502-b5f7-cf5fd3ae0b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3b222dc17d48faa301bde45d79b793'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:40.641544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1358/2729] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:40 2022] DELETE /identity/v3/users/cb3b222dc17d48faa301bde45d79b793 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:40.841777 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:40.843443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:40.867666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd849e9-77a2-445d-8b0a-01d5d5095b23 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:40.933828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca2715-cbd4-4daa-ba02-7318fe7b58c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:40.934489 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca2715-cbd4-4daa-ba02-7318fe7b58c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:40.934796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca2715-cbd4-4daa-ba02-7318fe7b58c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:40.935072 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca2715-cbd4-4daa-ba02-7318fe7b58c0 admin admin] PATH_INFO: `/v3/projects/807b0ca45d65483c95ef640fb03f7851` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:40.936187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca2715-cbd4-4daa-ba02-7318fe7b58c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=807b0ca45d65483c95ef640fb03f7851)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:40.938128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca2715-cbd4-4daa-ba02-7318fe7b58c0 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:40.985801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-abca2715-cbd4-4daa-ba02-7318fe7b58c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807b0ca45d65483c95ef640fb03f7851', 'request_id': 'req-abca2715-cbd4-4daa-ba02-7318fe7b58c0'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:40.991226 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-abca2715-cbd4-4daa-ba02-7318fe7b58c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807b0ca45d65483c95ef640fb03f7851', 'request_id': 'req-abca2715-cbd4-4daa-ba02-7318fe7b58c0'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:40.999936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-abca2715-cbd4-4daa-ba02-7318fe7b58c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807b0ca45d65483c95ef640fb03f7851', 'request_id': 'req-abca2715-cbd4-4daa-ba02-7318fe7b58c0'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:41.012753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-abca2715-cbd4-4daa-ba02-7318fe7b58c0 admin admin] The token cache is being invalidate because project 807b0ca45d65483c95ef640fb03f7851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:41.013018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-abca2715-cbd4-4daa-ba02-7318fe7b58c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:41.013662 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-abca2715-cbd4-4daa-ba02-7318fe7b58c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:41.015194 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1372/2730] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:40 2022] DELETE /identity/v3/projects/807b0ca45d65483c95ef640fb03f7851 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:41.022471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52368e55-bbef-43b1-a9c5-2ca8cd9d2306 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:41.022998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52368e55-bbef-43b1-a9c5-2ca8cd9d2306 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:41.023302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52368e55-bbef-43b1-a9c5-2ca8cd9d2306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:41.044885 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-52368e55-bbef-43b1-a9c5-2ca8cd9d2306 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:41.046194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-52368e55-bbef-43b1-a9c5-2ca8cd9d2306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:41.109726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1359/2731] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:41.117519 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e76f-20d6-4a56-bb5d-e4b3bea33d3a None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:41.117801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e76f-20d6-4a56-bb5d-e4b3bea33d3a None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:41.118065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e76f-20d6-4a56-bb5d-e4b3bea33d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:41.137680 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-8185e76f-20d6-4a56-bb5d-e4b3bea33d3a None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:41.138937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8185e76f-20d6-4a56-bb5d-e4b3bea33d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:41.146851 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1373/2732] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:41.151579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52368e55-bbef-43b1-a9c5-2ca8cd9d2306 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:41.163087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52368e55-bbef-43b1-a9c5-2ca8cd9d2306 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:41.168558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e7d7-f915-4da6-95aa-1679117dc967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:41.169316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e7d7-f915-4da6-95aa-1679117dc967 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:41.169603 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e7d7-f915-4da6-95aa-1679117dc967 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:41.169879 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e7d7-f915-4da6-95aa-1679117dc967 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:41.170560 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439e7d7-f915-4da6-95aa-1679117dc967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:41.170878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439e7d7-f915-4da6-95aa-1679117dc967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:41.172504 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439e7d7-f915-4da6-95aa-1679117dc967 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:41.185726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1360/2733] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:41:41.189939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185e76f-20d6-4a56-bb5d-e4b3bea33d3a None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:41.200395 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185e76f-20d6-4a56-bb5d-e4b3bea33d3a None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:41.206125 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aa4a1-6d33-48a9-916d-fef9a5a64303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:41.206762 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aa4a1-6d33-48a9-916d-fef9a5a64303 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:41.207038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aa4a1-6d33-48a9-916d-fef9a5a64303 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:41.207327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aa4a1-6d33-48a9-916d-fef9a5a64303 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:41.207931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2aa4a1-6d33-48a9-916d-fef9a5a64303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:41.209953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2aa4a1-6d33-48a9-916d-fef9a5a64303 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:41.241388 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1374/2734] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:41 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:41.245564 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e7d7-f915-4da6-95aa-1679117dc967 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:41.255554 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e7d7-f915-4da6-95aa-1679117dc967 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:41.311986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e83ef-1619-482f-8a82-5a2654136469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:41.312595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e83ef-1619-482f-8a82-5a2654136469 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:41.312875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e83ef-1619-482f-8a82-5a2654136469 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:41.314579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e83ef-1619-482f-8a82-5a2654136469 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:41.314579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e83ef-1619-482f-8a82-5a2654136469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:41.315785 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e83ef-1619-482f-8a82-5a2654136469 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:41.344964 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1361/2735] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:41 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:41.349182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aa4a1-6d33-48a9-916d-fef9a5a64303 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:41.361327 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aa4a1-6d33-48a9-916d-fef9a5a64303 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:41.376119 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322828f1-a0b5-4d89-b7c0-e87d329f82fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:41.376751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322828f1-a0b5-4d89-b7c0-e87d329f82fc admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:41.377064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322828f1-a0b5-4d89-b7c0-e87d329f82fc admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:41.377304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322828f1-a0b5-4d89-b7c0-e87d329f82fc admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:41.378075 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322828f1-a0b5-4d89-b7c0-e87d329f82fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:41.379721 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322828f1-a0b5-4d89-b7c0-e87d329f82fc admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:41.399569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1375/2736] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:41.401031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e83ef-1619-482f-8a82-5a2654136469 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:41.411461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e83ef-1619-482f-8a82-5a2654136469 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:41.419225 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188c758-fa69-4227-8238-faa721277487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:41.420020 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188c758-fa69-4227-8238-faa721277487 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:41.420371 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188c758-fa69-4227-8238-faa721277487 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:41.420717 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188c758-fa69-4227-8238-faa721277487 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:41.421448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188c758-fa69-4227-8238-faa721277487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:41.423180 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188c758-fa69-4227-8238-faa721277487 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:41.436406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1362/2737] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:41.439315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322828f1-a0b5-4d89-b7c0-e87d329f82fc admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:41.456840 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322828f1-a0b5-4d89-b7c0-e87d329f82fc admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:41.464509 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae4d8f-7eaa-4b7a-82b3-e294c09b8684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:41.465177 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae4d8f-7eaa-4b7a-82b3-e294c09b8684 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:41.465461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae4d8f-7eaa-4b7a-82b3-e294c09b8684 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:41.465738 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae4d8f-7eaa-4b7a-82b3-e294c09b8684 admin admin] PATH_INFO: `/v3/projects/f846559ccc0a4b3fa1670592272c39fa/users/bd5bdec3d09142c4adc92a64fc82605a/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:41.482019 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae4d8f-7eaa-4b7a-82b3-e294c09b8684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f846559ccc0a4b3fa1670592272c39fa, user_id=bd5bdec3d09142c4adc92a64fc82605a, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:41.485448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae4d8f-7eaa-4b7a-82b3-e294c09b8684 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:41.502571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1376/2738] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:41 2022] PUT /identity/v3/projects/f846559ccc0a4b3fa1670592272c39fa/users/bd5bdec3d09142c4adc92a64fc82605a/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:41.576606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372e3df-fb1b-4501-9fb6-bf5a3285c84d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:41.576884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372e3df-fb1b-4501-9fb6-bf5a3285c84d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:41.577161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372e3df-fb1b-4501-9fb6-bf5a3285c84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:41.606334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-c372e3df-fb1b-4501-9fb6-bf5a3285c84d None None] MFA Rules not processed for user `bd5bdec3d09142c4adc92a64fc82605a`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:41.607609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c372e3df-fb1b-4501-9fb6-bf5a3285c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:41.617254 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:41.678007 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1363/2739] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:41.690223 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae4d8f-7eaa-4b7a-82b3-e294c09b8684 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:41.692851 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-27ae4d8f-7eaa-4b7a-82b3-e294c09b8684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:41.701695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:41.777739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae4d8f-7eaa-4b7a-82b3-e294c09b8684 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:41.778895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210fa05-fb63-4eb4-85c9-0ea1cd5d7229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:41.779587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210fa05-fb63-4eb4-85c9-0ea1cd5d7229 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:41.779873 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210fa05-fb63-4eb4-85c9-0ea1cd5d7229 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:41.780151 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210fa05-fb63-4eb4-85c9-0ea1cd5d7229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:41.789561 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210fa05-fb63-4eb4-85c9-0ea1cd5d7229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:41.791073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210fa05-fb63-4eb4-85c9-0ea1cd5d7229 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:41.800737 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1377/2740] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:41:41.820582 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372e3df-fb1b-4501-9fb6-bf5a3285c84d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:41.893578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372e3df-fb1b-4501-9fb6-bf5a3285c84d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:41.898216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:41.898872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:41.899144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:41.899416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] PATH_INFO: `/v3/users/bd5bdec3d09142c4adc92a64fc82605a` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:41.900755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5bdec3d09142c4adc92a64fc82605a)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:41.902722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:41.954316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5bdec3d09142c4adc92a64fc82605a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:41.955225 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5bdec3d09142c4adc92a64fc82605a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:41.963192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5bdec3d09142c4adc92a64fc82605a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:41.964027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5bdec3d09142c4adc92a64fc82605a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:41.977266 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5bdec3d09142c4adc92a64fc82605a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:41.989552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1364/2741] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:41 2022] DELETE /identity/v3/users/bd5bdec3d09142c4adc92a64fc82605a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:41.994578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68b308-3fb1-47c3-901c-4adcd272a6a0 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:41.995384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68b308-3fb1-47c3-901c-4adcd272a6a0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:41.995675 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68b308-3fb1-47c3-901c-4adcd272a6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:42.015892 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-fc68b308-3fb1-47c3-901c-4adcd272a6a0 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:42.017106 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-fc68b308-3fb1-47c3-901c-4adcd272a6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:42.079936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1378/2742] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:42.090824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:42.092359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:42.129258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:42.158912 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8935b69-fade-4c83-881e-148a4af13d78 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:42.163312 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b38af-1da1-4692-b603-c45cc655e1d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:42.164336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b38af-1da1-4692-b603-c45cc655e1d3 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:42.164628 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b38af-1da1-4692-b603-c45cc655e1d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:42.165001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b38af-1da1-4692-b603-c45cc655e1d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:42.175282 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b38af-1da1-4692-b603-c45cc655e1d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:42.176887 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b38af-1da1-4692-b603-c45cc655e1d3 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:42.191947 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1365/2743] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:42.454670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68b308-3fb1-47c3-901c-4adcd272a6a0 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:42.456144 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-fc68b308-3fb1-47c3-901c-4adcd272a6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:42.471151 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68b308-3fb1-47c3-901c-4adcd272a6a0 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:42.475713 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:42.476336 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:42.476609 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:42.476876 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] PATH_INFO: `/v3/projects/f846559ccc0a4b3fa1670592272c39fa` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:42.478547 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f846559ccc0a4b3fa1670592272c39fa)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:42.480389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:42.527166 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f846559ccc0a4b3fa1670592272c39fa', 'request_id': 'req-22c4016e-622e-4e70-9fcf-be396a3a753b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:42.534246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f846559ccc0a4b3fa1670592272c39fa', 'request_id': 'req-22c4016e-622e-4e70-9fcf-be396a3a753b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:42.542710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f846559ccc0a4b3fa1670592272c39fa', 'request_id': 'req-22c4016e-622e-4e70-9fcf-be396a3a753b'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:42.553752 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] The token cache is being invalidate because project f846559ccc0a4b3fa1670592272c39fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:42.554038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:42.554690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:42.556796 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1379/2744] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:42 2022] DELETE /identity/v3/projects/f846559ccc0a4b3fa1670592272c39fa => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:42.561782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049ca86-761a-41c2-bcd9-03dff39147e2 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:42.562068 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049ca86-761a-41c2-bcd9-03dff39147e2 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:42.562341 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049ca86-761a-41c2-bcd9-03dff39147e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:42.582033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-4049ca86-761a-41c2-bcd9-03dff39147e2 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:42.583340 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4049ca86-761a-41c2-bcd9-03dff39147e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:42.613132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:42.614624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:42.647161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1366/2745] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:42.654944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621de9ae-b231-4083-83fa-35b60293fc8c None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:42.655137 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621de9ae-b231-4083-83fa-35b60293fc8c None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:42.655416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621de9ae-b231-4083-83fa-35b60293fc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:42.657078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:42.678415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-621de9ae-b231-4083-83fa-35b60293fc8c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:42.679739 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-621de9ae-b231-4083-83fa-35b60293fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:42.688525 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1367/2746] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:42.692624 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621de9ae-b231-4083-83fa-35b60293fc8c None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:42.692991 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4016e-622e-4e70-9fcf-be396a3a753b admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:42.697847 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560268f1-0021-4e51-b05e-2e15b30474b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:42.698488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560268f1-0021-4e51-b05e-2e15b30474b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:42.698844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560268f1-0021-4e51-b05e-2e15b30474b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:42.699156 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560268f1-0021-4e51-b05e-2e15b30474b3 admin admin] PATH_INFO: `/v3/users/efe510cadf8648dc962d1ee3e715d129` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:42.700332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560268f1-0021-4e51-b05e-2e15b30474b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efe510cadf8648dc962d1ee3e715d129)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:42.702308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560268f1-0021-4e51-b05e-2e15b30474b3 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:42.708262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621de9ae-b231-4083-83fa-35b60293fc8c None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:42.715019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769d2db-1393-416d-8ca9-1514cd0290a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:42.715880 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d2db-1393-416d-8ca9-1514cd0290a9 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:42.716229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d2db-1393-416d-8ca9-1514cd0290a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:42.716572 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d2db-1393-416d-8ca9-1514cd0290a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:42.717396 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769d2db-1393-416d-8ca9-1514cd0290a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:42.717764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769d2db-1393-416d-8ca9-1514cd0290a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:42.719607 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769d2db-1393-416d-8ca9-1514cd0290a9 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:42.736260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1368/2747] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:41:42.740523 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769d2db-1393-416d-8ca9-1514cd0290a9 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:42.750316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769d2db-1393-416d-8ca9-1514cd0290a9 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:42.755149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7924fb-97e6-493c-bab5-5f7f91131492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:42.755739 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7924fb-97e6-493c-bab5-5f7f91131492 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:42.756018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7924fb-97e6-493c-bab5-5f7f91131492 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:42.756283 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7924fb-97e6-493c-bab5-5f7f91131492 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:42.756954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7924fb-97e6-493c-bab5-5f7f91131492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:42.758929 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7924fb-97e6-493c-bab5-5f7f91131492 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:42.764300 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-560268f1-0021-4e51-b05e-2e15b30474b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efe510cadf8648dc962d1ee3e715d129'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:42.765065 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-560268f1-0021-4e51-b05e-2e15b30474b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efe510cadf8648dc962d1ee3e715d129'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:42.773234 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-560268f1-0021-4e51-b05e-2e15b30474b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efe510cadf8648dc962d1ee3e715d129'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:42.783665 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-560268f1-0021-4e51-b05e-2e15b30474b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efe510cadf8648dc962d1ee3e715d129'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:42.784909 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-560268f1-0021-4e51-b05e-2e15b30474b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efe510cadf8648dc962d1ee3e715d129'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:42.799497 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1369/2748] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:42 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:42.802619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7924fb-97e6-493c-bab5-5f7f91131492 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:42.805764 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-9e7924fb-97e6-493c-bab5-5f7f91131492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:42.812312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1380/2749] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:42 2022] DELETE /identity/v3/users/efe510cadf8648dc962d1ee3e715d129 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:42.816424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de519cb-3461-4427-96f2-2459cb86a75c None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:42.816827 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de519cb-3461-4427-96f2-2459cb86a75c None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:42.817227 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de519cb-3461-4427-96f2-2459cb86a75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:42.840521 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-6de519cb-3461-4427-96f2-2459cb86a75c None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:42.841854 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6de519cb-3461-4427-96f2-2459cb86a75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:42.890008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7924fb-97e6-493c-bab5-5f7f91131492 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:42.936585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:42.940830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1381/2750] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:42.951591 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de519cb-3461-4427-96f2-2459cb86a75c None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:42.953153 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-6de519cb-3461-4427-96f2-2459cb86a75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:42.963997 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc7e95-9164-48d0-9aec-494b4108eabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:42.964948 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc7e95-9164-48d0-9aec-494b4108eabd admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:42.965412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc7e95-9164-48d0-9aec-494b4108eabd admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:42.965870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc7e95-9164-48d0-9aec-494b4108eabd admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:42.966699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc7e95-9164-48d0-9aec-494b4108eabd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:42.970050 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc7e95-9164-48d0-9aec-494b4108eabd admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:42.999318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1370/2751] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:42 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:43.003620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc7e95-9164-48d0-9aec-494b4108eabd admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:43.018853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc7e95-9164-48d0-9aec-494b4108eabd admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:43.023116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de519cb-3461-4427-96f2-2459cb86a75c None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:43.026450 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7459a4-79ca-46a8-a18e-704886b38b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:43.027174 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7459a4-79ca-46a8-a18e-704886b38b0f admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:43.027462 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7459a4-79ca-46a8-a18e-704886b38b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:43.027738 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7459a4-79ca-46a8-a18e-704886b38b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:43.028384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7459a4-79ca-46a8-a18e-704886b38b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:43.029798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6779ce-fc61-438f-a564-7e6c8f0c74ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:43.030032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7459a4-79ca-46a8-a18e-704886b38b0f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:43.030972 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6779ce-fc61-438f-a564-7e6c8f0c74ef service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:43.031567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6779ce-fc61-438f-a564-7e6c8f0c74ef service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:43.031908 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6779ce-fc61-438f-a564-7e6c8f0c74ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:43.038686 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:43.040976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1371/2752] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:43.044028 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6779ce-fc61-438f-a564-7e6c8f0c74ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:43.045473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7459a4-79ca-46a8-a18e-704886b38b0f admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:43.046595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6779ce-fc61-438f-a564-7e6c8f0c74ef service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:43.055630 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7459a4-79ca-46a8-a18e-704886b38b0f admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:43.057912 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1382/2753] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:41:43.061245 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbc43e-8b14-43d6-9007-fd2b291f6412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:43.061853 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc43e-8b14-43d6-9007-fd2b291f6412 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:43.062137 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc43e-8b14-43d6-9007-fd2b291f6412 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:43.062411 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc43e-8b14-43d6-9007-fd2b291f6412 admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:43.063089 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbc43e-8b14-43d6-9007-fd2b291f6412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:43.064713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbc43e-8b14-43d6-9007-fd2b291f6412 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:43.076514 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1372/2754] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:43.080654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6779ce-fc61-438f-a564-7e6c8f0c74ef service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:43.091369 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6779ce-fc61-438f-a564-7e6c8f0c74ef service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:43.097090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c10700-5d8d-449a-8083-9cd69593b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:43.097375 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c10700-5d8d-449a-8083-9cd69593b2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:43.097651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c10700-5d8d-449a-8083-9cd69593b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:43.097931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c10700-5d8d-449a-8083-9cd69593b2b4 admin admin] PATH_INFO: `/v3/projects/754a6b43802f404d88987adc642a2def/users/0a497efd79fb4b62ac7356cfb593c38f/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:43.114488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c10700-5d8d-449a-8083-9cd69593b2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=754a6b43802f404d88987adc642a2def, user_id=0a497efd79fb4b62ac7356cfb593c38f, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:43.117373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c10700-5d8d-449a-8083-9cd69593b2b4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:43.132828 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1383/2755] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:43 2022] PUT /identity/v3/projects/754a6b43802f404d88987adc642a2def/users/0a497efd79fb4b62ac7356cfb593c38f/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:43.144446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fb4fd-228b-4238-aca9-6c19ef89eb2b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:43.145568 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fb4fd-228b-4238-aca9-6c19ef89eb2b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:43.145916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fb4fd-228b-4238-aca9-6c19ef89eb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:43.178817 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-d82fb4fd-228b-4238-aca9-6c19ef89eb2b None None] MFA Rules not processed for user `0a497efd79fb4b62ac7356cfb593c38f`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:43.180057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d82fb4fd-228b-4238-aca9-6c19ef89eb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:43.282571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1373/2756] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:43.292884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c10700-5d8d-449a-8083-9cd69593b2b4 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:43.294657 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-71c10700-5d8d-449a-8083-9cd69593b2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:43.374386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c10700-5d8d-449a-8083-9cd69593b2b4 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:43.378277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fb4fd-228b-4238-aca9-6c19ef89eb2b None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:43.379851 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-d82fb4fd-228b-4238-aca9-6c19ef89eb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:43.393462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c2904-f593-41e6-950c-2df39d207575 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:43.395002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c2904-f593-41e6-950c-2df39d207575 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:43.395002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c2904-f593-41e6-950c-2df39d207575 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:43.395002 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c2904-f593-41e6-950c-2df39d207575 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:43.420277 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c2904-f593-41e6-950c-2df39d207575 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:43.421923 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c2904-f593-41e6-950c-2df39d207575 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:43.432934 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1384/2757] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:43 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:43.464721 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fb4fd-228b-4238-aca9-6c19ef89eb2b None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:43.470374 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:43.471061 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:43.471336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:43.471884 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] PATH_INFO: `/v3/projects/9f7a5c6810da42608c1f74ef297ff546` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:43.473373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7a5c6810da42608c1f74ef297ff546)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:43.475562 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:43.539994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:43.550536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7a5c6810da42608c1f74ef297ff546', 'request_id': 'req-43848c72-062a-4cfc-9062-f64788231daa'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:43.558451 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7a5c6810da42608c1f74ef297ff546', 'request_id': 'req-43848c72-062a-4cfc-9062-f64788231daa'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:43.569703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7a5c6810da42608c1f74ef297ff546', 'request_id': 'req-43848c72-062a-4cfc-9062-f64788231daa'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:43.584578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] The token cache is being invalidate because project 9f7a5c6810da42608c1f74ef297ff546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:43.585157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:43.585998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:43.588710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1374/2758] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:43 2022] DELETE /identity/v3/projects/9f7a5c6810da42608c1f74ef297ff546 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:43.593260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c2904-f593-41e6-950c-2df39d207575 service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:43.619249 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c2904-f593-41e6-950c-2df39d207575 service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:43.686973 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207baf4-1f50-4b69-8a9c-1d1cfbe8b1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:43.688100 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207baf4-1f50-4b69-8a9c-1d1cfbe8b1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:43.688564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207baf4-1f50-4b69-8a9c-1d1cfbe8b1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:43.689183 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207baf4-1f50-4b69-8a9c-1d1cfbe8b1b3 admin admin] PATH_INFO: `/v3/users/0ee7680aed894c87a0a3065539ed5156` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:43.690725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207baf4-1f50-4b69-8a9c-1d1cfbe8b1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee7680aed894c87a0a3065539ed5156)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:43.692826 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207baf4-1f50-4b69-8a9c-1d1cfbe8b1b3 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:43.754042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9207baf4-1f50-4b69-8a9c-1d1cfbe8b1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee7680aed894c87a0a3065539ed5156'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:43.754870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9207baf4-1f50-4b69-8a9c-1d1cfbe8b1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee7680aed894c87a0a3065539ed5156'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:43.764307 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9207baf4-1f50-4b69-8a9c-1d1cfbe8b1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee7680aed894c87a0a3065539ed5156'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:43.772491 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9207baf4-1f50-4b69-8a9c-1d1cfbe8b1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee7680aed894c87a0a3065539ed5156'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:43.773492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-9207baf4-1f50-4b69-8a9c-1d1cfbe8b1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee7680aed894c87a0a3065539ed5156'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:43.782954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:43.795935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1385/2759] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:43 2022] DELETE /identity/v3/users/0ee7680aed894c87a0a3065539ed5156 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:43.851085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:43.852946 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:43.869705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43848c72-062a-4cfc-9062-f64788231daa admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:43.947676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:43.948320 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:43.948598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:43.948855 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] PATH_INFO: `/v3/users/6703f903089342d08519343d2376b6dd` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:43.950035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6703f903089342d08519343d2376b6dd)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:43.952031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:44.030620 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6703f903089342d08519343d2376b6dd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.031400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6703f903089342d08519343d2376b6dd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.040428 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6703f903089342d08519343d2376b6dd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.041191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6703f903089342d08519343d2376b6dd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.056587 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6703f903089342d08519343d2376b6dd'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.075317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1375/2760] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:43 2022] DELETE /identity/v3/users/6703f903089342d08519343d2376b6dd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:44.080088 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd7be7-a901-4220-a8e9-b49de5a5e6c4 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.080604 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd7be7-a901-4220-a8e9-b49de5a5e6c4 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.080709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd7be7-a901-4220-a8e9-b49de5a5e6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.104373 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-d1dd7be7-a901-4220-a8e9-b49de5a5e6c4 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:44.105735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d1dd7be7-a901-4220-a8e9-b49de5a5e6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:44.143550 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:44.145114 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:44.189787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1386/2761] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:44.196315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd7be7-a901-4220-a8e9-b49de5a5e6c4 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:44.198330 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-d1dd7be7-a901-4220-a8e9-b49de5a5e6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:44.215579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:44.235134 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451af19-fdf3-433a-8742-233a6ba61074 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:44.245019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a01111-9608-4551-be8a-60fcafd9e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:44.245605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a01111-9608-4551-be8a-60fcafd9e5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.245888 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a01111-9608-4551-be8a-60fcafd9e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.246193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a01111-9608-4551-be8a-60fcafd9e5a4 admin admin] PATH_INFO: `/v3/projects/4a45902dd6804ea78ee30624d7a2bb8e` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.247419 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a01111-9608-4551-be8a-60fcafd9e5a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a45902dd6804ea78ee30624d7a2bb8e)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:44.249381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a01111-9608-4551-be8a-60fcafd9e5a4 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:44.266590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd7be7-a901-4220-a8e9-b49de5a5e6c4 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:44.272638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b59bb-f505-4c02-bad7-a3d92eca37ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:44.273335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b59bb-f505-4c02-bad7-a3d92eca37ad service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.273623 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b59bb-f505-4c02-bad7-a3d92eca37ad service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.273895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b59bb-f505-4c02-bad7-a3d92eca37ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.284152 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b59bb-f505-4c02-bad7-a3d92eca37ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:44.285638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b59bb-f505-4c02-bad7-a3d92eca37ad service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:44.295772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1387/2762] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:41:44.299870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-87a01111-9608-4551-be8a-60fcafd9e5a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a45902dd6804ea78ee30624d7a2bb8e', 'request_id': 'req-87a01111-9608-4551-be8a-60fcafd9e5a4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.306611 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-87a01111-9608-4551-be8a-60fcafd9e5a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a45902dd6804ea78ee30624d7a2bb8e', 'request_id': 'req-87a01111-9608-4551-be8a-60fcafd9e5a4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.314883 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-87a01111-9608-4551-be8a-60fcafd9e5a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a45902dd6804ea78ee30624d7a2bb8e', 'request_id': 'req-87a01111-9608-4551-be8a-60fcafd9e5a4'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.330053 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-87a01111-9608-4551-be8a-60fcafd9e5a4 admin admin] The token cache is being invalidate because project 4a45902dd6804ea78ee30624d7a2bb8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:44.330346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-87a01111-9608-4551-be8a-60fcafd9e5a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.331235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-87a01111-9608-4551-be8a-60fcafd9e5a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.333023 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1376/2763] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:44 2022] DELETE /identity/v3/projects/4a45902dd6804ea78ee30624d7a2bb8e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:44.338393 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f9579-f269-4587-8f64-0f20ed7d6fac None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.338815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f9579-f269-4587-8f64-0f20ed7d6fac None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.339405 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f9579-f269-4587-8f64-0f20ed7d6fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.360762 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-075f9579-f269-4587-8f64-0f20ed7d6fac None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:44.362092 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-075f9579-f269-4587-8f64-0f20ed7d6fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:44.429434 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1388/2764] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:44.437799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29b323-1fa7-4db1-b318-877eeb660a01 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.438087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29b323-1fa7-4db1-b318-877eeb660a01 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.438365 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29b323-1fa7-4db1-b318-877eeb660a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.475994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-4c29b323-1fa7-4db1-b318-877eeb660a01 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:44.477286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4c29b323-1fa7-4db1-b318-877eeb660a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:44.497249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1377/2765] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:44.501474 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f9579-f269-4587-8f64-0f20ed7d6fac None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:44.511366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f9579-f269-4587-8f64-0f20ed7d6fac None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:44.516141 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa075372-795a-416a-9f58-bb5e8027a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:44.516905 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa075372-795a-416a-9f58-bb5e8027a741 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.517209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa075372-795a-416a-9f58-bb5e8027a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.517448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa075372-795a-416a-9f58-bb5e8027a741 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.518113 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa075372-795a-416a-9f58-bb5e8027a741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:44.518397 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa075372-795a-416a-9f58-bb5e8027a741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:44.520038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa075372-795a-416a-9f58-bb5e8027a741 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:44.532261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1389/2766] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:41:44.539881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29b323-1fa7-4db1-b318-877eeb660a01 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:44.551209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29b323-1fa7-4db1-b318-877eeb660a01 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:44.557147 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eb9c7-92a9-4ade-a230-d2a69c9cd3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:44.557762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb9c7-92a9-4ade-a230-d2a69c9cd3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.558041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb9c7-92a9-4ade-a230-d2a69c9cd3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.558310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb9c7-92a9-4ade-a230-d2a69c9cd3d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.559153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0eb9c7-92a9-4ade-a230-d2a69c9cd3d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:44.561082 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0eb9c7-92a9-4ade-a230-d2a69c9cd3d1 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:44.592004 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1378/2767] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:44 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:44.598031 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa075372-795a-416a-9f58-bb5e8027a741 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:44.613159 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eb9c7-92a9-4ade-a230-d2a69c9cd3d1 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:44.614103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa075372-795a-416a-9f58-bb5e8027a741 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:44.615100 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ea0eb9c7-92a9-4ade-a230-d2a69c9cd3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:44.636013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:44.678324 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e825ad7-1066-4595-8c28-77b4739ea8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:44.678962 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e825ad7-1066-4595-8c28-77b4739ea8df admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.679237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e825ad7-1066-4595-8c28-77b4739ea8df admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.679518 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e825ad7-1066-4595-8c28-77b4739ea8df admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.680160 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e825ad7-1066-4595-8c28-77b4739ea8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:44.682691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e825ad7-1066-4595-8c28-77b4739ea8df admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:44.685729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eb9c7-92a9-4ade-a230-d2a69c9cd3d1 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:44.690338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:44.690987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.691268 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.691538 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] PATH_INFO: `/v3/projects/9e474214e6c74dacb1c9fb025b2cdeae` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.692655 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e474214e6c74dacb1c9fb025b2cdeae)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:44.694601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:44.704504 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1390/2768] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:44 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:44.708415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e825ad7-1066-4595-8c28-77b4739ea8df admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:44.718086 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e825ad7-1066-4595-8c28-77b4739ea8df admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:44.722787 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b4a34-d768-47b7-8271-b5fcae42b570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:44.723391 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b4a34-d768-47b7-8271-b5fcae42b570 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.723666 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b4a34-d768-47b7-8271-b5fcae42b570 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.723951 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b4a34-d768-47b7-8271-b5fcae42b570 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.724578 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b4a34-d768-47b7-8271-b5fcae42b570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:44.726137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b4a34-d768-47b7-8271-b5fcae42b570 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:44.738417 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1391/2769] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:44.742187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b4a34-d768-47b7-8271-b5fcae42b570 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:44.745480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e474214e6c74dacb1c9fb025b2cdeae', 'request_id': 'req-427ac6c3-ef28-4157-ac68-b65df6988737'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.746833 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:44.752451 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b4a34-d768-47b7-8271-b5fcae42b570 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:44.752876 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e474214e6c74dacb1c9fb025b2cdeae', 'request_id': 'req-427ac6c3-ef28-4157-ac68-b65df6988737'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.760590 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e474214e6c74dacb1c9fb025b2cdeae', 'request_id': 'req-427ac6c3-ef28-4157-ac68-b65df6988737'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.771595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] The token cache is being invalidate because project 9e474214e6c74dacb1c9fb025b2cdeae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:44.771878 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.772508 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.773991 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1379/2770] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:44 2022] DELETE /identity/v3/projects/9e474214e6c74dacb1c9fb025b2cdeae => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:44.777928 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:44.779373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:44.814023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb3984-c042-4c6a-8491-7ff674ab9f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:44.814653 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb3984-c042-4c6a-8491-7ff674ab9f10 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.814932 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb3984-c042-4c6a-8491-7ff674ab9f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.815204 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb3984-c042-4c6a-8491-7ff674ab9f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.815836 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb3984-c042-4c6a-8491-7ff674ab9f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:44.817415 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb3984-c042-4c6a-8491-7ff674ab9f10 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:44.827206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1392/2771] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:44.831599 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb3984-c042-4c6a-8491-7ff674ab9f10 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:44.833303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-36eb3984-c042-4c6a-8491-7ff674ab9f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:44.845802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb3984-c042-4c6a-8491-7ff674ab9f10 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:44.850461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ea8bf-357e-454b-8f5d-9d6269c07903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:44.850692 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ac6c3-ef28-4157-ac68-b65df6988737 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:44.851128 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ea8bf-357e-454b-8f5d-9d6269c07903 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.851418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ea8bf-357e-454b-8f5d-9d6269c07903 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.851693 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ea8bf-357e-454b-8f5d-9d6269c07903 admin admin] PATH_INFO: `/v3/projects/1242ef26902d48359c7db9d3b1d08a45/users/3997212e9eb744c1bdcd7a3c96cbca24/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.855906 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:44.856528 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.856802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.857067 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] PATH_INFO: `/v3/users/e46dfd826e6b4b888b266e882776bdbe` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.858191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46dfd826e6b4b888b266e882776bdbe)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:44.860153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:44.866668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ea8bf-357e-454b-8f5d-9d6269c07903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1242ef26902d48359c7db9d3b1d08a45, user_id=3997212e9eb744c1bdcd7a3c96cbca24, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:44.869316 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ea8bf-357e-454b-8f5d-9d6269c07903 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:44.882565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1393/2772] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:44 2022] PUT /identity/v3/projects/1242ef26902d48359c7db9d3b1d08a45/users/3997212e9eb744c1bdcd7a3c96cbca24/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:44.912318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46dfd826e6b4b888b266e882776bdbe'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.913085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46dfd826e6b4b888b266e882776bdbe'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.925957 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46dfd826e6b4b888b266e882776bdbe'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.927216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46dfd826e6b4b888b266e882776bdbe'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.949101 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46dfd826e6b4b888b266e882776bdbe'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:44.953653 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0b87c-2cfd-41e2-af68-0bd34e34b9da None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:44.953918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0b87c-2cfd-41e2-af68-0bd34e34b9da None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:44.954186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0b87c-2cfd-41e2-af68-0bd34e34b9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:44.967871 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1380/2773] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:44 2022] DELETE /identity/v3/users/e46dfd826e6b4b888b266e882776bdbe => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:45.004259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-9dc0b87c-2cfd-41e2-af68-0bd34e34b9da None None] MFA Rules not processed for user `3997212e9eb744c1bdcd7a3c96cbca24`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:45.006157 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9dc0b87c-2cfd-41e2-af68-0bd34e34b9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:45.110208 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1394/2774] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:45.121537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:45.123033 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:45.197987 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420b648-d6a3-41c4-b53c-e1a9030b9386 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:45.208057 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691d1b2-b783-402c-844f-a4b4dfa38662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:45.208676 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691d1b2-b783-402c-844f-a4b4dfa38662 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:45.208953 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691d1b2-b783-402c-844f-a4b4dfa38662 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:45.209227 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691d1b2-b783-402c-844f-a4b4dfa38662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:45.222632 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691d1b2-b783-402c-844f-a4b4dfa38662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:45.222985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691d1b2-b783-402c-844f-a4b4dfa38662 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:45.230450 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:45.243881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1381/2775] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:45.286441 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0b87c-2cfd-41e2-af68-0bd34e34b9da None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:45.288118 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-9dc0b87c-2cfd-41e2-af68-0bd34e34b9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:45.293340 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:45.378471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0b87c-2cfd-41e2-af68-0bd34e34b9da None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:45.383245 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117a949-a621-4b67-93aa-59f4b2869d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:45.384395 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117a949-a621-4b67-93aa-59f4b2869d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:45.384677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117a949-a621-4b67-93aa-59f4b2869d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:45.384949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117a949-a621-4b67-93aa-59f4b2869d81 admin admin] PATH_INFO: `/v3/projects/485d8adc7e504933906191e107754426` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:45.386359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117a949-a621-4b67-93aa-59f4b2869d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=485d8adc7e504933906191e107754426)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:45.388123 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117a949-a621-4b67-93aa-59f4b2869d81 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:45.444029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d117a949-a621-4b67-93aa-59f4b2869d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485d8adc7e504933906191e107754426', 'request_id': 'req-d117a949-a621-4b67-93aa-59f4b2869d81'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:45.451305 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d117a949-a621-4b67-93aa-59f4b2869d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485d8adc7e504933906191e107754426', 'request_id': 'req-d117a949-a621-4b67-93aa-59f4b2869d81'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:45.460461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d117a949-a621-4b67-93aa-59f4b2869d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485d8adc7e504933906191e107754426', 'request_id': 'req-d117a949-a621-4b67-93aa-59f4b2869d81'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:45.472472 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d117a949-a621-4b67-93aa-59f4b2869d81 admin admin] The token cache is being invalidate because project 485d8adc7e504933906191e107754426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:45.472809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d117a949-a621-4b67-93aa-59f4b2869d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:45.473480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d117a949-a621-4b67-93aa-59f4b2869d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:45.475068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1395/2776] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:45 2022] DELETE /identity/v3/projects/485d8adc7e504933906191e107754426 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:45.479951 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071b5b-9e5e-407d-8b88-59dc360dd267 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:45.480235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071b5b-9e5e-407d-8b88-59dc360dd267 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:45.480506 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071b5b-9e5e-407d-8b88-59dc360dd267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:45.500816 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-0e071b5b-9e5e-407d-8b88-59dc360dd267 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:45.502051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0e071b5b-9e5e-407d-8b88-59dc360dd267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:45.576674 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1382/2777] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:45.584864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8526f7a-0737-4015-ae47-5ee10469b653 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:45.584864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8526f7a-0737-4015-ae47-5ee10469b653 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:45.585191 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8526f7a-0737-4015-ae47-5ee10469b653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:45.607952 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f8526f7a-0737-4015-ae47-5ee10469b653 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:45.609242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f8526f7a-0737-4015-ae47-5ee10469b653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:45.617425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1396/2778] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:45.622404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071b5b-9e5e-407d-8b88-59dc360dd267 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:45.632332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071b5b-9e5e-407d-8b88-59dc360dd267 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:45.637609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148dd04-2582-4300-affd-25a9da38269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:45.638211 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148dd04-2582-4300-affd-25a9da38269e admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:45.638484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148dd04-2582-4300-affd-25a9da38269e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:45.638802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148dd04-2582-4300-affd-25a9da38269e admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:45.639482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148dd04-2582-4300-affd-25a9da38269e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:45.639782 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148dd04-2582-4300-affd-25a9da38269e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:45.641713 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148dd04-2582-4300-affd-25a9da38269e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:45.653838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1383/2779] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:41:45.658279 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8526f7a-0737-4015-ae47-5ee10469b653 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:45.667355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8526f7a-0737-4015-ae47-5ee10469b653 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:45.672330 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45bf67-832f-4982-b7f6-41948d9187f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:45.672927 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45bf67-832f-4982-b7f6-41948d9187f0 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:45.673200 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45bf67-832f-4982-b7f6-41948d9187f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:45.673540 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45bf67-832f-4982-b7f6-41948d9187f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:45.674094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45bf67-832f-4982-b7f6-41948d9187f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:45.676042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45bf67-832f-4982-b7f6-41948d9187f0 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:45.703883 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1397/2780] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:45 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:45.707979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148dd04-2582-4300-affd-25a9da38269e admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:45.717811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148dd04-2582-4300-affd-25a9da38269e admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:45.772511 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fe77d-01a6-498b-935a-d53927141bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:45.772986 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fe77d-01a6-498b-935a-d53927141bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:45.773333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fe77d-01a6-498b-935a-d53927141bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:45.773684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fe77d-01a6-498b-935a-d53927141bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:45.774290 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fe77d-01a6-498b-935a-d53927141bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:45.776265 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fe77d-01a6-498b-935a-d53927141bb0 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:45.796486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1384/2781] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:45 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:45.800655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45bf67-832f-4982-b7f6-41948d9187f0 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:45.811273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45bf67-832f-4982-b7f6-41948d9187f0 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:45.815906 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a91c7-492d-4031-bd63-32eb70627f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:45.816498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a91c7-492d-4031-bd63-32eb70627f16 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:45.816778 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a91c7-492d-4031-bd63-32eb70627f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:45.817049 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a91c7-492d-4031-bd63-32eb70627f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:45.817680 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a91c7-492d-4031-bd63-32eb70627f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:45.819304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a91c7-492d-4031-bd63-32eb70627f16 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:45.829842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1398/2782] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:45.833608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fe77d-01a6-498b-935a-d53927141bb0 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:45.843513 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fe77d-01a6-498b-935a-d53927141bb0 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:45.848161 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87e802-34db-4d6b-b410-6c8c9ad59c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:45.848754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87e802-34db-4d6b-b410-6c8c9ad59c4f admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:45.849034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87e802-34db-4d6b-b410-6c8c9ad59c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:45.849310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87e802-34db-4d6b-b410-6c8c9ad59c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:45.849952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87e802-34db-4d6b-b410-6c8c9ad59c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:45.851574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87e802-34db-4d6b-b410-6c8c9ad59c4f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:45.862044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1385/2783] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:45.865912 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a91c7-492d-4031-bd63-32eb70627f16 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:45.876379 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a91c7-492d-4031-bd63-32eb70627f16 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:45.881023 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95056875-df14-4166-b784-f278e44b96dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:45.881655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95056875-df14-4166-b784-f278e44b96dd admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:45.881940 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95056875-df14-4166-b784-f278e44b96dd admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:45.882214 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95056875-df14-4166-b784-f278e44b96dd admin admin] PATH_INFO: `/v3/projects/d7f9d3dd21bd450bbf49c228a8ceb8db/users/07a3249ca12a43cfb8d2176e2a3a7bca/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:45.896983 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95056875-df14-4166-b784-f278e44b96dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f9d3dd21bd450bbf49c228a8ceb8db, user_id=07a3249ca12a43cfb8d2176e2a3a7bca, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:45.899735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95056875-df14-4166-b784-f278e44b96dd admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:45.912368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1399/2784] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:45 2022] PUT /identity/v3/projects/d7f9d3dd21bd450bbf49c228a8ceb8db/users/07a3249ca12a43cfb8d2176e2a3a7bca/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:45.922793 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb8efb-42b4-4f91-af45-035875d0caf8 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:45.923079 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb8efb-42b4-4f91-af45-035875d0caf8 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:45.923350 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb8efb-42b4-4f91-af45-035875d0caf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:45.952327 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-5deb8efb-42b4-4f91-af45-035875d0caf8 None None] MFA Rules not processed for user `07a3249ca12a43cfb8d2176e2a3a7bca`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:45.953779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5deb8efb-42b4-4f91-af45-035875d0caf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:46.009790 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:46.019789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1386/2785] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:46.024522 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95056875-df14-4166-b784-f278e44b96dd admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:46.055517 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:46.088099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95056875-df14-4166-b784-f278e44b96dd admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:46.092725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48385a-9014-48d4-9af2-9cd0d904d306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:46.093467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48385a-9014-48d4-9af2-9cd0d904d306 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:46.093773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48385a-9014-48d4-9af2-9cd0d904d306 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:46.094018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48385a-9014-48d4-9af2-9cd0d904d306 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:46.094672 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48385a-9014-48d4-9af2-9cd0d904d306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:46.096558 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48385a-9014-48d4-9af2-9cd0d904d306 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:46.123137 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1400/2786] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:46 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:46.127229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb8efb-42b4-4f91-af45-035875d0caf8 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:46.137780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb8efb-42b4-4f91-af45-035875d0caf8 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:46.192465 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaf430-f109-4c05-bdbd-4ddaf1514aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:46.193064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaf430-f109-4c05-bdbd-4ddaf1514aec admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:46.193342 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaf430-f109-4c05-bdbd-4ddaf1514aec admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:46.193615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaf430-f109-4c05-bdbd-4ddaf1514aec admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:46.194233 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfaf430-f109-4c05-bdbd-4ddaf1514aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:46.196205 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfaf430-f109-4c05-bdbd-4ddaf1514aec admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:46.218758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1387/2787] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:46 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:46.222761 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48385a-9014-48d4-9af2-9cd0d904d306 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:46.233532 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48385a-9014-48d4-9af2-9cd0d904d306 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:46.238112 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c0f31-2ad7-4621-bc37-945a45288104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:46.238735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c0f31-2ad7-4621-bc37-945a45288104 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:46.239012 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c0f31-2ad7-4621-bc37-945a45288104 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:46.239302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c0f31-2ad7-4621-bc37-945a45288104 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:46.239916 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c0f31-2ad7-4621-bc37-945a45288104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:46.241516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c0f31-2ad7-4621-bc37-945a45288104 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:46.254146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1401/2788] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:46.258388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaf430-f109-4c05-bdbd-4ddaf1514aec admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:46.272978 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaf430-f109-4c05-bdbd-4ddaf1514aec admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:46.277601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9c02e-69b0-4752-90f5-9e88aa8a86a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:46.278249 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c02e-69b0-4752-90f5-9e88aa8a86a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:46.278549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c02e-69b0-4752-90f5-9e88aa8a86a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:46.278824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c02e-69b0-4752-90f5-9e88aa8a86a0 admin admin] PATH_INFO: `/v3/projects/dbd3bf86364e486f8c1869d6e3bacacc/users/c2080b53ac894b5f8e2b82012e3a7869/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:46.294385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9c02e-69b0-4752-90f5-9e88aa8a86a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd3bf86364e486f8c1869d6e3bacacc, user_id=c2080b53ac894b5f8e2b82012e3a7869, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:46.297155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9c02e-69b0-4752-90f5-9e88aa8a86a0 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:46.311008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1388/2789] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:46 2022] PUT /identity/v3/projects/dbd3bf86364e486f8c1869d6e3bacacc/users/c2080b53ac894b5f8e2b82012e3a7869/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:46.315008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c0f31-2ad7-4621-bc37-945a45288104 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:46.325291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c0f31-2ad7-4621-bc37-945a45288104 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:46.387188 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9cfd7-e043-4c11-a046-d8a9bf51a351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:46.387795 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9cfd7-e043-4c11-a046-d8a9bf51a351 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:46.388094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9cfd7-e043-4c11-a046-d8a9bf51a351 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:46.388357 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9cfd7-e043-4c11-a046-d8a9bf51a351 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:46.388992 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9cfd7-e043-4c11-a046-d8a9bf51a351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:46.390646 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9cfd7-e043-4c11-a046-d8a9bf51a351 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:46.406169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1402/2790] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:46.411812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9c02e-69b0-4752-90f5-9e88aa8a86a0 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:46.424376 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9c02e-69b0-4752-90f5-9e88aa8a86a0 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:46.429328 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af4a59-02ab-41f7-9416-667be127673f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:46.429988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af4a59-02ab-41f7-9416-667be127673f admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:46.430262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af4a59-02ab-41f7-9416-667be127673f admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:46.430579 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af4a59-02ab-41f7-9416-667be127673f admin admin] PATH_INFO: `/v3/projects/dbd3bf86364e486f8c1869d6e3bacacc/users/c2080b53ac894b5f8e2b82012e3a7869/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:46.432555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af4a59-02ab-41f7-9416-667be127673f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd3bf86364e486f8c1869d6e3bacacc, user_id=c2080b53ac894b5f8e2b82012e3a7869, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:46.435218 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af4a59-02ab-41f7-9416-667be127673f admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:46.458135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1389/2791] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:46 2022] PUT /identity/v3/projects/dbd3bf86364e486f8c1869d6e3bacacc/users/c2080b53ac894b5f8e2b82012e3a7869/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:46.470051 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b199f5-f125-4c43-a497-e5b7bffaf2bd None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:46.470315 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b199f5-f125-4c43-a497-e5b7bffaf2bd None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:46.470557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b199f5-f125-4c43-a497-e5b7bffaf2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:46.500131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-a4b199f5-f125-4c43-a497-e5b7bffaf2bd None None] MFA Rules not processed for user `c2080b53ac894b5f8e2b82012e3a7869`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:46.501237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-a4b199f5-f125-4c43-a497-e5b7bffaf2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:46.581807 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1403/2792] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:46.595139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af4a59-02ab-41f7-9416-667be127673f admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:46.598002 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f3af4a59-02ab-41f7-9416-667be127673f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:46.671501 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af4a59-02ab-41f7-9416-667be127673f admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:46.676263 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d600bb-dc18-436f-8bf9-4fec1f70b342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:46.677553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d600bb-dc18-436f-8bf9-4fec1f70b342 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:46.678037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d600bb-dc18-436f-8bf9-4fec1f70b342 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:46.678380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d600bb-dc18-436f-8bf9-4fec1f70b342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:46.689813 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d600bb-dc18-436f-8bf9-4fec1f70b342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:46.691446 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d600bb-dc18-436f-8bf9-4fec1f70b342 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:46.705719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1390/2793] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:47.048371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b199f5-f125-4c43-a497-e5b7bffaf2bd None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:47.057809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b199f5-f125-4c43-a497-e5b7bffaf2bd None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:47.062446 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858b6a4-4e52-4d68-a1c8-fa49afa79fcf tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2080b53ac894b5f8e2b82012e3a7869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbd3bf86364e486f8c1869d6e3bacacc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:47.063071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858b6a4-4e52-4d68-a1c8-fa49afa79fcf tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:47.063352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858b6a4-4e52-4d68-a1c8-fa49afa79fcf tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:47.063624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858b6a4-4e52-4d68-a1c8-fa49afa79fcf tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:47.064266 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858b6a4-4e52-4d68-a1c8-fa49afa79fcf tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:47.064570 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858b6a4-4e52-4d68-a1c8-fa49afa79fcf tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:47.066269 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858b6a4-4e52-4d68-a1c8-fa49afa79fcf tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:47.079033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1404/2794] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:41:47.083296 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d600bb-dc18-436f-8bf9-4fec1f70b342 service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:47.093095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d600bb-dc18-436f-8bf9-4fec1f70b342 service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:47.097600 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe2151-1665-46b2-a141-c2f5d84ebd2a tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2080b53ac894b5f8e2b82012e3a7869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbd3bf86364e486f8c1869d6e3bacacc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:47.098189 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe2151-1665-46b2-a141-c2f5d84ebd2a tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:47.098468 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe2151-1665-46b2-a141-c2f5d84ebd2a tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:47.098773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe2151-1665-46b2-a141-c2f5d84ebd2a tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:47.099393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe2151-1665-46b2-a141-c2f5d84ebd2a tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:47.101284 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe2151-1665-46b2-a141-c2f5d84ebd2a tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:47.127552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1391/2795] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:47 2022] POST /identity/v3/projects => generated 353 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:47.131518 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858b6a4-4e52-4d68-a1c8-fa49afa79fcf tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:47.141935 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858b6a4-4e52-4d68-a1c8-fa49afa79fcf tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:47.149474 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:47.199616 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc1014-3858-4218-a7d9-182eef1065e5 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2080b53ac894b5f8e2b82012e3a7869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbd3bf86364e486f8c1869d6e3bacacc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:47.200211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc1014-3858-4218-a7d9-182eef1065e5 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:47.200488 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc1014-3858-4218-a7d9-182eef1065e5 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:47.200758 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc1014-3858-4218-a7d9-182eef1065e5 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:47.201387 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc1014-3858-4218-a7d9-182eef1065e5 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:47.201688 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc1014-3858-4218-a7d9-182eef1065e5 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:47.203306 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc1014-3858-4218-a7d9-182eef1065e5 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:47.216861 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1405/2796] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:41:47.254681 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe2151-1665-46b2-a141-c2f5d84ebd2a tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:47.265539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe2151-1665-46b2-a141-c2f5d84ebd2a tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:47.270066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2080b53ac894b5f8e2b82012e3a7869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbd3bf86364e486f8c1869d6e3bacacc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:47.270726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:47.271037 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:47.271315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] PATH_INFO: `/v3/projects/7e1a0a3821e343cb8a61d5bbf5a6a42b` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:47.272455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7e1a0a3821e343cb8a61d5bbf5a6a42b)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:47.274381 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:47.298435 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:47.322845 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1a0a3821e343cb8a61d5bbf5a6a42b', 'request_id': 'req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:47.328278 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1a0a3821e343cb8a61d5bbf5a6a42b', 'request_id': 'req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:47.335184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1a0a3821e343cb8a61d5bbf5a6a42b', 'request_id': 'req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:47.347593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] The token cache is being invalidate because project 7e1a0a3821e343cb8a61d5bbf5a6a42b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:47.347875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:47.348500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f77a0bd7-0adb-4c1e-9a90-6333a026cf46 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:47.350006 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1392/2797] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:47 2022] DELETE /identity/v3/projects/7e1a0a3821e343cb8a61d5bbf5a6a42b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:47.544747 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc1014-3858-4218-a7d9-182eef1065e5 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:47.546620 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5fbc1014-3858-4218-a7d9-182eef1065e5 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:47.616801 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc1014-3858-4218-a7d9-182eef1065e5 tempest-VolumeQuotaClassesTest-1144398166 tempest-VolumeQuotaClassesTest-1144398166-project-admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:47.675184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:47.675817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:47.676095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:47.676371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] PATH_INFO: `/v3/users/07a3249ca12a43cfb8d2176e2a3a7bca` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:47.677508 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] RBAC: Authorizing `identity:delete_user(user_id=07a3249ca12a43cfb8d2176e2a3a7bca)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:47.679452 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:47.732099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07a3249ca12a43cfb8d2176e2a3a7bca'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:47.733038 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07a3249ca12a43cfb8d2176e2a3a7bca'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:47.739303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:47.741918 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07a3249ca12a43cfb8d2176e2a3a7bca'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:47.756759 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07a3249ca12a43cfb8d2176e2a3a7bca'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:47.757684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07a3249ca12a43cfb8d2176e2a3a7bca'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:47.777029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1406/2798] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:47 2022] DELETE /identity/v3/users/07a3249ca12a43cfb8d2176e2a3a7bca => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:47.781566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde847-3102-40e0-a651-87ed091fa9e7 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:47.782387 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde847-3102-40e0-a651-87ed091fa9e7 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:47.782795 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde847-3102-40e0-a651-87ed091fa9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:47.802428 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-a1cde847-3102-40e0-a651-87ed091fa9e7 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:47.803696 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a1cde847-3102-40e0-a651-87ed091fa9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:47.866596 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1393/2799] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:47.876243 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:47.877632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:47.958400 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec326d7-80ce-4cce-94fb-8f3038e1610c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:47.969304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43a231-9144-4139-98de-58214e7db8c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:47.970291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43a231-9144-4139-98de-58214e7db8c8 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:47.970672 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43a231-9144-4139-98de-58214e7db8c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:47.971199 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43a231-9144-4139-98de-58214e7db8c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:47.984287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43a231-9144-4139-98de-58214e7db8c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:47.986317 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43a231-9144-4139-98de-58214e7db8c8 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:47.998338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1407/2800] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:48.295864 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde847-3102-40e0-a651-87ed091fa9e7 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:48.296935 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-a1cde847-3102-40e0-a651-87ed091fa9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:48.311313 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde847-3102-40e0-a651-87ed091fa9e7 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:48.316814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:48.317595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:48.317952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:48.318229 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] PATH_INFO: `/v3/projects/d7f9d3dd21bd450bbf49c228a8ceb8db` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:48.319393 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f9d3dd21bd450bbf49c228a8ceb8db)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:48.321801 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:48.368155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f9d3dd21bd450bbf49c228a8ceb8db', 'request_id': 'req-4a802e6e-d1ca-43a4-b489-211fa096d26c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.374203 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f9d3dd21bd450bbf49c228a8ceb8db', 'request_id': 'req-4a802e6e-d1ca-43a4-b489-211fa096d26c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.381855 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f9d3dd21bd450bbf49c228a8ceb8db', 'request_id': 'req-4a802e6e-d1ca-43a4-b489-211fa096d26c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.394088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] The token cache is being invalidate because project d7f9d3dd21bd450bbf49c228a8ceb8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:48.394391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.395063 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.396614 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1394/2801] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:48 2022] DELETE /identity/v3/projects/d7f9d3dd21bd450bbf49c228a8ceb8db => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:48.401429 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43a231-9144-4139-98de-58214e7db8c8 service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:48.411285 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43a231-9144-4139-98de-58214e7db8c8 service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:48.469585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f02eab-063e-4d41-ab48-0ac9edf9b51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:48.470212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f02eab-063e-4d41-ab48-0ac9edf9b51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:48.470490 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f02eab-063e-4d41-ab48-0ac9edf9b51e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:48.470814 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f02eab-063e-4d41-ab48-0ac9edf9b51e admin admin] PATH_INFO: `/v3/users/c2080b53ac894b5f8e2b82012e3a7869` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:48.471953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f02eab-063e-4d41-ab48-0ac9edf9b51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2080b53ac894b5f8e2b82012e3a7869)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:48.474207 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f02eab-063e-4d41-ab48-0ac9edf9b51e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:48.518528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d0f02eab-063e-4d41-ab48-0ac9edf9b51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2080b53ac894b5f8e2b82012e3a7869'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.519171 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d0f02eab-063e-4d41-ab48-0ac9edf9b51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2080b53ac894b5f8e2b82012e3a7869'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.526651 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d0f02eab-063e-4d41-ab48-0ac9edf9b51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2080b53ac894b5f8e2b82012e3a7869'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.533867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d0f02eab-063e-4d41-ab48-0ac9edf9b51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2080b53ac894b5f8e2b82012e3a7869'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.534872 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d0f02eab-063e-4d41-ab48-0ac9edf9b51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2080b53ac894b5f8e2b82012e3a7869'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.544896 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:48.554215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1408/2802] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:48 2022] DELETE /identity/v3/users/c2080b53ac894b5f8e2b82012e3a7869 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:48.591593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:48.593018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:48.606759 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a802e6e-d1ca-43a4-b489-211fa096d26c admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:48.640473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:48.668793 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:48.669458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:48.669737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:48.670005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] PATH_INFO: `/v3/users/0a497efd79fb4b62ac7356cfb593c38f` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:48.671158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a497efd79fb4b62ac7356cfb593c38f)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:48.673065 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:48.731942 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a497efd79fb4b62ac7356cfb593c38f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.732726 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a497efd79fb4b62ac7356cfb593c38f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.741634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a497efd79fb4b62ac7356cfb593c38f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.745364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a497efd79fb4b62ac7356cfb593c38f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.758045 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a497efd79fb4b62ac7356cfb593c38f'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:48.771978 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1395/2803] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:48 2022] DELETE /identity/v3/users/0a497efd79fb4b62ac7356cfb593c38f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:48.776514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111939e5-05cb-439f-839b-c65c577d2615 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:48.776804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111939e5-05cb-439f-839b-c65c577d2615 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:48.777264 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111939e5-05cb-439f-839b-c65c577d2615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:48.796329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-111939e5-05cb-439f-839b-c65c577d2615 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:48.797574 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-111939e5-05cb-439f-839b-c65c577d2615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:48.835545 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:48.837039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:48.880018 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1409/2804] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:48.895584 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111939e5-05cb-439f-839b-c65c577d2615 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:48.897391 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-111939e5-05cb-439f-839b-c65c577d2615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:48.926786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf60568-5835-4c97-8881-a51b3e5d9b79 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:48.933747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85957a0-80c8-49b8-b476-2de8c248f082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:48.934592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85957a0-80c8-49b8-b476-2de8c248f082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:48.934881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85957a0-80c8-49b8-b476-2de8c248f082 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:48.935154 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85957a0-80c8-49b8-b476-2de8c248f082 admin admin] PATH_INFO: `/v3/projects/dbd3bf86364e486f8c1869d6e3bacacc` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:48.936482 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85957a0-80c8-49b8-b476-2de8c248f082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd3bf86364e486f8c1869d6e3bacacc)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:48.938731 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85957a0-80c8-49b8-b476-2de8c248f082 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:48.961371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111939e5-05cb-439f-839b-c65c577d2615 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:48.965668 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ff8fc-7661-4ec9-9a73-a1f992ae5999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:48.966274 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ff8fc-7661-4ec9-9a73-a1f992ae5999 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:48.966579 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ff8fc-7661-4ec9-9a73-a1f992ae5999 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:48.966857 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ff8fc-7661-4ec9-9a73-a1f992ae5999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:48.978815 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ff8fc-7661-4ec9-9a73-a1f992ae5999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:48.980419 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ff8fc-7661-4ec9-9a73-a1f992ae5999 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:48.990690 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1410/2805] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:49.000097 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f85957a0-80c8-49b8-b476-2de8c248f082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd3bf86364e486f8c1869d6e3bacacc', 'request_id': 'req-f85957a0-80c8-49b8-b476-2de8c248f082'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:49.007409 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:49.009505 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f85957a0-80c8-49b8-b476-2de8c248f082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd3bf86364e486f8c1869d6e3bacacc', 'request_id': 'req-f85957a0-80c8-49b8-b476-2de8c248f082'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:49.023959 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f85957a0-80c8-49b8-b476-2de8c248f082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd3bf86364e486f8c1869d6e3bacacc', 'request_id': 'req-f85957a0-80c8-49b8-b476-2de8c248f082'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:49.037753 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f85957a0-80c8-49b8-b476-2de8c248f082 admin admin] The token cache is being invalidate because project dbd3bf86364e486f8c1869d6e3bacacc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:49.038132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f85957a0-80c8-49b8-b476-2de8c248f082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:49.038976 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f85957a0-80c8-49b8-b476-2de8c248f082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:49.041904 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1396/2806] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:48 2022] DELETE /identity/v3/projects/dbd3bf86364e486f8c1869d6e3bacacc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:49.048037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7de6-a0d9-42d9-92d0-f366ca4b0ee8 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:49.048352 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7de6-a0d9-42d9-92d0-f366ca4b0ee8 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:49.048698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7de6-a0d9-42d9-92d0-f366ca4b0ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:49.071048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-998b7de6-a0d9-42d9-92d0-f366ca4b0ee8 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:49.072442 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-998b7de6-a0d9-42d9-92d0-f366ca4b0ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:49.159173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1411/2807] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:49.173418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35618fdd-71f0-4d2e-a76a-673d7ab58962 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:49.173418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35618fdd-71f0-4d2e-a76a-673d7ab58962 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:49.173418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35618fdd-71f0-4d2e-a76a-673d7ab58962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:49.221418 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-35618fdd-71f0-4d2e-a76a-673d7ab58962 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:49.226767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-35618fdd-71f0-4d2e-a76a-673d7ab58962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:49.234258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1397/2808] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:49.238941 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7de6-a0d9-42d9-92d0-f366ca4b0ee8 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:49.254533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7de6-a0d9-42d9-92d0-f366ca4b0ee8 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:49.260321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20681c-058d-4453-aa13-17eb4fa70cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:49.260939 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20681c-058d-4453-aa13-17eb4fa70cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:49.261215 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20681c-058d-4453-aa13-17eb4fa70cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:49.261481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20681c-058d-4453-aa13-17eb4fa70cc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:49.262133 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20681c-058d-4453-aa13-17eb4fa70cc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104774) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:49.262438 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20681c-058d-4453-aa13-17eb4fa70cc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:49.264367 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20681c-058d-4453-aa13-17eb4fa70cc6 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:49.282885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1412/2809] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:41:49.283594 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35618fdd-71f0-4d2e-a76a-673d7ab58962 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:49.295627 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35618fdd-71f0-4d2e-a76a-673d7ab58962 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:49.301520 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af01ae-79e0-483b-ac12-09155296c01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:49.302392 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af01ae-79e0-483b-ac12-09155296c01b admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:49.302719 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af01ae-79e0-483b-ac12-09155296c01b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:49.302994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af01ae-79e0-483b-ac12-09155296c01b admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:49.303635 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af01ae-79e0-483b-ac12-09155296c01b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:49.307909 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af01ae-79e0-483b-ac12-09155296c01b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:49.345139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1398/2810] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:49 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:49.349232 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20681c-058d-4453-aa13-17eb4fa70cc6 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:49.360039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20681c-058d-4453-aa13-17eb4fa70cc6 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:49.382316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af01ae-79e0-483b-ac12-09155296c01b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:49.385855 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-09af01ae-79e0-483b-ac12-09155296c01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:49.391300 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:49.447497 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742450dc-2eea-43d3-865e-f938e2eceda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:49.448115 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742450dc-2eea-43d3-865e-f938e2eceda2 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:49.448365 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742450dc-2eea-43d3-865e-f938e2eceda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:49.448635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742450dc-2eea-43d3-865e-f938e2eceda2 admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:49.449280 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742450dc-2eea-43d3-865e-f938e2eceda2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:49.451211 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742450dc-2eea-43d3-865e-f938e2eceda2 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:49.484195 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1413/2811] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:49 2022] POST /identity/v3/users => generated 283 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:49.488624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742450dc-2eea-43d3-865e-f938e2eceda2 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:49.500697 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742450dc-2eea-43d3-865e-f938e2eceda2 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:49.506532 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091e2f-a136-4912-907e-24d2006fd3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:49.507145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091e2f-a136-4912-907e-24d2006fd3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:49.507425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091e2f-a136-4912-907e-24d2006fd3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:49.507698 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091e2f-a136-4912-907e-24d2006fd3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:49.508338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31091e2f-a136-4912-907e-24d2006fd3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:49.509447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af01ae-79e0-483b-ac12-09155296c01b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:49.510624 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31091e2f-a136-4912-907e-24d2006fd3d8 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:49.516095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:49.517442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:49.518397 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:49.519184 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe admin admin] PATH_INFO: `/v3/projects/754a6b43802f404d88987adc642a2def` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:49.520380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=754a6b43802f404d88987adc642a2def)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:49.522400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:49.522564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1414/2812] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:49.526753 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091e2f-a136-4912-907e-24d2006fd3d8 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:49.539290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091e2f-a136-4912-907e-24d2006fd3d8 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:49.544499 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8856a74-1a50-4782-bb6d-f08af9d4d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:49.545103 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8856a74-1a50-4782-bb6d-f08af9d4d1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:49.545412 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8856a74-1a50-4782-bb6d-f08af9d4d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:49.545674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8856a74-1a50-4782-bb6d-f08af9d4d1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:49.546386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8856a74-1a50-4782-bb6d-f08af9d4d1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:49.548283 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8856a74-1a50-4782-bb6d-f08af9d4d1b4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:49.561433 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1415/2813] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:49.565718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8856a74-1a50-4782-bb6d-f08af9d4d1b4 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:49.578169 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8856a74-1a50-4782-bb6d-f08af9d4d1b4 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:49.579770 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754a6b43802f404d88987adc642a2def', 'request_id': 'req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:49.587298 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754a6b43802f404d88987adc642a2def', 'request_id': 'req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:49.599684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754a6b43802f404d88987adc642a2def', 'request_id': 'req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:49.612646 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe admin admin] The token cache is being invalidate because project 754a6b43802f404d88987adc642a2def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:49.612930 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:49.613589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-f2fd3cc4-7a07-467b-b2a0-cff76d7ecbbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:49.615207 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1399/2814] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:49 2022] DELETE /identity/v3/projects/754a6b43802f404d88987adc642a2def => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:49.645007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ded0c-6a3c-4ba9-ba52-49070c2b41d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:49.645695 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ded0c-6a3c-4ba9-ba52-49070c2b41d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:49.645980 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ded0c-6a3c-4ba9-ba52-49070c2b41d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:49.646255 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ded0c-6a3c-4ba9-ba52-49070c2b41d8 admin admin] PATH_INFO: `/v3/projects/077d068e3d49420e9c770d9a152c162f/users/6471eba933464a13910462da88709b8b/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:49.664432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ded0c-6a3c-4ba9-ba52-49070c2b41d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=077d068e3d49420e9c770d9a152c162f, user_id=6471eba933464a13910462da88709b8b, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:49.667702 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ded0c-6a3c-4ba9-ba52-49070c2b41d8 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:49.682052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1416/2815] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:49 2022] PUT /identity/v3/projects/077d068e3d49420e9c770d9a152c162f/users/6471eba933464a13910462da88709b8b/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:49.694015 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d885cd-9a12-4715-86f0-7b74250c3f18 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:49.695169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d885cd-9a12-4715-86f0-7b74250c3f18 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:49.695535 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d885cd-9a12-4715-86f0-7b74250c3f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:49.730484 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-c9d885cd-9a12-4715-86f0-7b74250c3f18 None None] MFA Rules not processed for user `6471eba933464a13910462da88709b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:49.731833 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c9d885cd-9a12-4715-86f0-7b74250c3f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:49.904475 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:49.939234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1400/2816] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:49.943842 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ded0c-6a3c-4ba9-ba52-49070c2b41d8 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:49.945504 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-307ded0c-6a3c-4ba9-ba52-49070c2b41d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:50.015007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ded0c-6a3c-4ba9-ba52-49070c2b41d8 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:50.019590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150e26b-9dec-431e-b9be-201ab28394f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:50.020189 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150e26b-9dec-431e-b9be-201ab28394f3 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:50.020464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150e26b-9dec-431e-b9be-201ab28394f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:50.020734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150e26b-9dec-431e-b9be-201ab28394f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:50.021374 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150e26b-9dec-431e-b9be-201ab28394f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:50.023314 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150e26b-9dec-431e-b9be-201ab28394f3 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:50.043942 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:50.051261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1417/2817] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:49 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:50.055166 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d885cd-9a12-4715-86f0-7b74250c3f18 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:50.066195 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d885cd-9a12-4715-86f0-7b74250c3f18 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:50.124754 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7bb2e-c1e6-4c78-9b8e-e2c135ea61a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:50.125259 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7bb2e-c1e6-4c78-9b8e-e2c135ea61a0 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:50.125544 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7bb2e-c1e6-4c78-9b8e-e2c135ea61a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:50.125814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7bb2e-c1e6-4c78-9b8e-e2c135ea61a0 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:50.126433 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7bb2e-c1e6-4c78-9b8e-e2c135ea61a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:50.128448 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7bb2e-c1e6-4c78-9b8e-e2c135ea61a0 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:50.150315 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1401/2818] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:50 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:50.154594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150e26b-9dec-431e-b9be-201ab28394f3 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:50.167245 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150e26b-9dec-431e-b9be-201ab28394f3 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:50.172248 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a6f18-b75a-43f1-ac76-10b64e07ef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:50.172840 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a6f18-b75a-43f1-ac76-10b64e07ef4b admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:50.173121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a6f18-b75a-43f1-ac76-10b64e07ef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:50.173396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a6f18-b75a-43f1-ac76-10b64e07ef4b admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:50.174037 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a6f18-b75a-43f1-ac76-10b64e07ef4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:50.175658 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a6f18-b75a-43f1-ac76-10b64e07ef4b admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:50.186134 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1418/2819] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:50.190139 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7bb2e-c1e6-4c78-9b8e-e2c135ea61a0 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:50.199995 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7bb2e-c1e6-4c78-9b8e-e2c135ea61a0 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:50.204875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84097c0b-61c9-4cbf-a943-257f44c370f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:50.205515 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84097c0b-61c9-4cbf-a943-257f44c370f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:50.205806 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84097c0b-61c9-4cbf-a943-257f44c370f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:50.206078 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84097c0b-61c9-4cbf-a943-257f44c370f7 admin admin] PATH_INFO: `/v3/projects/2bfe906c6c934266b9ffc2d31956844a/users/ce9965bba67a4f8a8d6906d61ae2e4f8/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:50.221705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84097c0b-61c9-4cbf-a943-257f44c370f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bfe906c6c934266b9ffc2d31956844a, user_id=ce9965bba67a4f8a8d6906d61ae2e4f8, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:50.224407 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84097c0b-61c9-4cbf-a943-257f44c370f7 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:50.247305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1402/2820] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:50 2022] PUT /identity/v3/projects/2bfe906c6c934266b9ffc2d31956844a/users/ce9965bba67a4f8a8d6906d61ae2e4f8/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:50.251767 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a6f18-b75a-43f1-ac76-10b64e07ef4b admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:50.263879 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a6f18-b75a-43f1-ac76-10b64e07ef4b admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:50.320809 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cd8b0-6a89-45a9-b54e-19eda1ecff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:50.321448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cd8b0-6a89-45a9-b54e-19eda1ecff10 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:50.321718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cd8b0-6a89-45a9-b54e-19eda1ecff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:50.321989 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cd8b0-6a89-45a9-b54e-19eda1ecff10 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:50.322670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090cd8b0-6a89-45a9-b54e-19eda1ecff10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:50.324246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090cd8b0-6a89-45a9-b54e-19eda1ecff10 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:50.334987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1419/2821] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:50.339781 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84097c0b-61c9-4cbf-a943-257f44c370f7 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:50.350308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84097c0b-61c9-4cbf-a943-257f44c370f7 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:50.355517 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499ece3-10c2-4b2f-9b42-d78b83e1dcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:50.356158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499ece3-10c2-4b2f-9b42-d78b83e1dcf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:50.356432 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499ece3-10c2-4b2f-9b42-d78b83e1dcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:50.356693 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499ece3-10c2-4b2f-9b42-d78b83e1dcf6 admin admin] PATH_INFO: `/v3/projects/2bfe906c6c934266b9ffc2d31956844a/users/ce9965bba67a4f8a8d6906d61ae2e4f8/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:50.358631 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499ece3-10c2-4b2f-9b42-d78b83e1dcf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bfe906c6c934266b9ffc2d31956844a, user_id=ce9965bba67a4f8a8d6906d61ae2e4f8, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:50.361260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499ece3-10c2-4b2f-9b42-d78b83e1dcf6 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:50.371442 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1403/2822] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:50 2022] PUT /identity/v3/projects/2bfe906c6c934266b9ffc2d31956844a/users/ce9965bba67a4f8a8d6906d61ae2e4f8/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:50.382082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a504e61-cd09-4de4-b3b2-849901d7befa None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:50.382302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a504e61-cd09-4de4-b3b2-849901d7befa None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:50.382609 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a504e61-cd09-4de4-b3b2-849901d7befa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:50.410556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-2a504e61-cd09-4de4-b3b2-849901d7befa None None] MFA Rules not processed for user `ce9965bba67a4f8a8d6906d61ae2e4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:50.411776 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-2a504e61-cd09-4de4-b3b2-849901d7befa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:50.489780 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1420/2823] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:50.536980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499ece3-10c2-4b2f-9b42-d78b83e1dcf6 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:50.539072 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-3499ece3-10c2-4b2f-9b42-d78b83e1dcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:50.604524 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499ece3-10c2-4b2f-9b42-d78b83e1dcf6 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:50.608412 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d3268-a071-4f87-ac9e-d76a9b1a2f7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:50.609016 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3268-a071-4f87-ac9e-d76a9b1a2f7e service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:50.609288 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3268-a071-4f87-ac9e-d76a9b1a2f7e service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:50.609551 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3268-a071-4f87-ac9e-d76a9b1a2f7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:50.618536 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d3268-a071-4f87-ac9e-d76a9b1a2f7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:50.619980 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d3268-a071-4f87-ac9e-d76a9b1a2f7e service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:50.630723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1404/2824] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:50.733635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a504e61-cd09-4de4-b3b2-849901d7befa None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:50.735178 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-2a504e61-cd09-4de4-b3b2-849901d7befa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:50.747080 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a504e61-cd09-4de4-b3b2-849901d7befa None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:50.750647 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984b394-6c95-47d2-9403-4cae8f890d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:50.751252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b394-6c95-47d2-9403-4cae8f890d5b service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:50.751535 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b394-6c95-47d2-9403-4cae8f890d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:50.751804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b394-6c95-47d2-9403-4cae8f890d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:50.810884 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984b394-6c95-47d2-9403-4cae8f890d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:50.812338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984b394-6c95-47d2-9403-4cae8f890d5b service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:50.821830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1421/2825] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:51.905769 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d24ba-67ea-4f30-acdc-01f27fd709ed None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:51.907364 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d24ba-67ea-4f30-acdc-01f27fd709ed None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:51.907944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d24ba-67ea-4f30-acdc-01f27fd709ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:51.951728 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-bc3d24ba-67ea-4f30-acdc-01f27fd709ed None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:51.952967 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-bc3d24ba-67ea-4f30-acdc-01f27fd709ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:51.981020 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:52.016168 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1405/2826] 10.222.0.16 () {58 vars in 1016 bytes} [Fri Sep 16 05:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:52.038598 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984b394-6c95-47d2-9403-4cae8f890d5b service cinder] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:52.040109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f984b394-6c95-47d2-9403-4cae8f890d5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:52.053099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:52.122263 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984b394-6c95-47d2-9403-4cae8f890d5b service cinder] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:52.128298 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048a974-8d4a-464a-8f89-c8c364e44ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:52.128909 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048a974-8d4a-464a-8f89-c8c364e44ae7 service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:52.129190 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048a974-8d4a-464a-8f89-c8c364e44ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:52.129461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048a974-8d4a-464a-8f89-c8c364e44ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:52.138173 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048a974-8d4a-464a-8f89-c8c364e44ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:52.139800 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048a974-8d4a-464a-8f89-c8c364e44ae7 service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:52.149116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1422/2827] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:55.195549 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6969987-82ea-4004-8dad-61ddc8a0d2b3 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:55.196031 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6969987-82ea-4004-8dad-61ddc8a0d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:55.196153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6969987-82ea-4004-8dad-61ddc8a0d2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:55.216680 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-c6969987-82ea-4004-8dad-61ddc8a0d2b3 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:55.217943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c6969987-82ea-4004-8dad-61ddc8a0d2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:55.227190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1406/2828] 10.222.0.16 () {58 vars in 1016 bytes} [Fri Sep 16 05:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:55.262669 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048a974-8d4a-464a-8f89-c8c364e44ae7 service nova] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:55.264480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-4048a974-8d4a-464a-8f89-c8c364e44ae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:55.280563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048a974-8d4a-464a-8f89-c8c364e44ae7 service nova] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:55.286064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd5cf5-e4a2-4731-99f6-8a68d60c875c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:55.286718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd5cf5-e4a2-4731-99f6-8a68d60c875c service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:55.286985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd5cf5-e4a2-4731-99f6-8a68d60c875c service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:55.287261 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd5cf5-e4a2-4731-99f6-8a68d60c875c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:55.295392 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd5cf5-e4a2-4731-99f6-8a68d60c875c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:55.296966 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd5cf5-e4a2-4731-99f6-8a68d60c875c service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:55.306296 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1423/2829] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:55.571258 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6969987-82ea-4004-8dad-61ddc8a0d2b3 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:55.581932 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6969987-82ea-4004-8dad-61ddc8a0d2b3 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:55.586736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:55.587290 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:55.587598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:55.587823 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] PATH_INFO: `/v3/users/6471eba933464a13910462da88709b8b` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:55.589005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6471eba933464a13910462da88709b8b)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:55.591075 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:55.645038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6471eba933464a13910462da88709b8b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:55.645699 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6471eba933464a13910462da88709b8b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:55.654090 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6471eba933464a13910462da88709b8b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:55.654727 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6471eba933464a13910462da88709b8b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:55.666870 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6471eba933464a13910462da88709b8b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:55.680157 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1407/2830] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:55 2022] DELETE /identity/v3/users/6471eba933464a13910462da88709b8b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:55.685071 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a66f14-4e2f-4a7b-8655-893136e0a593 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:55.685351 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a66f14-4e2f-4a7b-8655-893136e0a593 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:55.685619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a66f14-4e2f-4a7b-8655-893136e0a593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:55.704880 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-e5a66f14-4e2f-4a7b-8655-893136e0a593 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:55.706095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e5a66f14-4e2f-4a7b-8655-893136e0a593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:55.773244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1424/2831] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:55.782689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:55.784113 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:55.840802 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299b3d7-6c61-49bc-a721-0507d8755ea5 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:55.844558 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09ecd7-1955-429f-8fb1-117cb0595b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:55.845156 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09ecd7-1955-429f-8fb1-117cb0595b61 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:55.845438 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09ecd7-1955-429f-8fb1-117cb0595b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:55.845725 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09ecd7-1955-429f-8fb1-117cb0595b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:55.855192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09ecd7-1955-429f-8fb1-117cb0595b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:55.856634 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09ecd7-1955-429f-8fb1-117cb0595b61 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:55.866127 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1408/2832] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:56.141948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a66f14-4e2f-4a7b-8655-893136e0a593 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:56.143422 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e5a66f14-4e2f-4a7b-8655-893136e0a593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:56.155362 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a66f14-4e2f-4a7b-8655-893136e0a593 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:56.160059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:56.160691 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:56.160964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:56.161235 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] PATH_INFO: `/v3/projects/077d068e3d49420e9c770d9a152c162f` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:56.162378 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=077d068e3d49420e9c770d9a152c162f)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:56.164313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:56.211587 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '077d068e3d49420e9c770d9a152c162f', 'request_id': 'req-68c538db-7954-4af8-b759-eb889419acfd'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.217095 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '077d068e3d49420e9c770d9a152c162f', 'request_id': 'req-68c538db-7954-4af8-b759-eb889419acfd'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.224582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '077d068e3d49420e9c770d9a152c162f', 'request_id': 'req-68c538db-7954-4af8-b759-eb889419acfd'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.236411 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] The token cache is being invalidate because project 077d068e3d49420e9c770d9a152c162f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:56.236708 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.237359 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.239421 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1425/2833] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:56 2022] DELETE /identity/v3/projects/077d068e3d49420e9c770d9a152c162f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:56.243809 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09ecd7-1955-429f-8fb1-117cb0595b61 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:56.254877 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09ecd7-1955-429f-8fb1-117cb0595b61 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:56.296209 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:56.318902 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac909c-b5fd-47a8-9801-9c6714a1a74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:56.319578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac909c-b5fd-47a8-9801-9c6714a1a74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:56.319858 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac909c-b5fd-47a8-9801-9c6714a1a74e admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:56.320271 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac909c-b5fd-47a8-9801-9c6714a1a74e admin admin] PATH_INFO: `/v3/users/ce9965bba67a4f8a8d6906d61ae2e4f8` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:56.321608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac909c-b5fd-47a8-9801-9c6714a1a74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9965bba67a4f8a8d6906d61ae2e4f8)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:56.324214 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac909c-b5fd-47a8-9801-9c6714a1a74e admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:56.368958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ffac909c-b5fd-47a8-9801-9c6714a1a74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9965bba67a4f8a8d6906d61ae2e4f8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.369591 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ffac909c-b5fd-47a8-9801-9c6714a1a74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9965bba67a4f8a8d6906d61ae2e4f8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.377704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ffac909c-b5fd-47a8-9801-9c6714a1a74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9965bba67a4f8a8d6906d61ae2e4f8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.378359 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ffac909c-b5fd-47a8-9801-9c6714a1a74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9965bba67a4f8a8d6906d61ae2e4f8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.390619 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ffac909c-b5fd-47a8-9801-9c6714a1a74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9965bba67a4f8a8d6906d61ae2e4f8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.402571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1409/2834] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:56 2022] DELETE /identity/v3/users/ce9965bba67a4f8a8d6906d61ae2e4f8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:56.666180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:56.668176 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:56.677635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:56.682084 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c538db-7954-4af8-b759-eb889419acfd admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:56.741074 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:56.741694 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:56.741970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:56.742239 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] PATH_INFO: `/v3/projects/2bfe906c6c934266b9ffc2d31956844a` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:56.743372 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bfe906c6c934266b9ffc2d31956844a)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:56.745903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:56.799632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bfe906c6c934266b9ffc2d31956844a', 'request_id': 'req-1af13f4a-5da6-41ff-95e4-377501f7a320'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.809146 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bfe906c6c934266b9ffc2d31956844a', 'request_id': 'req-1af13f4a-5da6-41ff-95e4-377501f7a320'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.817454 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bfe906c6c934266b9ffc2d31956844a', 'request_id': 'req-1af13f4a-5da6-41ff-95e4-377501f7a320'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.831013 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] The token cache is being invalidate because project 2bfe906c6c934266b9ffc2d31956844a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:56.831332 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.832008 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:56.833510 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1426/2835] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:56 2022] DELETE /identity/v3/projects/2bfe906c6c934266b9ffc2d31956844a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:56.838298 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049ed18-2a7b-4db9-b31f-19f804b13305 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:56.839257 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049ed18-2a7b-4db9-b31f-19f804b13305 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:56.839762 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049ed18-2a7b-4db9-b31f-19f804b13305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:56.860280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-0049ed18-2a7b-4db9-b31f-19f804b13305 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:56.861645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0049ed18-2a7b-4db9-b31f-19f804b13305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:56.913330 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:56.914902 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:56.927780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1410/2836] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:56.935043 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c98f52-50e0-4e69-aea0-70cc60d4e16b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:56.935332 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c98f52-50e0-4e69-aea0-70cc60d4e16b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:56.935605 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c98f52-50e0-4e69-aea0-70cc60d4e16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:56.954775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-84c98f52-50e0-4e69-aea0-70cc60d4e16b None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:56.956027 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-84c98f52-50e0-4e69-aea0-70cc60d4e16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:56.964642 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1411/2837] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:56.968742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c98f52-50e0-4e69-aea0-70cc60d4e16b None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:56.977539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c98f52-50e0-4e69-aea0-70cc60d4e16b None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:56.981699 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af13f4a-5da6-41ff-95e4-377501f7a320 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:56.982671 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf4505-d1ce-49cd-8e54-1ee084343377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:56.983259 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf4505-d1ce-49cd-8e54-1ee084343377 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:56.983534 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf4505-d1ce-49cd-8e54-1ee084343377 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:56.983799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf4505-d1ce-49cd-8e54-1ee084343377 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:56.984430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf4505-d1ce-49cd-8e54-1ee084343377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:41:56.984728 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf4505-d1ce-49cd-8e54-1ee084343377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:56.986340 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf4505-d1ce-49cd-8e54-1ee084343377 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:56.987011 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347686bc-0af0-4aec-84d3-eb5bdd1f07cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:56.987709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347686bc-0af0-4aec-84d3-eb5bdd1f07cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:56.987986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347686bc-0af0-4aec-84d3-eb5bdd1f07cf admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:56.988259 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347686bc-0af0-4aec-84d3-eb5bdd1f07cf admin admin] PATH_INFO: `/v3/users/3997212e9eb744c1bdcd7a3c96cbca24` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:56.989418 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347686bc-0af0-4aec-84d3-eb5bdd1f07cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3997212e9eb744c1bdcd7a3c96cbca24)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:56.991343 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347686bc-0af0-4aec-84d3-eb5bdd1f07cf admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:56.997952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1412/2838] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 05:41:57.002663 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf4505-d1ce-49cd-8e54-1ee084343377 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:57.014380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf4505-d1ce-49cd-8e54-1ee084343377 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:57.019626 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaadc2-a94c-498e-93e9-e6df6ddff550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:57.020181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaadc2-a94c-498e-93e9-e6df6ddff550 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.020493 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaadc2-a94c-498e-93e9-e6df6ddff550 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.020836 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaadc2-a94c-498e-93e9-e6df6ddff550 admin admin] PATH_INFO: `/v3/projects` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.021548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaadc2-a94c-498e-93e9-e6df6ddff550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:57.023789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaadc2-a94c-498e-93e9-e6df6ddff550 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:57.032683 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:57.043660 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-347686bc-0af0-4aec-84d3-eb5bdd1f07cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3997212e9eb744c1bdcd7a3c96cbca24'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:57.044635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-347686bc-0af0-4aec-84d3-eb5bdd1f07cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3997212e9eb744c1bdcd7a3c96cbca24'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:57.051770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-347686bc-0af0-4aec-84d3-eb5bdd1f07cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3997212e9eb744c1bdcd7a3c96cbca24'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:57.056661 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1413/2839] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:57 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:57.057668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaadc2-a94c-498e-93e9-e6df6ddff550 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:57.058919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-347686bc-0af0-4aec-84d3-eb5bdd1f07cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3997212e9eb744c1bdcd7a3c96cbca24'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:57.059638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-347686bc-0af0-4aec-84d3-eb5bdd1f07cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3997212e9eb744c1bdcd7a3c96cbca24'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:57.080893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:57.088386 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1427/2840] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:56 2022] DELETE /identity/v3/users/3997212e9eb744c1bdcd7a3c96cbca24 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:57.093885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a169fd-efe3-4739-b611-0d5165823786 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.094186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a169fd-efe3-4739-b611-0d5165823786 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.094710 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a169fd-efe3-4739-b611-0d5165823786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.115265 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-73a169fd-efe3-4739-b611-0d5165823786 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:57.116468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-73a169fd-efe3-4739-b611-0d5165823786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:57.135201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaadc2-a94c-498e-93e9-e6df6ddff550 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:57.177185 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1428/2841] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:57.190773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9f464-c630-4930-918b-9f62c3b023f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:57.191389 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f464-c630-4930-918b-9f62c3b023f3 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.191668 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f464-c630-4930-918b-9f62c3b023f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.191925 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a169fd-efe3-4739-b611-0d5165823786 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:57.192049 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f464-c630-4930-918b-9f62c3b023f3 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.192543 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9f464-c630-4930-918b-9f62c3b023f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:57.193786 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-73a169fd-efe3-4739-b611-0d5165823786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:57.194451 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9f464-c630-4930-918b-9f62c3b023f3 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:57.217431 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1414/2842] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:57 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:41:57.221454 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9f464-c630-4930-918b-9f62c3b023f3 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:57.227873 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e0a9f464-c630-4930-918b-9f62c3b023f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:57.241338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9f464-c630-4930-918b-9f62c3b023f3 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:57.248461 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d793184-f9a2-458c-ad2e-e49ed94359ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:57.249244 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d793184-f9a2-458c-ad2e-e49ed94359ae admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.249527 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d793184-f9a2-458c-ad2e-e49ed94359ae admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.250132 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d793184-f9a2-458c-ad2e-e49ed94359ae admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.250812 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d793184-f9a2-458c-ad2e-e49ed94359ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:57.252415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d793184-f9a2-458c-ad2e-e49ed94359ae admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:57.259948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a169fd-efe3-4739-b611-0d5165823786 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:57.262479 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1415/2843] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:57.264121 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102abc5-9131-444e-9ebe-771eac17c417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:57.264727 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102abc5-9131-444e-9ebe-771eac17c417 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.265005 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102abc5-9131-444e-9ebe-771eac17c417 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.265274 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102abc5-9131-444e-9ebe-771eac17c417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.266400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d793184-f9a2-458c-ad2e-e49ed94359ae admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:57.274580 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102abc5-9131-444e-9ebe-771eac17c417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:57.275949 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102abc5-9131-444e-9ebe-771eac17c417 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:57.276267 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d793184-f9a2-458c-ad2e-e49ed94359ae admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:57.281384 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1d5a0-ae24-4456-a539-77ceb127ba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:57.281958 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d5a0-ae24-4456-a539-77ceb127ba3b admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.282237 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d5a0-ae24-4456-a539-77ceb127ba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.282537 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d5a0-ae24-4456-a539-77ceb127ba3b admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.283160 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1d5a0-ae24-4456-a539-77ceb127ba3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:57.284734 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1d5a0-ae24-4456-a539-77ceb127ba3b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:57.285719 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1429/2844] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:41:57.300952 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1416/2845] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:57.304970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102abc5-9131-444e-9ebe-771eac17c417 service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:57.315061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102abc5-9131-444e-9ebe-771eac17c417 service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:57.319684 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a749f-5434-47e3-8f9d-f042debc4f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:57.320324 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a749f-5434-47e3-8f9d-f042debc4f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.320600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a749f-5434-47e3-8f9d-f042debc4f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.320867 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a749f-5434-47e3-8f9d-f042debc4f16 admin admin] PATH_INFO: `/v3/projects/12b007feb13545bfaf5e7d23b67afd9d/users/c2cff273899b40e7a743568050cd4ec0/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.336465 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a749f-5434-47e3-8f9d-f042debc4f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b007feb13545bfaf5e7d23b67afd9d, user_id=c2cff273899b40e7a743568050cd4ec0, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:57.339278 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a749f-5434-47e3-8f9d-f042debc4f16 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:57.352445 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1430/2846] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:57 2022] PUT /identity/v3/projects/12b007feb13545bfaf5e7d23b67afd9d/users/c2cff273899b40e7a743568050cd4ec0/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:57.364926 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f73db-dcd3-4dcf-852b-ccecfd016f0f None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.365135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f73db-dcd3-4dcf-852b-ccecfd016f0f None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.365416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f73db-dcd3-4dcf-852b-ccecfd016f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.399086 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-1d1f73db-dcd3-4dcf-852b-ccecfd016f0f None None] MFA Rules not processed for user `c2cff273899b40e7a743568050cd4ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:57.400339 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1d1f73db-dcd3-4dcf-852b-ccecfd016f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:57.473575 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1417/2847] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:41:57.478270 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a749f-5434-47e3-8f9d-f042debc4f16 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:57.513749 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:57.548251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a749f-5434-47e3-8f9d-f042debc4f16 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:57.553068 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20894193-1cc4-4603-ae60-6348eec1e336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:57.553770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20894193-1cc4-4603-ae60-6348eec1e336 admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.554120 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20894193-1cc4-4603-ae60-6348eec1e336 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.554461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20894193-1cc4-4603-ae60-6348eec1e336 admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.555206 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20894193-1cc4-4603-ae60-6348eec1e336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:57.558058 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20894193-1cc4-4603-ae60-6348eec1e336 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:57.583460 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f73db-dcd3-4dcf-852b-ccecfd016f0f None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:57.585372 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1d1f73db-dcd3-4dcf-852b-ccecfd016f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:57.594374 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1431/2848] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:41:57 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:57.599219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20894193-1cc4-4603-ae60-6348eec1e336 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:57.602333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f73db-dcd3-4dcf-852b-ccecfd016f0f None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:57.623070 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:57.662654 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:57.663289 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.663569 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.663846 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] PATH_INFO: `/v3/projects/1242ef26902d48359c7db9d3b1d08a45` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.663979 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20894193-1cc4-4603-ae60-6348eec1e336 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:57.664977 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1242ef26902d48359c7db9d3b1d08a45)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:57.667559 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:57.669082 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92aceb-4e02-43c4-bed9-ee2e974098dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:57.669685 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92aceb-4e02-43c4-bed9-ee2e974098dc admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.669964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92aceb-4e02-43c4-bed9-ee2e974098dc admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.670232 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92aceb-4e02-43c4-bed9-ee2e974098dc admin admin] PATH_INFO: `/v3/users` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.670887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92aceb-4e02-43c4-bed9-ee2e974098dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:57.672813 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92aceb-4e02-43c4-bed9-ee2e974098dc admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:57.694900 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1432/2849] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:41:57 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:41:57.700284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92aceb-4e02-43c4-bed9-ee2e974098dc admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:57.710480 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92aceb-4e02-43c4-bed9-ee2e974098dc admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:57.716916 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1242ef26902d48359c7db9d3b1d08a45', 'request_id': 'req-0bccb877-2a08-48be-84a2-e98d34ad61f2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:57.722805 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1242ef26902d48359c7db9d3b1d08a45', 'request_id': 'req-0bccb877-2a08-48be-84a2-e98d34ad61f2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:57.731310 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1242ef26902d48359c7db9d3b1d08a45', 'request_id': 'req-0bccb877-2a08-48be-84a2-e98d34ad61f2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:57.743851 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] The token cache is being invalidate because project 1242ef26902d48359c7db9d3b1d08a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:57.744144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:57.744791 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:57.746850 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1418/2850] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:57 2022] DELETE /identity/v3/projects/1242ef26902d48359c7db9d3b1d08a45 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:57.768834 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2659f-2cdc-471d-b186-8fb181dec48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:57.769469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2659f-2cdc-471d-b186-8fb181dec48a admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.769748 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2659f-2cdc-471d-b186-8fb181dec48a admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.770184 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2659f-2cdc-471d-b186-8fb181dec48a admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.770887 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2659f-2cdc-471d-b186-8fb181dec48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:57.772533 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2659f-2cdc-471d-b186-8fb181dec48a admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:57.783781 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1433/2851] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:41:57.788140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:57.789692 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:57.802592 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccb877-2a08-48be-84a2-e98d34ad61f2 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:57.808383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99467c4d-adb2-4c94-b3e2-d157bcbbc7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:57.809087 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467c4d-adb2-4c94-b3e2-d157bcbbc7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.809368 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467c4d-adb2-4c94-b3e2-d157bcbbc7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.809644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467c4d-adb2-4c94-b3e2-d157bcbbc7c5 admin admin] PATH_INFO: `/v3/projects/5ac2b4d79e074ead8f47f2c2c5ff635f/users/a171cdbec4b240818becf1d48c61c064/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.827608 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99467c4d-adb2-4c94-b3e2-d157bcbbc7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac2b4d79e074ead8f47f2c2c5ff635f, user_id=a171cdbec4b240818becf1d48c61c064, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:57.830689 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99467c4d-adb2-4c94-b3e2-d157bcbbc7c5 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:57.847704 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1419/2852] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:57 2022] PUT /identity/v3/projects/5ac2b4d79e074ead8f47f2c2c5ff635f/users/a171cdbec4b240818becf1d48c61c064/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:57.851898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2659f-2cdc-471d-b186-8fb181dec48a admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:57.863546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2659f-2cdc-471d-b186-8fb181dec48a admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:57.912140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:57.930733 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dd56a-7462-4305-81af-b64e3b27b5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:57.931355 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dd56a-7462-4305-81af-b64e3b27b5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.931632 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dd56a-7462-4305-81af-b64e3b27b5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.931920 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dd56a-7462-4305-81af-b64e3b27b5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.932603 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88dd56a-7462-4305-81af-b64e3b27b5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:57.934338 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88dd56a-7462-4305-81af-b64e3b27b5d8 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:57.945760 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1434/2853] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:41:57.950604 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99467c4d-adb2-4c94-b3e2-d157bcbbc7c5 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:57.961660 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99467c4d-adb2-4c94-b3e2-d157bcbbc7c5 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:57.967148 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be278d-e66e-4405-b4da-bc23f5ab9871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:57.967818 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be278d-e66e-4405-b4da-bc23f5ab9871 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.968095 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be278d-e66e-4405-b4da-bc23f5ab9871 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.968363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be278d-e66e-4405-b4da-bc23f5ab9871 admin admin] PATH_INFO: `/v3/projects/5ac2b4d79e074ead8f47f2c2c5ff635f/users/a171cdbec4b240818becf1d48c61c064/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:57.970287 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be278d-e66e-4405-b4da-bc23f5ab9871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac2b4d79e074ead8f47f2c2c5ff635f, user_id=a171cdbec4b240818becf1d48c61c064, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:57.972970 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be278d-e66e-4405-b4da-bc23f5ab9871 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:57.984250 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1420/2854] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:41:57 2022] PUT /identity/v3/projects/5ac2b4d79e074ead8f47f2c2c5ff635f/users/a171cdbec4b240818becf1d48c61c064/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:57.995335 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023506a-4a9a-4e8e-a5c4-5b86ce520fb2 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:57.995747 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023506a-4a9a-4e8e-a5c4-5b86ce520fb2 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:57.996077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023506a-4a9a-4e8e-a5c4-5b86ce520fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:58.028273 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f023506a-4a9a-4e8e-a5c4-5b86ce520fb2 None None] MFA Rules not processed for user `a171cdbec4b240818becf1d48c61c064`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:58.029503 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f023506a-4a9a-4e8e-a5c4-5b86ce520fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:58.099508 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1435/2855] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:58.114692 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be278d-e66e-4405-b4da-bc23f5ab9871 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:58.116443 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-f0be278d-e66e-4405-b4da-bc23f5ab9871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:58.175005 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be278d-e66e-4405-b4da-bc23f5ab9871 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:58.179128 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f421168-1f0f-4b79-91b8-66370efcc8ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:58.179803 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f421168-1f0f-4b79-91b8-66370efcc8ba service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:58.180123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f421168-1f0f-4b79-91b8-66370efcc8ba service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:58.180453 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f421168-1f0f-4b79-91b8-66370efcc8ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:58.191196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f421168-1f0f-4b79-91b8-66370efcc8ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:58.192690 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f421168-1f0f-4b79-91b8-66370efcc8ba service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:58.202998 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1421/2856] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:58.272052 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03a22-45e8-453d-9a5d-0d1e01012d3e None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:58.272337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03a22-45e8-453d-9a5d-0d1e01012d3e None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:58.272612 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03a22-45e8-453d-9a5d-0d1e01012d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:58.293495 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-86c03a22-45e8-453d-9a5d-0d1e01012d3e None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:58.294736 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-86c03a22-45e8-453d-9a5d-0d1e01012d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:58.298415 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f421168-1f0f-4b79-91b8-66370efcc8ba service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:58.306988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f421168-1f0f-4b79-91b8-66370efcc8ba service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:58.311236 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d9b71-8cc2-45ce-8d66-6ac033154a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:58.311889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9b71-8cc2-45ce-8d66-6ac033154a2e service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:58.312235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9b71-8cc2-45ce-8d66-6ac033154a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:58.312571 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9b71-8cc2-45ce-8d66-6ac033154a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:58.314382 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1a2d9b71-8cc2-45ce-8d66-6ac033154a2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:58.330066 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:58.356337 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1436/2857] 10.222.0.16 () {58 vars in 1016 bytes} [Fri Sep 16 05:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:58.376722 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d9b71-8cc2-45ce-8d66-6ac033154a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:58.378149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d9b71-8cc2-45ce-8d66-6ac033154a2e service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:58.387902 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1422/2858] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 05:41:58.404182 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03a22-45e8-453d-9a5d-0d1e01012d3e None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:58.405903 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-86c03a22-45e8-453d-9a5d-0d1e01012d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:58.476655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:58.482955 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03a22-45e8-453d-9a5d-0d1e01012d3e None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:58.489067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744352dc-a14d-434f-9951-3b4fecc8658f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:58.489674 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744352dc-a14d-434f-9951-3b4fecc8658f service nova] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:58.489948 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744352dc-a14d-434f-9951-3b4fecc8658f service nova] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:58.490221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744352dc-a14d-434f-9951-3b4fecc8658f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:58.499654 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744352dc-a14d-434f-9951-3b4fecc8658f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:58.501162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744352dc-a14d-434f-9951-3b4fecc8658f service nova] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:58.511097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1437/2859] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:58.661280 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d9b71-8cc2-45ce-8d66-6ac033154a2e service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:58.672204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d9b71-8cc2-45ce-8d66-6ac033154a2e service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:58.676705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:58.677317 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:58.677590 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:58.677854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] PATH_INFO: `/v3/users/c2cff273899b40e7a743568050cd4ec0` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:58.679123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2cff273899b40e7a743568050cd4ec0)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:58.681053 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:58.726380 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2cff273899b40e7a743568050cd4ec0'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:58.727044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2cff273899b40e7a743568050cd4ec0'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:58.734473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2cff273899b40e7a743568050cd4ec0'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:58.735101 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2cff273899b40e7a743568050cd4ec0'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:58.747155 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2cff273899b40e7a743568050cd4ec0'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:58.758799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1423/2860] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:58 2022] DELETE /identity/v3/users/c2cff273899b40e7a743568050cd4ec0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:58.763376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8157fdd-d9fc-43a2-a45e-8260c9d0c1ef None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:58.763837 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8157fdd-d9fc-43a2-a45e-8260c9d0c1ef None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:58.763936 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8157fdd-d9fc-43a2-a45e-8260c9d0c1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:58.782390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-e8157fdd-d9fc-43a2-a45e-8260c9d0c1ef None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:58.783600 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e8157fdd-d9fc-43a2-a45e-8260c9d0c1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:58.842268 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1438/2861] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:58.851771 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:58.853159 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:58.908573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4da2b-6e37-4fc1-a3af-f3478dd32bb7 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:58.912172 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa366118-36c3-4815-ae37-0dc141f32934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:58.912768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366118-36c3-4815-ae37-0dc141f32934 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:58.913044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366118-36c3-4815-ae37-0dc141f32934 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:58.913313 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366118-36c3-4815-ae37-0dc141f32934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:58.922650 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa366118-36c3-4815-ae37-0dc141f32934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:58.924069 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa366118-36c3-4815-ae37-0dc141f32934 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:58.933833 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1424/2862] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:41:59.195471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8157fdd-d9fc-43a2-a45e-8260c9d0c1ef None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:59.196886 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e8157fdd-d9fc-43a2-a45e-8260c9d0c1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:59.209590 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8157fdd-d9fc-43a2-a45e-8260c9d0c1ef None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:59.216376 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:59.217020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:59.217615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:59.217615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] PATH_INFO: `/v3/projects/12b007feb13545bfaf5e7d23b67afd9d` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:59.218694 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b007feb13545bfaf5e7d23b67afd9d)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:59.220725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:59.272605 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b007feb13545bfaf5e7d23b67afd9d', 'request_id': 'req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.278607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b007feb13545bfaf5e7d23b67afd9d', 'request_id': 'req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.285615 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b007feb13545bfaf5e7d23b67afd9d', 'request_id': 'req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.296985 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] The token cache is being invalidate because project 12b007feb13545bfaf5e7d23b67afd9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:59.297287 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.297881 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.299371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1439/2863] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:59 2022] DELETE /identity/v3/projects/12b007feb13545bfaf5e7d23b67afd9d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:59.303322 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa366118-36c3-4815-ae37-0dc141f32934 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:59.313009 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa366118-36c3-4815-ae37-0dc141f32934 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:59.341362 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:59.370102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e05f25-5835-4ba2-8f80-afabd301a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:59.370755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05f25-5835-4ba2-8f80-afabd301a8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:59.371035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05f25-5835-4ba2-8f80-afabd301a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:59.371302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05f25-5835-4ba2-8f80-afabd301a8a7 admin admin] PATH_INFO: `/v3/users/a171cdbec4b240818becf1d48c61c064` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:59.372405 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e05f25-5835-4ba2-8f80-afabd301a8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a171cdbec4b240818becf1d48c61c064)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:59.374336 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e05f25-5835-4ba2-8f80-afabd301a8a7 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:59.431705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-94e05f25-5835-4ba2-8f80-afabd301a8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a171cdbec4b240818becf1d48c61c064'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.432282 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-94e05f25-5835-4ba2-8f80-afabd301a8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a171cdbec4b240818becf1d48c61c064'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.439716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-94e05f25-5835-4ba2-8f80-afabd301a8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a171cdbec4b240818becf1d48c61c064'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.440348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-94e05f25-5835-4ba2-8f80-afabd301a8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a171cdbec4b240818becf1d48c61c064'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.452527 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-94e05f25-5835-4ba2-8f80-afabd301a8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a171cdbec4b240818becf1d48c61c064'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.465169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1425/2864] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:41:59 2022] DELETE /identity/v3/users/a171cdbec4b240818becf1d48c61c064 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:41:59.738677 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:41:59.740307 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:59.753444 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc72a10-2a8b-4e5f-8acb-de4859a7b456 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:41:59.811131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d05573-9d88-490e-9a23-9fdfa7704aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:41:59.811770 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d05573-9d88-490e-9a23-9fdfa7704aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:59.812061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d05573-9d88-490e-9a23-9fdfa7704aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:59.812334 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d05573-9d88-490e-9a23-9fdfa7704aa7 admin admin] PATH_INFO: `/v3/projects/5ac2b4d79e074ead8f47f2c2c5ff635f` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:59.813450 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d05573-9d88-490e-9a23-9fdfa7704aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac2b4d79e074ead8f47f2c2c5ff635f)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:41:59.815396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d05573-9d88-490e-9a23-9fdfa7704aa7 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:41:59.832498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:41:59.862996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d6d05573-9d88-490e-9a23-9fdfa7704aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac2b4d79e074ead8f47f2c2c5ff635f', 'request_id': 'req-d6d05573-9d88-490e-9a23-9fdfa7704aa7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.868389 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d6d05573-9d88-490e-9a23-9fdfa7704aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac2b4d79e074ead8f47f2c2c5ff635f', 'request_id': 'req-d6d05573-9d88-490e-9a23-9fdfa7704aa7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.875371 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d6d05573-9d88-490e-9a23-9fdfa7704aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac2b4d79e074ead8f47f2c2c5ff635f', 'request_id': 'req-d6d05573-9d88-490e-9a23-9fdfa7704aa7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.886145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d6d05573-9d88-490e-9a23-9fdfa7704aa7 admin admin] The token cache is being invalidate because project 5ac2b4d79e074ead8f47f2c2c5ff635f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:41:59.886432 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d6d05573-9d88-490e-9a23-9fdfa7704aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.887085 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-d6d05573-9d88-490e-9a23-9fdfa7704aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:41:59.888524 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1440/2865] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:41:59 2022] DELETE /identity/v3/projects/5ac2b4d79e074ead8f47f2c2c5ff635f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 05:41:59.893609 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b9cdc-c94d-4f31-9854-53002851877d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:59.893893 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b9cdc-c94d-4f31-9854-53002851877d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:59.894164 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b9cdc-c94d-4f31-9854-53002851877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:41:59.913640 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-273b9cdc-c94d-4f31-9854-53002851877d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:41:59.914860 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-273b9cdc-c94d-4f31-9854-53002851877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:41:59.972178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1426/2866] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:41:59.981251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad5cb1-d23c-4e78-a685-591d01769a20 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:41:59.981567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad5cb1-d23c-4e78-a685-591d01769a20 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:41:59.981868 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad5cb1-d23c-4e78-a685-591d01769a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.001055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-b9ad5cb1-d23c-4e78-a685-591d01769a20 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:00.002254 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b9ad5cb1-d23c-4e78-a685-591d01769a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:00.011769 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1441/2867] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:42:00.015939 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b9cdc-c94d-4f31-9854-53002851877d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:00.025546 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b9cdc-c94d-4f31-9854-53002851877d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:00.030710 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654d65-2c85-437e-918c-bc0434742fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:00.031300 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654d65-2c85-437e-918c-bc0434742fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.031574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654d65-2c85-437e-918c-bc0434742fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.031842 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654d65-2c85-437e-918c-bc0434742fa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.032473 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14654d65-2c85-437e-918c-bc0434742fa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:42:00.032769 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14654d65-2c85-437e-918c-bc0434742fa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:00.034615 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14654d65-2c85-437e-918c-bc0434742fa8 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:00.051589 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1427/2868] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:42:00.053029 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad5cb1-d23c-4e78-a685-591d01769a20 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:00.062321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad5cb1-d23c-4e78-a685-591d01769a20 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:00.067062 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96125a85-95c9-4f79-81b5-d3c79a08d02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:00.068140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96125a85-95c9-4f79-81b5-d3c79a08d02a admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.068140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96125a85-95c9-4f79-81b5-d3c79a08d02a admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.068382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96125a85-95c9-4f79-81b5-d3c79a08d02a admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.068832 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96125a85-95c9-4f79-81b5-d3c79a08d02a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:00.071232 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96125a85-95c9-4f79-81b5-d3c79a08d02a admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:00.099692 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1442/2869] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:42:00 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:42:00.103716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654d65-2c85-437e-918c-bc0434742fa8 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:00.115137 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654d65-2c85-437e-918c-bc0434742fa8 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:00.146831 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:00.171234 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4e0d0-1546-43f3-9f76-0d2475c7aba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:00.171824 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4e0d0-1546-43f3-9f76-0d2475c7aba1 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.172101 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4e0d0-1546-43f3-9f76-0d2475c7aba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.172376 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4e0d0-1546-43f3-9f76-0d2475c7aba1 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.173015 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4e0d0-1546-43f3-9f76-0d2475c7aba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:00.174993 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4e0d0-1546-43f3-9f76-0d2475c7aba1 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:00.195416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1428/2870] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:42:00 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:42:00.200003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96125a85-95c9-4f79-81b5-d3c79a08d02a admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:00.210396 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96125a85-95c9-4f79-81b5-d3c79a08d02a admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:00.215661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea82d3e-e571-4ad4-a67f-869736d560e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:00.216276 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea82d3e-e571-4ad4-a67f-869736d560e1 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.216552 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea82d3e-e571-4ad4-a67f-869736d560e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.216820 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea82d3e-e571-4ad4-a67f-869736d560e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.217483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea82d3e-e571-4ad4-a67f-869736d560e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:00.219109 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea82d3e-e571-4ad4-a67f-869736d560e1 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:00.229498 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1443/2871] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:42:00.233289 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4e0d0-1546-43f3-9f76-0d2475c7aba1 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:00.243402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4e0d0-1546-43f3-9f76-0d2475c7aba1 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:00.249016 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170b856-84dd-48eb-a4b2-e9f47cba0afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:00.249618 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170b856-84dd-48eb-a4b2-e9f47cba0afb admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.250192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170b856-84dd-48eb-a4b2-e9f47cba0afb admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.250192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170b856-84dd-48eb-a4b2-e9f47cba0afb admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.250811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170b856-84dd-48eb-a4b2-e9f47cba0afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:00.252459 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170b856-84dd-48eb-a4b2-e9f47cba0afb admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:00.264942 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1429/2872] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:42:00.269097 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea82d3e-e571-4ad4-a67f-869736d560e1 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:00.279773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea82d3e-e571-4ad4-a67f-869736d560e1 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:00.284640 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e1743-3c43-4d02-974f-dfb0756d70cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:00.285290 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e1743-3c43-4d02-974f-dfb0756d70cc admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.285569 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e1743-3c43-4d02-974f-dfb0756d70cc admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.285840 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e1743-3c43-4d02-974f-dfb0756d70cc admin admin] PATH_INFO: `/v3/projects/b207902102f4426cbb3b39fe5ffb0763/users/5c4c212d22104b3cb18dc46840849688/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.300231 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e1743-3c43-4d02-974f-dfb0756d70cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b207902102f4426cbb3b39fe5ffb0763, user_id=5c4c212d22104b3cb18dc46840849688, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:00.302885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e1743-3c43-4d02-974f-dfb0756d70cc admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:00.315383 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1444/2873] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:42:00 2022] PUT /identity/v3/projects/b207902102f4426cbb3b39fe5ffb0763/users/5c4c212d22104b3cb18dc46840849688/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:00.379925 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af669714-09c4-430d-b99e-615d4b5fea0b None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.380486 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af669714-09c4-430d-b99e-615d4b5fea0b None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.380617 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af669714-09c4-430d-b99e-615d4b5fea0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.408318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-af669714-09c4-430d-b99e-615d4b5fea0b None None] MFA Rules not processed for user `5c4c212d22104b3cb18dc46840849688`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:00.409527 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-af669714-09c4-430d-b99e-615d4b5fea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:00.470900 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1430/2874] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:42:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:42:00.475368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e1743-3c43-4d02-974f-dfb0756d70cc admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:00.536062 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e1743-3c43-4d02-974f-dfb0756d70cc admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:00.540655 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12064114-6ba3-486b-882a-dbcf221a889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:00.541251 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12064114-6ba3-486b-882a-dbcf221a889d admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.541530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12064114-6ba3-486b-882a-dbcf221a889d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.541804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12064114-6ba3-486b-882a-dbcf221a889d admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.542425 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12064114-6ba3-486b-882a-dbcf221a889d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:00.544341 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12064114-6ba3-486b-882a-dbcf221a889d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:00.570572 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1445/2875] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:42:00 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:42:00.575260 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af669714-09c4-430d-b99e-615d4b5fea0b None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:00.586491 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af669714-09c4-430d-b99e-615d4b5fea0b None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:00.640969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f707c2-41e7-432d-9c40-b6db6447bc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:00.641567 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f707c2-41e7-432d-9c40-b6db6447bc36 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.641847 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f707c2-41e7-432d-9c40-b6db6447bc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.642120 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f707c2-41e7-432d-9c40-b6db6447bc36 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.642807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f707c2-41e7-432d-9c40-b6db6447bc36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:00.644778 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f707c2-41e7-432d-9c40-b6db6447bc36 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:00.665651 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1431/2876] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:42:00 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:42:00.669890 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12064114-6ba3-486b-882a-dbcf221a889d admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:00.680221 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12064114-6ba3-486b-882a-dbcf221a889d admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:00.686102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666ecc5-d0cb-41a0-871e-1e02708962e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:00.686748 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666ecc5-d0cb-41a0-871e-1e02708962e8 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.687033 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666ecc5-d0cb-41a0-871e-1e02708962e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.687308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666ecc5-d0cb-41a0-871e-1e02708962e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.687998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666ecc5-d0cb-41a0-871e-1e02708962e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:00.689619 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666ecc5-d0cb-41a0-871e-1e02708962e8 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:00.702367 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1446/2877] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:42:00.706842 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f707c2-41e7-432d-9c40-b6db6447bc36 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:00.716940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f707c2-41e7-432d-9c40-b6db6447bc36 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:00.721698 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efc527-4654-4930-a99d-b734fae54f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:00.722383 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efc527-4654-4930-a99d-b734fae54f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.722716 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efc527-4654-4930-a99d-b734fae54f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.723011 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efc527-4654-4930-a99d-b734fae54f0c admin admin] PATH_INFO: `/v3/projects/50675d15d089440087267d9fc774b702/users/a0eb7abec4e246cbabc6ac50a5538ef8/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.737768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efc527-4654-4930-a99d-b734fae54f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=50675d15d089440087267d9fc774b702, user_id=a0eb7abec4e246cbabc6ac50a5538ef8, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:00.740606 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efc527-4654-4930-a99d-b734fae54f0c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:00.753715 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1432/2878] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:42:00 2022] PUT /identity/v3/projects/50675d15d089440087267d9fc774b702/users/a0eb7abec4e246cbabc6ac50a5538ef8/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:00.758043 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666ecc5-d0cb-41a0-871e-1e02708962e8 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:00.771964 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666ecc5-d0cb-41a0-871e-1e02708962e8 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:00.785370 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:00.831648 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1288c-c023-4ce2-b97e-3ffa45ddcc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:00.832291 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1288c-c023-4ce2-b97e-3ffa45ddcc6f admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.832505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1288c-c023-4ce2-b97e-3ffa45ddcc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.832798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1288c-c023-4ce2-b97e-3ffa45ddcc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.833426 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1288c-c023-4ce2-b97e-3ffa45ddcc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:00.835041 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1288c-c023-4ce2-b97e-3ffa45ddcc6f admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:00.844563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1447/2879] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:42:00.848729 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efc527-4654-4930-a99d-b734fae54f0c admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:00.858775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efc527-4654-4930-a99d-b734fae54f0c admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:00.863370 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04718f2a-1d13-4ad1-a449-b820449b99ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:00.864013 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04718f2a-1d13-4ad1-a449-b820449b99ca admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.864292 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04718f2a-1d13-4ad1-a449-b820449b99ca admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.864568 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04718f2a-1d13-4ad1-a449-b820449b99ca admin admin] PATH_INFO: `/v3/projects/50675d15d089440087267d9fc774b702/users/a0eb7abec4e246cbabc6ac50a5538ef8/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.866578 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04718f2a-1d13-4ad1-a449-b820449b99ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=50675d15d089440087267d9fc774b702, user_id=a0eb7abec4e246cbabc6ac50a5538ef8, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:00.869233 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04718f2a-1d13-4ad1-a449-b820449b99ca admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:00.876197 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:00.883773 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1433/2880] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:42:00 2022] PUT /identity/v3/projects/50675d15d089440087267d9fc774b702/users/a0eb7abec4e246cbabc6ac50a5538ef8/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:00.894608 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09117b8a-61f4-4f6a-acd6-244136c58a80 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:00.894896 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09117b8a-61f4-4f6a-acd6-244136c58a80 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:00.895172 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09117b8a-61f4-4f6a-acd6-244136c58a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:00.922839 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-09117b8a-61f4-4f6a-acd6-244136c58a80 None None] MFA Rules not processed for user `a0eb7abec4e246cbabc6ac50a5538ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:00.924054 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-09117b8a-61f4-4f6a-acd6-244136c58a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:00.991633 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1448/2881] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:42:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:42:01.003006 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04718f2a-1d13-4ad1-a449-b820449b99ca admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:01.004874 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-04718f2a-1d13-4ad1-a449-b820449b99ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:01.062798 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04718f2a-1d13-4ad1-a449-b820449b99ca admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:01.066402 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58eabb-0ec0-472b-813d-09965a45c012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:01.067039 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58eabb-0ec0-472b-813d-09965a45c012 service cinder] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:01.067318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58eabb-0ec0-472b-813d-09965a45c012 service cinder] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:01.067585 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58eabb-0ec0-472b-813d-09965a45c012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:01.122569 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58eabb-0ec0-472b-813d-09965a45c012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:01.124019 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58eabb-0ec0-472b-813d-09965a45c012 service cinder] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:01.132706 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1434/2882] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:42:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:42:01.408549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f06fe0-f395-4480-bfc5-7db1fe93dee9 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:01.408831 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f06fe0-f395-4480-bfc5-7db1fe93dee9 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:01.409101 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f06fe0-f395-4480-bfc5-7db1fe93dee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:01.431048 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-52f06fe0-f395-4480-bfc5-7db1fe93dee9 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:01.438274 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-52f06fe0-f395-4480-bfc5-7db1fe93dee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:01.517311 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1449/2883] 10.222.0.16 () {58 vars in 1016 bytes} [Fri Sep 16 05:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:42:01.549251 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58eabb-0ec0-472b-813d-09965a45c012 service cinder] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:01.550747 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-df58eabb-0ec0-472b-813d-09965a45c012 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:01.623680 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58eabb-0ec0-472b-813d-09965a45c012 service cinder] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:01.629153 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dba82e-933f-4619-b87e-d8e563ca658b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:01.629789 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dba82e-933f-4619-b87e-d8e563ca658b service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:01.630069 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dba82e-933f-4619-b87e-d8e563ca658b service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:01.630340 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dba82e-933f-4619-b87e-d8e563ca658b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:01.638363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dba82e-933f-4619-b87e-d8e563ca658b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:01.639988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dba82e-933f-4619-b87e-d8e563ca658b service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:01.649223 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1435/2884] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:42:04.630219 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9e7be-d473-4261-a109-d7fbb29da013 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:04.630802 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9e7be-d473-4261-a109-d7fbb29da013 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:04.630915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9e7be-d473-4261-a109-d7fbb29da013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:04.650709 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-f9d9e7be-d473-4261-a109-d7fbb29da013 None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:04.652458 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f9d9e7be-d473-4261-a109-d7fbb29da013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:04.660302 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1450/2885] 10.222.0.16 () {58 vars in 1016 bytes} [Fri Sep 16 05:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:42:04.690196 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dba82e-933f-4619-b87e-d8e563ca658b service nova] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:04.691616 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-81dba82e-933f-4619-b87e-d8e563ca658b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:04.706767 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dba82e-933f-4619-b87e-d8e563ca658b service nova] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:04.712201 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a72c8-5a65-467d-ac08-d2da73199653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:04.712792 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a72c8-5a65-467d-ac08-d2da73199653 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:04.713064 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a72c8-5a65-467d-ac08-d2da73199653 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:04.713333 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a72c8-5a65-467d-ac08-d2da73199653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:04.722408 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a72c8-5a65-467d-ac08-d2da73199653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:04.726625 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a72c8-5a65-467d-ac08-d2da73199653 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:04.741452 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1436/2886] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:42:05.370163 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9e7be-d473-4261-a109-d7fbb29da013 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:05.372055 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f9d9e7be-d473-4261-a109-d7fbb29da013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:05.383556 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9e7be-d473-4261-a109-d7fbb29da013 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:05.387659 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780efbb-fa64-4b40-911e-1f02bf76ca55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc48962e649c40ca82cf3173ce9940e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:05.388244 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780efbb-fa64-4b40-911e-1f02bf76ca55 service cinder] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:05.388523 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780efbb-fa64-4b40-911e-1f02bf76ca55 service cinder] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:05.388790 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780efbb-fa64-4b40-911e-1f02bf76ca55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:05.397461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780efbb-fa64-4b40-911e-1f02bf76ca55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:05.398895 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780efbb-fa64-4b40-911e-1f02bf76ca55 service cinder] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:05.408003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1451/2887] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:42:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:42:10.310192 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a72c8-5a65-467d-ac08-d2da73199653 service nova] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:10.319658 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a72c8-5a65-467d-ac08-d2da73199653 service nova] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:10.324140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:10.324755 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:10.325030 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:10.325302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] PATH_INFO: `/v3/users/5c4c212d22104b3cb18dc46840849688` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:10.326443 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c4c212d22104b3cb18dc46840849688)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:10.328645 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:10.350137 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:10.383430 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c4c212d22104b3cb18dc46840849688'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:10.384084 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c4c212d22104b3cb18dc46840849688'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:10.391190 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c4c212d22104b3cb18dc46840849688'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:10.391799 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c4c212d22104b3cb18dc46840849688'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:10.404169 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c4c212d22104b3cb18dc46840849688'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:10.415898 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1437/2888] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:42:10 2022] DELETE /identity/v3/users/5c4c212d22104b3cb18dc46840849688 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:10.420894 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9899e7e-f441-4f36-abea-cff149cdaa8d None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:10.421382 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9899e7e-f441-4f36-abea-cff149cdaa8d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:10.421504 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9899e7e-f441-4f36-abea-cff149cdaa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:10.439817 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-b9899e7e-f441-4f36-abea-cff149cdaa8d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:10.440996 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b9899e7e-f441-4f36-abea-cff149cdaa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:10.452391 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:10.499772 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1452/2889] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 05:42:10.509665 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:10.511105 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:10.567385 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb60889-2b7d-40ce-a84c-0c349e517b4d admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:10.570999 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb149f-598d-4a00-9ff9-fbfa7ae1bb5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:10.571590 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb149f-598d-4a00-9ff9-fbfa7ae1bb5c service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:10.571872 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb149f-598d-4a00-9ff9-fbfa7ae1bb5c service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:10.572135 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb149f-598d-4a00-9ff9-fbfa7ae1bb5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:10.583181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb149f-598d-4a00-9ff9-fbfa7ae1bb5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:10.584622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb149f-598d-4a00-9ff9-fbfa7ae1bb5c service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:10.594302 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1438/2890] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:42:10.850403 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9899e7e-f441-4f36-abea-cff149cdaa8d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:10.851953 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-b9899e7e-f441-4f36-abea-cff149cdaa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:10.864040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9899e7e-f441-4f36-abea-cff149cdaa8d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:10.868821 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:10.869464 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:10.869739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:10.870009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] PATH_INFO: `/v3/projects/b207902102f4426cbb3b39fe5ffb0763` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:10.871237 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b207902102f4426cbb3b39fe5ffb0763)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:10.873156 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:10.919773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b207902102f4426cbb3b39fe5ffb0763', 'request_id': 'req-fb762aec-c805-462f-a90d-7d90980b28f3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:10.925094 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b207902102f4426cbb3b39fe5ffb0763', 'request_id': 'req-fb762aec-c805-462f-a90d-7d90980b28f3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:10.932565 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b207902102f4426cbb3b39fe5ffb0763', 'request_id': 'req-fb762aec-c805-462f-a90d-7d90980b28f3'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:10.943563 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] The token cache is being invalidate because project b207902102f4426cbb3b39fe5ffb0763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:42:10.943844 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:10.944461 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:10.945913 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1453/2891] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:42:10 2022] DELETE /identity/v3/projects/b207902102f4426cbb3b39fe5ffb0763 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:10.950388 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb149f-598d-4a00-9ff9-fbfa7ae1bb5c service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:10.960119 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb149f-598d-4a00-9ff9-fbfa7ae1bb5c service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:11.016766 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:11.017316 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:11.017593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:11.017862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] PATH_INFO: `/v3/users/a0eb7abec4e246cbabc6ac50a5538ef8` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:11.019006 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0eb7abec4e246cbabc6ac50a5538ef8)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:11.020910 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:11.062440 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:11.068779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0eb7abec4e246cbabc6ac50a5538ef8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:11.069741 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0eb7abec4e246cbabc6ac50a5538ef8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:11.078046 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0eb7abec4e246cbabc6ac50a5538ef8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:11.078974 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0eb7abec4e246cbabc6ac50a5538ef8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:11.091173 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0eb7abec4e246cbabc6ac50a5538ef8'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:11.103178 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1439/2892] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:42:10 2022] DELETE /identity/v3/users/a0eb7abec4e246cbabc6ac50a5538ef8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:11.390567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:11.392020 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:11.412439 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb762aec-c805-462f-a90d-7d90980b28f3 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:11.492549 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:11.493292 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:11.493496 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:11.493773 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] PATH_INFO: `/v3/projects/50675d15d089440087267d9fc774b702` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:11.494970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50675d15d089440087267d9fc774b702)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:11.497463 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:11.544368 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:11.547798 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50675d15d089440087267d9fc774b702', 'request_id': 'req-f9adec0c-5548-44ec-912a-c2a5cebb0774'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:11.554928 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50675d15d089440087267d9fc774b702', 'request_id': 'req-f9adec0c-5548-44ec-912a-c2a5cebb0774'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:11.563469 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50675d15d089440087267d9fc774b702', 'request_id': 'req-f9adec0c-5548-44ec-912a-c2a5cebb0774'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:11.574912 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] The token cache is being invalidate because project 50675d15d089440087267d9fc774b702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:42:11.575212 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:11.575821 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:11.577308 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1454/2893] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:42:11 2022] DELETE /identity/v3/projects/50675d15d089440087267d9fc774b702 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:18.446780 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:18.448235 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:18.504212 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c990c4-3e10-4001-8d23-9f8aeeba5fde admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:18.550595 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e5b78-76dc-4c7f-aab0-73b1f2765192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:18.551191 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e5b78-76dc-4c7f-aab0-73b1f2765192 service neutron] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:18.551469 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e5b78-76dc-4c7f-aab0-73b1f2765192 service neutron] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:18.551737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e5b78-76dc-4c7f-aab0-73b1f2765192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:18.553447 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-245e5b78-76dc-4c7f-aab0-73b1f2765192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:18.610586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e5b78-76dc-4c7f-aab0-73b1f2765192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:18.612024 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e5b78-76dc-4c7f-aab0-73b1f2765192 service neutron] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:18.620775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1440/2894] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:42:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:42:21.571551 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:23.672576 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:23.674158 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:23.687131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adec0c-5548-44ec-912a-c2a5cebb0774 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:23.690595 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97fa8b-ac7e-4453-b42d-42c3d39232d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:23.691186 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97fa8b-ac7e-4453-b42d-42c3d39232d9 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:23.691466 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97fa8b-ac7e-4453-b42d-42c3d39232d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:23.691739 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97fa8b-ac7e-4453-b42d-42c3d39232d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:23.693414 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-eb97fa8b-ac7e-4453-b42d-42c3d39232d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:23.757066 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97fa8b-ac7e-4453-b42d-42c3d39232d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:23.758516 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97fa8b-ac7e-4453-b42d-42c3d39232d9 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:23.768295 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1455/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:42:28.616721 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=82,keystone:DELETE=4,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:29.994649 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e5b78-76dc-4c7f-aab0-73b1f2765192 service neutron] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:29.996347 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-245e5b78-76dc-4c7f-aab0-73b1f2765192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:30.013979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e5b78-76dc-4c7f-aab0-73b1f2765192 service neutron] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:30.018779 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:30.019423 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:30.019705 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:30.019983 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] PATH_INFO: `/v3/users/e9a6fa6a7f4a4e4fbfd711dbf9b73916` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:30.021914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a6fa6a7f4a4e4fbfd711dbf9b73916)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:30.024379 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:30.083346 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a6fa6a7f4a4e4fbfd711dbf9b73916'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.087144 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a6fa6a7f4a4e4fbfd711dbf9b73916'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.097081 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a6fa6a7f4a4e4fbfd711dbf9b73916'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.097875 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a6fa6a7f4a4e4fbfd711dbf9b73916'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.112102 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a6fa6a7f4a4e4fbfd711dbf9b73916'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.125391 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1441/2896] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:42:29 2022] DELETE /identity/v3/users/e9a6fa6a7f4a4e4fbfd711dbf9b73916 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:30.315555 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97fa8b-ac7e-4453-b42d-42c3d39232d9 service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:30.326898 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97fa8b-ac7e-4453-b42d-42c3d39232d9 service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:30.389271 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:30.390145 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:30.390653 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:30.390931 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] PATH_INFO: `/v3/projects/ca15877a4df44b7396c1a1175f2ff437` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:30.392057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca15877a4df44b7396c1a1175f2ff437)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:30.393998 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:30.439670 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca15877a4df44b7396c1a1175f2ff437', 'request_id': 'req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.444921 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca15877a4df44b7396c1a1175f2ff437', 'request_id': 'req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.452313 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca15877a4df44b7396c1a1175f2ff437', 'request_id': 'req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.463635 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] The token cache is being invalidate because project ca15877a4df44b7396c1a1175f2ff437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:42:30.463919 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.464546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.466718 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1456/2897] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:42:30 2022] DELETE /identity/v3/projects/ca15877a4df44b7396c1a1175f2ff437 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:30.470811 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:30.472231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:30.486287 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c681870-b7a2-4715-806f-2e1e31519216 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:30.542641 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:30.543273 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:30.543553 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:30.543845 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] PATH_INFO: `/v3/users/3d58b51e9e6946eb95c6c943e75d412b` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:30.545001 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d58b51e9e6946eb95c6c943e75d412b)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:30.547025 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:30.592666 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d58b51e9e6946eb95c6c943e75d412b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.593318 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d58b51e9e6946eb95c6c943e75d412b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.600498 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d58b51e9e6946eb95c6c943e75d412b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.601158 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d58b51e9e6946eb95c6c943e75d412b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.612865 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d58b51e9e6946eb95c6c943e75d412b'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.614814 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:30.627786 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1442/2898] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:42:30 2022] DELETE /identity/v3/users/3d58b51e9e6946eb95c6c943e75d412b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:30.794471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:30.796046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:30.808845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cad4c-b712-46e7-b7eb-c0e8cb7b35e8 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:30.830987 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:30.871358 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:30.872116 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:30.872937 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:30.873213 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] PATH_INFO: `/v3/projects/761b1cd067854460a1b63cb94cdfb1a3` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:30.874526 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=761b1cd067854460a1b63cb94cdfb1a3)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:30.876462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:30.923483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761b1cd067854460a1b63cb94cdfb1a3', 'request_id': 'req-8accdf40-6b5a-43ee-83da-b398af2f1cd4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.929009 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761b1cd067854460a1b63cb94cdfb1a3', 'request_id': 'req-8accdf40-6b5a-43ee-83da-b398af2f1cd4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.936626 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761b1cd067854460a1b63cb94cdfb1a3', 'request_id': 'req-8accdf40-6b5a-43ee-83da-b398af2f1cd4'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.947704 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] The token cache is being invalidate because project 761b1cd067854460a1b63cb94cdfb1a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:42:30.948099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.948735 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:30.950201 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1457/2899] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:42:30 2022] DELETE /identity/v3/projects/761b1cd067854460a1b63cb94cdfb1a3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:32.884326 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:32.885868 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:32.899480 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1da44d-f9af-40ea-b7b9-f6e071f37157 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:32.954781 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eff8d-fc78-423a-be1b-c84ce6555b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:32.955406 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eff8d-fc78-423a-be1b-c84ce6555b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:32.955684 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eff8d-fc78-423a-be1b-c84ce6555b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:32.955957 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eff8d-fc78-423a-be1b-c84ce6555b28 admin admin] PATH_INFO: `/v3/users/09c6e6f7803f4feca497bfc43134a6b2` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:32.957071 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eff8d-fc78-423a-be1b-c84ce6555b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c6e6f7803f4feca497bfc43134a6b2)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:32.959026 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eff8d-fc78-423a-be1b-c84ce6555b28 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:33.002363 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-127eff8d-fc78-423a-be1b-c84ce6555b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c6e6f7803f4feca497bfc43134a6b2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:33.003042 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-127eff8d-fc78-423a-be1b-c84ce6555b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c6e6f7803f4feca497bfc43134a6b2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:33.010400 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-127eff8d-fc78-423a-be1b-c84ce6555b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c6e6f7803f4feca497bfc43134a6b2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:33.011182 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-127eff8d-fc78-423a-be1b-c84ce6555b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c6e6f7803f4feca497bfc43134a6b2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:33.023944 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-127eff8d-fc78-423a-be1b-c84ce6555b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c6e6f7803f4feca497bfc43134a6b2'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:33.035673 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1443/2900] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:42:32 2022] DELETE /identity/v3/users/09c6e6f7803f4feca497bfc43134a6b2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:33.204374 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:33.205855 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:33.219040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accdf40-6b5a-43ee-83da-b398af2f1cd4 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:33.279656 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc1a66-0bae-4e46-b445-009b0e685829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:33.280209 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc1a66-0bae-4e46-b445-009b0e685829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:33.280483 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc1a66-0bae-4e46-b445-009b0e685829 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:33.280751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc1a66-0bae-4e46-b445-009b0e685829 admin admin] PATH_INFO: `/v3/projects/03dd55b892d142328ae0e5738f5179b7` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:33.281878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc1a66-0bae-4e46-b445-009b0e685829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03dd55b892d142328ae0e5738f5179b7)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:33.283799 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc1a66-0bae-4e46-b445-009b0e685829 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:33.330132 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-19fc1a66-0bae-4e46-b445-009b0e685829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03dd55b892d142328ae0e5738f5179b7', 'request_id': 'req-19fc1a66-0bae-4e46-b445-009b0e685829'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:33.334611 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:33.335864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-19fc1a66-0bae-4e46-b445-009b0e685829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03dd55b892d142328ae0e5738f5179b7', 'request_id': 'req-19fc1a66-0bae-4e46-b445-009b0e685829'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:33.343449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-19fc1a66-0bae-4e46-b445-009b0e685829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03dd55b892d142328ae0e5738f5179b7', 'request_id': 'req-19fc1a66-0bae-4e46-b445-009b0e685829'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:33.354673 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-19fc1a66-0bae-4e46-b445-009b0e685829 admin admin] The token cache is being invalidate because project 03dd55b892d142328ae0e5738f5179b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104774) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:42:33.354960 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-19fc1a66-0bae-4e46-b445-009b0e685829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:33.355581 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-19fc1a66-0bae-4e46-b445-009b0e685829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:42:33.357534 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1458/2901] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:42:33 2022] DELETE /identity/v3/projects/03dd55b892d142328ae0e5738f5179b7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:33.362416 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79432de4-8664-4893-a275-1a6dd360dd2d None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:33.362737 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79432de4-8664-4893-a275-1a6dd360dd2d None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:33.363012 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79432de4-8664-4893-a275-1a6dd360dd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:33.382499 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-79432de4-8664-4893-a275-1a6dd360dd2d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:33.383724 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-79432de4-8664-4893-a275-1a6dd360dd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:33.440988 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1444/2902] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:42:33.449585 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80cf4f-47c5-4198-8bed-9d5a89c02a1d None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:33.449870 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80cf4f-47c5-4198-8bed-9d5a89c02a1d None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:33.450140 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80cf4f-47c5-4198-8bed-9d5a89c02a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:33.470057 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-eb80cf4f-47c5-4198-8bed-9d5a89c02a1d None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:33.471288 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-eb80cf4f-47c5-4198-8bed-9d5a89c02a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:33.479046 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1459/2903] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:42:33.483742 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79432de4-8664-4893-a275-1a6dd360dd2d None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:33.493373 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79432de4-8664-4893-a275-1a6dd360dd2d None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:33.497937 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310c553-5dd2-4295-b5e1-474c4830cae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:33.498555 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310c553-5dd2-4295-b5e1-474c4830cae6 admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:33.498838 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310c553-5dd2-4295-b5e1-474c4830cae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:33.499107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310c553-5dd2-4295-b5e1-474c4830cae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:33.499745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310c553-5dd2-4295-b5e1-474c4830cae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=104772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 05:42:33.500044 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310c553-5dd2-4295-b5e1-474c4830cae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:33.501632 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310c553-5dd2-4295-b5e1-474c4830cae6 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:33.508225 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:33.513854 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1445/2904] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 05:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 05:42:33.517912 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80cf4f-47c5-4198-8bed-9d5a89c02a1d None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:33.526976 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80cf4f-47c5-4198-8bed-9d5a89c02a1d None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:33.532187 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c4b8c-dcfa-42d3-9a2c-cd8d46c4c38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:33.532714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c4b8c-dcfa-42d3-9a2c-cd8d46c4c38a admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:33.532986 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c4b8c-dcfa-42d3-9a2c-cd8d46c4c38a admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:33.533258 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c4b8c-dcfa-42d3-9a2c-cd8d46c4c38a admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:33.533878 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c4b8c-dcfa-42d3-9a2c-cd8d46c4c38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:33.535784 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c4b8c-dcfa-42d3-9a2c-cd8d46c4c38a admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:33.563467 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1460/2905] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:42:33 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:42:33.567577 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310c553-5dd2-4295-b5e1-474c4830cae6 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:33.577450 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310c553-5dd2-4295-b5e1-474c4830cae6 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:33.632471 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e030b-c6a8-4e69-b637-ef696bc9e913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:33.633108 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e030b-c6a8-4e69-b637-ef696bc9e913 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:33.633356 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e030b-c6a8-4e69-b637-ef696bc9e913 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:33.633622 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e030b-c6a8-4e69-b637-ef696bc9e913 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:33.634256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e030b-c6a8-4e69-b637-ef696bc9e913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:33.636216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e030b-c6a8-4e69-b637-ef696bc9e913 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:33.660038 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1446/2906] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:42:33 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 05:42:33.664076 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c4b8c-dcfa-42d3-9a2c-cd8d46c4c38a admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:33.674915 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c4b8c-dcfa-42d3-9a2c-cd8d46c4c38a admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:33.679481 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b919737-888f-4eae-8421-b24b2e97443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:33.680073 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b919737-888f-4eae-8421-b24b2e97443e admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:33.680353 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b919737-888f-4eae-8421-b24b2e97443e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:33.680625 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b919737-888f-4eae-8421-b24b2e97443e admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:33.681260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b919737-888f-4eae-8421-b24b2e97443e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:33.682885 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b919737-888f-4eae-8421-b24b2e97443e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:33.692638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1461/2907] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:42:33.696404 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e030b-c6a8-4e69-b637-ef696bc9e913 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:33.706348 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e030b-c6a8-4e69-b637-ef696bc9e913 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:33.710969 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4f17f-3853-4ba3-9b65-1dc2b87211dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:33.711552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4f17f-3853-4ba3-9b65-1dc2b87211dc admin admin] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:33.711830 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4f17f-3853-4ba3-9b65-1dc2b87211dc admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:33.712096 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4f17f-3853-4ba3-9b65-1dc2b87211dc admin admin] PATH_INFO: `/v3/roles` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:33.712724 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4f17f-3853-4ba3-9b65-1dc2b87211dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:33.714308 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4f17f-3853-4ba3-9b65-1dc2b87211dc admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:33.726286 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1447/2908] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:42:33.730582 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b919737-888f-4eae-8421-b24b2e97443e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:33.741027 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b919737-888f-4eae-8421-b24b2e97443e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:33.745550 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15d387-5831-4f9d-9d15-569698b16766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:33.746179 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15d387-5831-4f9d-9d15-569698b16766 admin admin] REQUEST_METHOD: `PUT` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:33.746452 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15d387-5831-4f9d-9d15-569698b16766 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:33.746751 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15d387-5831-4f9d-9d15-569698b16766 admin admin] PATH_INFO: `/v3/projects/fa7da58709f4441cbedb91417659bc00/users/c162ea1a4206421bb792b1faddded1f7/roles/d912a7e672bb441099f4ef85d61e7c46` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:33.761078 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15d387-5831-4f9d-9d15-569698b16766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7da58709f4441cbedb91417659bc00, user_id=c162ea1a4206421bb792b1faddded1f7, role_id=d912a7e672bb441099f4ef85d61e7c46)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:33.763714 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15d387-5831-4f9d-9d15-569698b16766 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:33.775950 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1462/2909] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:42:33 2022] PUT /identity/v3/projects/fa7da58709f4441cbedb91417659bc00/users/c162ea1a4206421bb792b1faddded1f7/roles/d912a7e672bb441099f4ef85d61e7c46 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:33.781455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c90ddb-108e-42cc-9357-0925e8c453ff None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:33.781736 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c90ddb-108e-42cc-9357-0925e8c453ff None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:33.782018 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c90ddb-108e-42cc-9357-0925e8c453ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:33.801107 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-65c90ddb-108e-42cc-9357-0925e8c453ff None None] MFA Rules not processed for user `c4192bd98cd24e289022a82073365dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:33.802288 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-65c90ddb-108e-42cc-9357-0925e8c453ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:33.865098 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1448/2910] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:42:33.874717 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15d387-5831-4f9d-9d15-569698b16766 admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:33.876390 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-ab15d387-5831-4f9d-9d15-569698b16766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:33.931729 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15d387-5831-4f9d-9d15-569698b16766 admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:33.935468 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31020c-48bd-450b-8b9e-c0066e4b4c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:33.936077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31020c-48bd-450b-8b9e-c0066e4b4c1b service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:33.936384 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31020c-48bd-450b-8b9e-c0066e4b4c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:33.936661 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31020c-48bd-450b-8b9e-c0066e4b4c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:33.945850 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31020c-48bd-450b-8b9e-c0066e4b4c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:33.947304 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31020c-48bd-450b-8b9e-c0066e4b4c1b service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:33.957406 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1463/2911] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:42:37.828047 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4ca71-7994-429d-8135-c63804b08723 None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:37.828788 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4ca71-7994-429d-8135-c63804b08723 None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:37.828908 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4ca71-7994-429d-8135-c63804b08723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:37.857856 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-e5c4ca71-7994-429d-8135-c63804b08723 None None] MFA Rules not processed for user `c162ea1a4206421bb792b1faddded1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:37.859121 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e5c4ca71-7994-429d-8135-c63804b08723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:37.923979 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1449/2912] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:42:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:42:37.928520 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31020c-48bd-450b-8b9e-c0066e4b4c1b service neutron] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:37.939067 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31020c-48bd-450b-8b9e-c0066e4b4c1b service neutron] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:37.943804 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e023b-9612-4e59-a16f-a371dea4ce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:37.944431 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e023b-9612-4e59-a16f-a371dea4ce7d admin admin] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:37.944711 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e023b-9612-4e59-a16f-a371dea4ce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:37.944983 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e023b-9612-4e59-a16f-a371dea4ce7d admin admin] PATH_INFO: `/v3/projects` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:37.945638 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e023b-9612-4e59-a16f-a371dea4ce7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:37.947630 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e023b-9612-4e59-a16f-a371dea4ce7d admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:37.976711 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1464/2913] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 05:42:37 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:42:37.980685 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4ca71-7994-429d-8135-c63804b08723 None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:37.992204 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4ca71-7994-429d-8135-c63804b08723 None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:37.996040 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:38.053570 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaccdd-e961-4b85-b0cd-c825d5c10e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:38.054194 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaccdd-e961-4b85-b0cd-c825d5c10e31 admin admin] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:38.054539 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaccdd-e961-4b85-b0cd-c825d5c10e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:38.054807 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaccdd-e961-4b85-b0cd-c825d5c10e31 admin admin] PATH_INFO: `/v3/users` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:38.055449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfaccdd-e961-4b85-b0cd-c825d5c10e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:38.057395 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfaccdd-e961-4b85-b0cd-c825d5c10e31 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:38.081723 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1450/2914] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 05:42:37 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 05:42:38.086099 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e023b-9612-4e59-a16f-a371dea4ce7d admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:38.098081 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e023b-9612-4e59-a16f-a371dea4ce7d admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:38.103102 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc6764-fc1d-4aab-896e-97cb47342a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:38.103725 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc6764-fc1d-4aab-896e-97cb47342a0c admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:38.104007 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc6764-fc1d-4aab-896e-97cb47342a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:38.104312 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc6764-fc1d-4aab-896e-97cb47342a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:38.104910 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc6764-fc1d-4aab-896e-97cb47342a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:38.107260 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc6764-fc1d-4aab-896e-97cb47342a0c admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:38.119706 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1465/2915] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 05:42:38.123749 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaccdd-e961-4b85-b0cd-c825d5c10e31 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:38.134034 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaccdd-e961-4b85-b0cd-c825d5c10e31 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:38.139099 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884748f2-e04c-420d-ad22-2dee399fec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:38.139741 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884748f2-e04c-420d-ad22-2dee399fec2b admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:38.140015 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884748f2-e04c-420d-ad22-2dee399fec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:38.140311 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884748f2-e04c-420d-ad22-2dee399fec2b admin admin] PATH_INFO: `/v3/projects/4ba73e0155a84121b26db9e9659c72b8/users/f5d546f692dd4e898053c01e8f182dd5/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:38.155455 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884748f2-e04c-420d-ad22-2dee399fec2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba73e0155a84121b26db9e9659c72b8, user_id=f5d546f692dd4e898053c01e8f182dd5, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:38.158181 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884748f2-e04c-420d-ad22-2dee399fec2b admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:38.174444 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1451/2916] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:42:38 2022] PUT /identity/v3/projects/4ba73e0155a84121b26db9e9659c72b8/users/f5d546f692dd4e898053c01e8f182dd5/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:38.175728 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc6764-fc1d-4aab-896e-97cb47342a0c admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:38.186568 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc6764-fc1d-4aab-896e-97cb47342a0c admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:38.234571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:38.249593 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db2f68-6bc3-4009-9cc0-80e0b4c10318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:38.250213 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db2f68-6bc3-4009-9cc0-80e0b4c10318 admin admin] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:38.250482 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db2f68-6bc3-4009-9cc0-80e0b4c10318 admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:38.250800 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db2f68-6bc3-4009-9cc0-80e0b4c10318 admin admin] PATH_INFO: `/v3/roles` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:38.251443 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db2f68-6bc3-4009-9cc0-80e0b4c10318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:38.253090 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db2f68-6bc3-4009-9cc0-80e0b4c10318 admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:38.265024 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1466/2917] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 05:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 05:42:38.269647 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884748f2-e04c-420d-ad22-2dee399fec2b admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:38.280889 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884748f2-e04c-420d-ad22-2dee399fec2b admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:38.285962 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfaef1-4dd9-49d5-95df-50dbb76b7ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:38.286709 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfaef1-4dd9-49d5-95df-50dbb76b7ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:38.286985 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfaef1-4dd9-49d5-95df-50dbb76b7ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:38.287306 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfaef1-4dd9-49d5-95df-50dbb76b7ec8 admin admin] PATH_INFO: `/v3/projects/4ba73e0155a84121b26db9e9659c72b8/users/f5d546f692dd4e898053c01e8f182dd5/roles/58e91278467047aaa25e6e7b7e1dc735` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:38.289290 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfaef1-4dd9-49d5-95df-50dbb76b7ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba73e0155a84121b26db9e9659c72b8, user_id=f5d546f692dd4e898053c01e8f182dd5, role_id=58e91278467047aaa25e6e7b7e1dc735)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:38.291955 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfaef1-4dd9-49d5-95df-50dbb76b7ec8 admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:38.303262 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1452/2918] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 05:42:38 2022] PUT /identity/v3/projects/4ba73e0155a84121b26db9e9659c72b8/users/f5d546f692dd4e898053c01e8f182dd5/roles/58e91278467047aaa25e6e7b7e1dc735 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:42:42.693198 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631ef75-dddb-445e-932c-600fb2908fdf None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:42.693646 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631ef75-dddb-445e-932c-600fb2908fdf None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:42.693732 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631ef75-dddb-445e-932c-600fb2908fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:42.740004 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-0631ef75-dddb-445e-932c-600fb2908fdf None None] MFA Rules not processed for user `f5d546f692dd4e898053c01e8f182dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:42.741257 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-0631ef75-dddb-445e-932c-600fb2908fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:42.872528 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1467/2919] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:42:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:42:42.885601 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfaef1-4dd9-49d5-95df-50dbb76b7ec8 admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:42.888013 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-e7dfaef1-4dd9-49d5-95df-50dbb76b7ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:42.987256 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfaef1-4dd9-49d5-95df-50dbb76b7ec8 admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:42.990994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57de06-fc8c-455b-bc24-e6f4328a48bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20d8e253a72c44f7a5a986f981660df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:42.991593 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57de06-fc8c-455b-bc24-e6f4328a48bc service glance] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:42.991874 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57de06-fc8c-455b-bc24-e6f4328a48bc service glance] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:42.992149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57de06-fc8c-455b-bc24-e6f4328a48bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:43.055000 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:43.059338 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57de06-fc8c-455b-bc24-e6f4328a48bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:43.061277 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57de06-fc8c-455b-bc24-e6f4328a48bc service glance] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:43.072265 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1453/2920] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:42:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:42:43.221557 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11d270-45f9-4f55-99e9-03c2977708a0 None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:43.222077 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11d270-45f9-4f55-99e9-03c2977708a0 None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:43.223253 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11d270-45f9-4f55-99e9-03c2977708a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:43.268303 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-5d11d270-45f9-4f55-99e9-03c2977708a0 None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:43.269546 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5d11d270-45f9-4f55-99e9-03c2977708a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:43.346448 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1468/2921] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:42:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:42:43.398051 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57de06-fc8c-455b-bc24-e6f4328a48bc service glance] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:43.399743 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-ce57de06-fc8c-455b-bc24-e6f4328a48bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:43.480343 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57de06-fc8c-455b-bc24-e6f4328a48bc service glance] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:43.485934 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac8127-a084-4a4a-acaa-abfe22ec2e4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:43.486561 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac8127-a084-4a4a-acaa-abfe22ec2e4e service swift] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:43.486841 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac8127-a084-4a4a-acaa-abfe22ec2e4e service swift] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:43.487106 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac8127-a084-4a4a-acaa-abfe22ec2e4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:43.495021 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac8127-a084-4a4a-acaa-abfe22ec2e4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:43.496655 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac8127-a084-4a4a-acaa-abfe22ec2e4e service swift] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:43.506354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1454/2922] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:42:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:42:50.401242 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11d270-45f9-4f55-99e9-03c2977708a0 None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:50.404530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-5d11d270-45f9-4f55-99e9-03c2977708a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:50.442965 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=100 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:42:50.515321 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11d270-45f9-4f55-99e9-03c2977708a0 None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:50.520400 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2a2ab-8211-45e1-876a-cb9124ab6442 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef60b27f5f545aa8ea063009ec66eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:50.521003 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2a2ab-8211-45e1-876a-cb9124ab6442 service placement] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:50.521284 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2a2ab-8211-45e1-876a-cb9124ab6442 service placement] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:50.521554 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2a2ab-8211-45e1-876a-cb9124ab6442 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:50.523329 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-97b2a2ab-8211-45e1-876a-cb9124ab6442 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:50.536508 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2a2ab-8211-45e1-876a-cb9124ab6442 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:50.538098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2a2ab-8211-45e1-876a-cb9124ab6442 service placement] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:50.549361 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1469/2923] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:42:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:42:52.175548 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396c909-8f4f-456d-93d2-f4ac2ebbf8af None None] REQUEST_METHOD: `POST` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:52.176088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396c909-8f4f-456d-93d2-f4ac2ebbf8af None None] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:52.176088 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396c909-8f4f-456d-93d2-f4ac2ebbf8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:52.195696 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.auth.core [None req-5396c909-8f4f-456d-93d2-f4ac2ebbf8af None None] MFA Rules not processed for user `c162ea1a4206421bb792b1faddded1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=104772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:52.196914 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-5396c909-8f4f-456d-93d2-f4ac2ebbf8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:52.204574 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1455/2924] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 05:42:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:42:54.421571 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7783ce-3f57-41b6-90fd-6006d354a97b None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:54.422059 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7783ce-3f57-41b6-90fd-6006d354a97b None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:54.422181 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7783ce-3f57-41b6-90fd-6006d354a97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:54.441862 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-cc7783ce-3f57-41b6-90fd-6006d354a97b None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:42:54.443098 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-cc7783ce-3f57-41b6-90fd-6006d354a97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:42:54.450492 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1470/2925] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 05:42:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:42:54.463827 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396c909-8f4f-456d-93d2-f4ac2ebbf8af None None] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:42:54.477874 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396c909-8f4f-456d-93d2-f4ac2ebbf8af None None] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:42:54.483758 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5f970-f114-471c-afd6-1af6b1af94ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:42:54.484598 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5f970-f114-471c-afd6-1af6b1af94ae service swift] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:42:54.484903 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5f970-f114-471c-afd6-1af6b1af94ae service swift] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:42:54.485226 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5f970-f114-471c-afd6-1af6b1af94ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:42:54.494085 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5f970-f114-471c-afd6-1af6b1af94ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:42:54.495920 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5f970-f114-471c-afd6-1af6b1af94ae service swift] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:42:54.504950 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1456/2926] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:42:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:43:04.436954 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=31 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:43:04.501476 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=44 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:43:14.196042 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7783ce-3f57-41b6-90fd-6006d354a97b None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:43:14.260366 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7783ce-3f57-41b6-90fd-6006d354a97b None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:43:14.264594 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069526b4-ad7a-44db-a6ea-ed69d6617a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51f44d06b0f4303a753709bd1bcf3e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:43:14.265185 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069526b4-ad7a-44db-a6ea-ed69d6617a49 service neutron] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:43:14.265462 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069526b4-ad7a-44db-a6ea-ed69d6617a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:43:14.265734 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069526b4-ad7a-44db-a6ea-ed69d6617a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:43:14.274530 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069526b4-ad7a-44db-a6ea-ed69d6617a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:43:14.275951 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069526b4-ad7a-44db-a6ea-ed69d6617a49 service neutron] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:43:14.285113 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1471/2927] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:43:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:43:17.547008 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5f970-f114-471c-afd6-1af6b1af94ae service swift] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:43:17.549140 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-18b5f970-f114-471c-afd6-1af6b1af94ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:43:17.677421 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5f970-f114-471c-afd6-1af6b1af94ae service swift] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:43:17.683354 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d96939-5bd4-48e0-aa60-f5eaf0067c52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515e548efd984b87bca742e26eec162a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:43:17.684775 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d96939-5bd4-48e0-aa60-f5eaf0067c52 service nova] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:43:17.685123 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d96939-5bd4-48e0-aa60-f5eaf0067c52 service nova] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:43:17.685602 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d96939-5bd4-48e0-aa60-f5eaf0067c52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:43:17.687449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-96d96939-5bd4-48e0-aa60-f5eaf0067c52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:43:17.701796 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d96939-5bd4-48e0-aa60-f5eaf0067c52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:43:17.703529 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d96939-5bd4-48e0-aa60-f5eaf0067c52 service nova] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:43:17.715449 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1457/2928] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:43:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:43:24.281064 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=30 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:43:27.715500 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=43 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:44:36.067039 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e5bf6-770a-4c29-a9d7-633fbdc3867e None None] REQUEST_METHOD: `POST` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:44:36.067505 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e5bf6-770a-4c29-a9d7-633fbdc3867e None None] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:44:36.067607 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e5bf6-770a-4c29-a9d7-633fbdc3867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:44:36.086927 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.auth.core [None req-934e5bf6-770a-4c29-a9d7-633fbdc3867e None None] MFA Rules not processed for user `10247532345a4f75939950b803202cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=104774) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 05:44:36.088131 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-934e5bf6-770a-4c29-a9d7-633fbdc3867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:44:36.095191 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1472/2929] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 16 05:44:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 05:44:36.134943 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d96939-5bd4-48e0-aa60-f5eaf0067c52 service nova] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:44:36.146050 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d96939-5bd4-48e0-aa60-f5eaf0067c52 service nova] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:44:36.150912 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8679915-0d44-4d7a-a6e7-464b53f0c7ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bae43204e3984619b4fdb64f36ef47ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:44:36.151495 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679915-0d44-4d7a-a6e7-464b53f0c7ac service swift] REQUEST_METHOD: `GET` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:44:36.151765 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679915-0d44-4d7a-a6e7-464b53f0c7ac service swift] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:44:36.152032 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679915-0d44-4d7a-a6e7-464b53f0c7ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:44:36.159752 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8679915-0d44-4d7a-a6e7-464b53f0c7ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:44:36.161334 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8679915-0d44-4d7a-a6e7-464b53f0c7ac service swift] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:44:36.169573 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1458/2930] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 05:44:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 05:44:42.373040 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e5bf6-770a-4c29-a9d7-633fbdc3867e None None] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:44:42.455752 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e5bf6-770a-4c29-a9d7-633fbdc3867e None None] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:44:42.460501 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:44:42.461124 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:44:42.461404 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:44:42.461675 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] PATH_INFO: `/v3/users/c162ea1a4206421bb792b1faddded1f7` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:44:42.462846 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c162ea1a4206421bb792b1faddded1f7)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:44:42.464830 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:44:42.509471 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c162ea1a4206421bb792b1faddded1f7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:42.510687 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c162ea1a4206421bb792b1faddded1f7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:42.517564 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c162ea1a4206421bb792b1faddded1f7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:42.524871 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c162ea1a4206421bb792b1faddded1f7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:42.525506 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c162ea1a4206421bb792b1faddded1f7'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:42.542424 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1473/2931] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:44:42 2022] DELETE /identity/v3/users/c162ea1a4206421bb792b1faddded1f7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:44:42.712566 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8679915-0d44-4d7a-a6e7-464b53f0c7ac service swift] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:44:42.725193 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8679915-0d44-4d7a-a6e7-464b53f0c7ac service swift] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:44:42.781552 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:44:42.782176 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:44:42.782458 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:44:42.782768 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] PATH_INFO: `/v3/projects/fa7da58709f4441cbedb91417659bc00` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:44:42.783881 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa7da58709f4441cbedb91417659bc00)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:44:42.785785 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:44:42.833954 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa7da58709f4441cbedb91417659bc00', 'request_id': 'req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:42.840502 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa7da58709f4441cbedb91417659bc00', 'request_id': 'req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:42.849231 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa7da58709f4441cbedb91417659bc00', 'request_id': 'req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:42.875745 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] The token cache is being invalidate because project fa7da58709f4441cbedb91417659bc00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:44:42.876035 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:42.876669 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:42.878149 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1459/2932] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:44:42 2022] DELETE /identity/v3/projects/fa7da58709f4441cbedb91417659bc00 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:44:42.882151 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:44:42.883601 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:44:42.896203 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff61758-e923-4ddc-8577-55bf7c63d55a admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:44:42.945933 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:44:42.953567 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:44:42.954859 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:44:42.955252 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:44:42.955551 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] PATH_INFO: `/v3/users/f5d546f692dd4e898053c01e8f182dd5` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:44:42.956968 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d546f692dd4e898053c01e8f182dd5)` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:44:42.959162 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:44:43.005485 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d546f692dd4e898053c01e8f182dd5'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:43.006126 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d546f692dd4e898053c01e8f182dd5'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:43.013466 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d546f692dd4e898053c01e8f182dd5'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:43.021180 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d546f692dd4e898053c01e8f182dd5'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:43.021864 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.notifications [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d546f692dd4e898053c01e8f182dd5'} {{(pid=104774) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:43.039449 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1474/2933] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 05:44:42 2022] DELETE /identity/v3/users/f5d546f692dd4e898053c01e8f182dd5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:44:43.204091 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] Authenticating user token {{(pid=104772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:44:43.205862 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.fernet_utils [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:44:43.219968 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889601fa-2cbf-4ac8-b53c-fde73fd9f22c admin admin] Validating token access rules against request {{(pid=104772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:44:43.280305 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1112985-6d13-4012-bd68-9f00a2332d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4192bd98cd24e289022a82073365dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0a847de7a845db8a359724caa6c1da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:44:43.280940 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1112985-6d13-4012-bd68-9f00a2332d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:44:43.281216 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1112985-6d13-4012-bd68-9f00a2332d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:44:43.281644 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1112985-6d13-4012-bd68-9f00a2332d8a admin admin] PATH_INFO: `/v3/projects/4ba73e0155a84121b26db9e9659c72b8` {{(pid=104772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:44:43.294733 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1112985-6d13-4012-bd68-9f00a2332d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba73e0155a84121b26db9e9659c72b8)` {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:44:43.294733 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1112985-6d13-4012-bd68-9f00a2332d8a admin admin] RBAC: Authorization granted {{(pid=104772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:44:43.301956 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:44:43.343007 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d1112985-6d13-4012-bd68-9f00a2332d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba73e0155a84121b26db9e9659c72b8', 'request_id': 'req-d1112985-6d13-4012-bd68-9f00a2332d8a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:43.348355 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d1112985-6d13-4012-bd68-9f00a2332d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba73e0155a84121b26db9e9659c72b8', 'request_id': 'req-d1112985-6d13-4012-bd68-9f00a2332d8a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:43.356062 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d1112985-6d13-4012-bd68-9f00a2332d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba73e0155a84121b26db9e9659c72b8', 'request_id': 'req-d1112985-6d13-4012-bd68-9f00a2332d8a'} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:43.367703 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d1112985-6d13-4012-bd68-9f00a2332d8a admin admin] The token cache is being invalidate because project 4ba73e0155a84121b26db9e9659c72b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=104772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 05:44:43.367994 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d1112985-6d13-4012-bd68-9f00a2332d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:43.368752 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG keystone.notifications [None req-d1112985-6d13-4012-bd68-9f00a2332d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=104772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 05:44:43.371041 dv-cinder-857528-3-smb devstack@keystone.service[104772]: [pid: 104772|app: 0|req: 1460/2934] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 05:44:43 2022] DELETE /identity/v3/projects/4ba73e0155a84121b26db9e9659c72b8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 05:44:53.035975 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=28,keystone:DELETE=10,keystone:INSERT=1 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:44:53.364586 dv-cinder-857528-3-smb devstack@keystone.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 05:47:52.458061 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] Authenticating user token {{(pid=104774) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 05:47:52.459514 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:47:52.526401 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005e565-9883-4b3c-b849-d3144317d25e admin admin] Validating token access rules against request {{(pid=104774) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 05:47:52.584380 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9d37f-10c5-4a4a-877f-b11d65a853de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ef60b27f5f545aa8ea063009ec66eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74c9d19fb1534f8f8888e957d1007640', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=104774) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 05:47:52.584970 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9d37f-10c5-4a4a-877f-b11d65a853de service placement] REQUEST_METHOD: `GET` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 05:47:52.585246 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9d37f-10c5-4a4a-877f-b11d65a853de service placement] SCRIPT_NAME: `/identity` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 05:47:52.585513 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9d37f-10c5-4a4a-877f-b11d65a853de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=104774) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 05:47:52.587240 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.fernet_utils [None req-07e9d37f-10c5-4a4a-877f-b11d65a853de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=104774) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 05:47:52.598845 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9d37f-10c5-4a4a-877f-b11d65a853de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 05:47:52.600400 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9d37f-10c5-4a4a-877f-b11d65a853de service placement] RBAC: Authorization granted {{(pid=104774) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 05:47:52.610091 dv-cinder-857528-3-smb devstack@keystone.service[104774]: [pid: 104774|app: 0|req: 1475/2935] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 05:47:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 05:48:02.606465 dv-cinder-857528-3-smb devstack@keystone.service[104774]: DEBUG dbcounter [-] [104774] Writing DB stats keystone:SELECT=58 {{(pid=104774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}